Sep 17 13:55:54.105312 ip-10-0-132-81 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 13:55:54.510847 ip-10-0-132-81 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 13:55:54.510847 ip-10-0-132-81 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 13:55:54.510847 ip-10-0-132-81 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 13:55:54.510847 ip-10-0-132-81 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 13:55:54.510847 ip-10-0-132-81 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 13:55:54.511747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.511674    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 13:55:54.514542 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514527    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.514542 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514542    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514546    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514551    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514554    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514558    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514561    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514564    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514567    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514570    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514572    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514575    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514578    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514580    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514583    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514585    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514588    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514590    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514594    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.514608 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514598    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514602    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514606    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514616    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514619    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514622    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514624    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514626    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514629    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514632    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514634    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514637    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514640    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514642    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514645    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514648    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514651    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514653    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514656    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514658    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.515062 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514661    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514663    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514667    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514670    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514672    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514675    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514677    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514679    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514683    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514685    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514687    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514690    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514692    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514695    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514698    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514700    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514703    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514705    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514708    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514710    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.515553 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514713    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514715    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514718    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514720    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514723    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514725    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514728    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514730    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514733    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514735    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514738    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514741    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514743    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514746    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514748    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514751    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514753    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514756    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514758    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514761    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.516054 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514764    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514767    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514770    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514773    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514775    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514778    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514781    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514783    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514786    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514788    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514791    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514794    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514796    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514799    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514801    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514804    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514807    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514809    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514812    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.516537 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.514814    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516030    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516052    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516056    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516060    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516063    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516066    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516069    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516072    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516074    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516077    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516079    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516082    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516084    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516087    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516090    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516093    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516095    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516098    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.516988 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516101    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516104    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516106    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516109    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516112    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516115    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516117    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516121    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516125    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516128    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516131    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516134    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516136    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516139    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516142    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516144    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516147    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516150    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516152    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516155    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.517479 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516158    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516160    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516163    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516165    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516168    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516171    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516174    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516176    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516178    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516181    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516184    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516187    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516192    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516194    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516197    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516199    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516202    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516205    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516207    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516209    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.517972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516212    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516215    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516217    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516220    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516222    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516226    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516230    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516233    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516236    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516239    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516241    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516244    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516246    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516249    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516251    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516254    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516258    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516260    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516263    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.518471 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516265    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516268    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516270    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516274    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516276    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516280    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516283    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516285    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516288    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516291    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516293    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516296    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516298    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516301    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516305    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516308    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516311    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516314    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516316    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516319    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.518979 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516322    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516325    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516670    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516675    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516678    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516680    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516683    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516686    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516688    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516691    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516694    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516697    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516699    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516702    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516705    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516719    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516722    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516726    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516728    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516731    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.519499 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516733    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516736    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516739    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516741    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516744    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516747    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516749    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516752    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516755    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516757    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516760    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516762    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516764    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516767    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516770    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516773    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516777    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516780    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516782    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516784    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.519975 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516787    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516789    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516792    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516795    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516798    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516800    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516803    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516807    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516816    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516820    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516823    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516827    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516830    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516833    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516836    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516839    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516842    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516844    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.520492 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516847    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516850    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516852    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516855    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516857    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516860    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516862    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516864    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516867    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516870    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516872    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516875    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516877    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516880    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516882    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516884    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516887    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516890    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516892    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516894    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.520928 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516897    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516899    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516902    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516905    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516908    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516910    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516913    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516915    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516918    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516920    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516923    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516925    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516928    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516930    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516933    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516936    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516938    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516941    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516943    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516946    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.521457 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516948    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516951    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.516953    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517033    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517092    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517099    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517103    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517107    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517111    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517115    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517119    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517122    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517125    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517128    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517131    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517134    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517138    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517141    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517144    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517147    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517149    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517154    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517156    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517159    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 13:55:54.521973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517162    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517166    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517174    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517176    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517179    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517182    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517185    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517188    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517191    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517194    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517197    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517201    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517204    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517206    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517209    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517212    2579 flags.go:64] FLAG: --enable-server="true"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517215    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517221    2579 flags.go:64] FLAG: --event-burst="100"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517224    2579 flags.go:64] FLAG: --event-qps="50"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517227    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517230    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517233    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517239    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517242    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517245    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 13:55:54.522548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517248    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517251    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517254    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517256    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517259    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517262    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517265    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517268    2579 flags.go:64] FLAG: --feature-gates=""
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517272    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517274    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517277    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517280    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517283    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517286    2579 flags.go:64] FLAG: --help="false"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517289    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517292    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517296    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517299    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517302    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517305    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517308    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517311    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517313    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 13:55:54.523172 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517316    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517320    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517324    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517326    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517329    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517332    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517337    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517339    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517342    2579 flags.go:64] FLAG: --lock-file=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517345    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517348    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517351    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517357    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517359    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517362    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517365    2579 flags.go:64] FLAG: --logging-format="text"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517368    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517371    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517374    2579 flags.go:64] FLAG: --manifest-url=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517377    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517381    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517384    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517388    2579 flags.go:64] FLAG: --max-pods="110"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517391    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517393    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 13:55:54.523911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517396    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517399    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517402    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517405    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517409    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517416    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517419    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517422    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517426    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517429    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517435    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517437    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517441    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517443    2579 flags.go:64] FLAG: --port="10250"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517447    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517450    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02bcadb4fd973279d"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517453    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517456    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517461    2579 flags.go:64] FLAG: --register-node="true"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517463    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517467    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517470    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517473    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517475    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517479    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 13:55:54.525015 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517482    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517485    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517488    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517492    2579 flags.go:64] FLAG: --runonce="false"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517495    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517498    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517502    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517504    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517507    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517510    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517513    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517516    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517519    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517522    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517525    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517529    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517532    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517535    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517538    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517543    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517546    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517549    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517554    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517556    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517559    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 13:55:54.525982 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517562    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517566    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517569    2579 flags.go:64] FLAG: --v="2"
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517572    2579 flags.go:64] FLAG: --version="false"
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517576    2579 flags.go:64] FLAG: --vmodule=""
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517580    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.517583    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517700    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517704    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517707    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517710    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517713    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517716    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517719    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517722    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517724    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517727    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517730    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517734    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517737    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517740    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.526818 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517742    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517746    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517749    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517751    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517754    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517756    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517759    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517763    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517766    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517769    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517771    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517774    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517776    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517782    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517784    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517787    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517789    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517792    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517795    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517803    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.527745 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517805    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517808    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517811    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517813    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517816    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517818    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517821    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517824    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517826    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517829    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517832    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517834    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517837    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517841    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517843    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517846    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517848    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517851    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517854    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517858    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.528399 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517860    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517863    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517865    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517868    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517871    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517874    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517877    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517879    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517882    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517884    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517887    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517890    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517892    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517895    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517897    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517900    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517903    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517905    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517908    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517910    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.529211 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517913    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517916    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517918    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517921    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517923    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517931    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517934    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517937    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517940    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517943    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517945    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517949    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517952    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517955    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517957    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517960    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517962    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517965    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517967    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.529871 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517975    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517979    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517983    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517986    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517989    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.517991    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.518000    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.525772    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.525789    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.526581    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.526596    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526690    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526698    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526703    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.530447 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526707    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526711    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526715    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526719    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526724    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526729    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526733    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526737    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526741    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526745    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526750    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526754    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526758    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526762    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526766    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526771    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526775    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526779    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526785    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526789    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.530804 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526793    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526797    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526801    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526808    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526813    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526819    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526824    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526828    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526832    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526836    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526840    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526845    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526849    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526854    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526858    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526863    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526875    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526879    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526883    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526887    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.531381 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526892    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526896    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526900    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526904    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526908    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526913    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526917    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526921    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526928    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526934    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526939    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526945    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526950    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526954    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526959    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526963    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526967    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526972    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526979    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.531972 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526985    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526990    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.526995    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527000    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527004    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527009    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527013    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527017    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527022    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527026    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527030    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527035    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527053    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527059    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527063    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527067    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527072    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527076    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527080    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.532580 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527084    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527088    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527092    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527096    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527101    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527106    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527111    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527115    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527119    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527124    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527129    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527133    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527138    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527142    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527147    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527151    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527155    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.533149 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527159    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.527167    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527342    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527350    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527355    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527359    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527364    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527368    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527372    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527377    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527381    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527385    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527389    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527394    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 13:55:54.533685 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527398    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527402    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527406    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527410    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527415    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527419    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527424    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527427    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527432    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527436    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527441    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527445    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527449    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527453    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527457    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527463    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527467    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527474    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527479    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527484    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 13:55:54.534084 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527489    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527494    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527498    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527503    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527507    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527511    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527516    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527520    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527524    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527528    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527532    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527536    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527540    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527544    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527549    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527553    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527557    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527561    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527568    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527574    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 13:55:54.534640 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527578    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527587    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527592    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527596    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527600    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527605    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527609    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527613    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527618    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527624    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527630    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527635    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527640    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527644    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527648    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527652    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527657    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527661    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527665    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527670    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 13:55:54.535199 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527674    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527678    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527682    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527686    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527690    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527694    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527698    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527702    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527705    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527709    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527713    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527718    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527722    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527726    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527732    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527736    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527740    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527744    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527748    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527752    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 13:55:54.535927 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527756    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527760    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527764    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527768    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527772    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527776    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:54.527781    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.527788    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.527925    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.533350    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.535103    2579 server.go:1019] "Starting client certificate rotation"
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.535193    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 13:55:54.536427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.535234    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 13:55:54.537857 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.537840    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 13:55:54.541013 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.540993    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 13:55:54.550488 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.550473    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 17 13:55:54.553330 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.553311    2579 log.go:25] "Validated CRI v1 image API"
Sep 17 13:55:54.554108 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.554092    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 13:55:54.559354 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.559331    2579 fs.go:135] Filesystem UUIDs: map[03abb527-f8ea-445c-b5a7-092c597f5ddc:/dev/nvme0n1p4 1af83ae2-b516-4942-9b99-058d1d20c96d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 17 13:55:54.559427 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.559352    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 13:55:54.564167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.564020    2579 manager.go:216] Machine: {Timestamp:2026-09-17 13:55:54.562779817 +0000 UTC m=+0.336547478 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099043 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2461fb29dd282470719ce1e2ed6a50 SystemUUID:ec2461fb-29dd-2824-7071-9ce1e2ed6a50 BootID:aa7550ae-6345-4a78-8b5c-e2d723ce2209 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dc:fe:26:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dc:fe:26:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:aa:7b:2a:48:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 13:55:54.564167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.564148    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 13:55:54.564316 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.564158    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 13:55:54.564351 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.564330    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 13:55:54.566689 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.566670    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 13:55:54.566831 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.566694    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-81.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 13:55:54.567480 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.567471    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 13:55:54.567520 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.567482    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 13:55:54.567520 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.567490    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 13:55:54.568249 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.568239    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 13:55:54.569166 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.569157    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 13:55:54.572474 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572463    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 13:55:54.572591 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572582    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 13:55:54.572629 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572615    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 13:55:54.572662 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572632    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 13:55:54.572662 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572643    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 13:55:54.572662 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572651    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 17 13:55:54.572662 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.572659    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 13:55:54.573240 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.573200    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 13:55:54.573240 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.573222    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 13:55:54.575242 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.575214    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 13:55:54.577403 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.577381    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 13:55:54.577456 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.577428    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 13:55:54.579116 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579105    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 13:55:54.579151 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579121    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 13:55:54.579151 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579127    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 13:55:54.579151 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579132    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 13:55:54.579151 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579140    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 13:55:54.579151 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579145    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579161    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579169    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579181    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579186    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579195    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 13:55:54.579278 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579200    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 13:55:54.579909 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579900    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 13:55:54.579938 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.579912    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 13:55:54.584895 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.584874    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-81.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 13:55:54.585053 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.584912    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 13:55:54.585135 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.585099    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 13:55:54.585344 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.585326    2579 server.go:1268] "Started kubelet"
Sep 17 13:55:54.585423 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.585390    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 13:55:54.586008 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.585937    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 13:55:54.586092 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.586030    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 13:55:54.586279 ip-10-0-132-81 systemd[1]: Started Kubernetes Kubelet.
Sep 17 13:55:54.589205 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.589186    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 13:55:54.589866 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.589851    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 13:55:54.593095 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.593077    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 13:55:54.593816 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.592911    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-81.ec2.internal.18d6203e772443e6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-81.ec2.internal,UID:ip-10-0-132-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-81.ec2.internal,},FirstTimestamp:2026-09-17 13:55:54.585277414 +0000 UTC m=+0.359045078,LastTimestamp:2026-09-17 13:55:54.585277414 +0000 UTC m=+0.359045078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-81.ec2.internal,}"
Sep 17 13:55:54.594889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.594872    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 13:55:54.594986 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.594890    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 13:55:54.594986 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.594962    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:54.595531 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595513    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 13:55:54.595637 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595518    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 13:55:54.595637 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595556    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 13:55:54.595740 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595656    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 13:55:54.595740 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595665    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 13:55:54.595898 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595883    2579 factory.go:153] Registering CRI-O factory
Sep 17 13:55:54.595953 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595904    2579 factory.go:223] Registration of the crio container factory successfully
Sep 17 13:55:54.595999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595958    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 13:55:54.595999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595967    2579 factory.go:55] Registering systemd factory
Sep 17 13:55:54.595999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595975    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 17 13:55:54.595999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.595991    2579 factory.go:103] Registering Raw factory
Sep 17 13:55:54.596213 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.596005    2579 manager.go:1196] Started watching for new ooms in manager
Sep 17 13:55:54.596434 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.596419    2579 manager.go:349] Starting recovery of all containers
Sep 17 13:55:54.600032 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.600007    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtvdx"
Sep 17 13:55:54.603297 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.603272    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 13:55:54.603684 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.603662    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 13:55:54.606284 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.606144    2579 manager.go:354] Recovery completed
Sep 17 13:55:54.607202 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.607183    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtvdx"
Sep 17 13:55:54.612850 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.612830    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.615327 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615310    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.615392 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615343    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.615392 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615357    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.615934 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615917    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 13:55:54.615934 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615934    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.616087 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.615933    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 13:55:54.616087 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.616015    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 13:55:54.616681 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.616663    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.616749 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.616696    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.616749 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.616711    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.617270 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.617258    2579 policy_none.go:49] "None policy: Start"
Sep 17 13:55:54.617333 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.617273    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 13:55:54.617333 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.617283    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 13:55:54.618404 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.618393    2579 policy_none.go:47] "Start"
Sep 17 13:55:54.647690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.647677    2579 manager.go:337] "Starting Device Plugin manager"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.647710    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.647721    2579 server.go:87] "Starting device plugin registration server"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.647985    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.647997    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.648189    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.648277    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.648286    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.648711    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 13:55:54.665176 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.648766    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:54.691351 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.691331    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 13:55:54.692457 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.692444    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 13:55:54.692523 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.692492    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 13:55:54.692523 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.692512    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 13:55:54.692626 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.692550    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 13:55:54.695251 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.695235    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 13:55:54.748714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.748693    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.756906 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.756891    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.756972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.756917    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.756972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.756926    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.756972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.756944    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.767916 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.767860    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.767916 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.767879    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-81.ec2.internal\": node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:54.793402 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.793380    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"]
Sep 17 13:55:54.793495 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.793444    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.794213 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.794200    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.794283 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.794220    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.794283 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.794229    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.795612 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.795599    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.795735 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.795720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.795781 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.795749    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.796280 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796265    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.796280 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796280    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796289    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796300    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796312    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796301    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.796419 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.796356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1154ca9b081a22b9ada33774b1f2200d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"1154ca9b081a22b9ada33774b1f2200d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.797928 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.797912    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.798001 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.797936    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 13:55:54.798560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.798546    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 13:55:54.798610 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.798574    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 13:55:54.798610 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.798588    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID"
Sep 17 13:55:54.802029 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.802016    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:54.822586 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.822565    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-81.ec2.internal\" not found" node="ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.826815 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.826801    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-81.ec2.internal\" not found" node="ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896529 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896621 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896621 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1154ca9b081a22b9ada33774b1f2200d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"1154ca9b081a22b9ada33774b1f2200d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896621 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896621 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1154ca9b081a22b9ada33774b1f2200d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"1154ca9b081a22b9ada33774b1f2200d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.896765 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:54.896619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2611d13780e287da3f7b59700f163628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"2611d13780e287da3f7b59700f163628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:54.902649 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:54.902634    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.003153 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.003132    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.103924 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.103866    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.125029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.125009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:55.129816 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.129795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:55.204229 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.204198    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.304736 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.304709    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.405268 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.405216    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.506093 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.506062    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.535683 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.535655    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 13:55:55.536102 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.535808    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 13:55:55.568984 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.568961    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 13:55:55.607053 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.607020    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.612584 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.612556    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 13:50:55 +0000 UTC" deadline="2028-03-10 16:17:37.569134149 +0000 UTC"
Sep 17 13:55:55.612645 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.612584    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12962h21m41.956553077s"
Sep 17 13:55:55.708133 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.708111    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.757262 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:55.757236    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1154ca9b081a22b9ada33774b1f2200d.slice/crio-9b264e2f0577b660d1cf9dc5cd3cb04cff1a1d9aaaa7c667d1ebc8300eeea25f WatchSource:0}: Error finding container 9b264e2f0577b660d1cf9dc5cd3cb04cff1a1d9aaaa7c667d1ebc8300eeea25f: Status 404 returned error can't find the container with id 9b264e2f0577b660d1cf9dc5cd3cb04cff1a1d9aaaa7c667d1ebc8300eeea25f
Sep 17 13:55:55.763465 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.763447    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 13:55:55.808579 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.808552    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.908880 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:55.908830    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found"
Sep 17 13:55:55.931426 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.931382    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 13:55:55.996394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:55.996370    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:56.009271 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.009249    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 13:55:56.010594 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.010578    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"
Sep 17 13:55:56.020949 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.020934    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 13:55:56.089871 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.089857    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 13:55:56.262790 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.262766    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2611d13780e287da3f7b59700f163628.slice/crio-d1437c9c98abe56b13300d267f6a853fab92654ea09ae8078445aaa8ba76b471 WatchSource:0}: Error finding container d1437c9c98abe56b13300d267f6a853fab92654ea09ae8078445aaa8ba76b471: Status 404 returned error can't find the container with id d1437c9c98abe56b13300d267f6a853fab92654ea09ae8078445aaa8ba76b471
Sep 17 13:55:56.552273 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.552196    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 13:55:56.574466 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.574440    2579 apiserver.go:52] "Watching apiserver"
Sep 17 13:55:56.580345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.580326    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 13:55:56.582490 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.582470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-cxhlc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal","openshift-network-operator/iptables-alerter-swz7c","openshift-ovn-kubernetes/ovnkube-node-2pp7z","kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5","openshift-dns/node-resolver-8lr9q","openshift-image-registry/node-ca-ml2lf","openshift-multus/multus-additional-cni-plugins-xwjr4","openshift-multus/multus-hdt8z","openshift-multus/network-metrics-daemon-45c6t","openshift-network-diagnostics/network-check-target-z6r7m","kube-system/global-pull-secret-syncer-jf4rd","kube-system/konnectivity-agent-tf84j"]
Sep 17 13:55:56.584506 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.584490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.586113 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.586090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.586208 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.586184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:55:56.586671 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.586654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.586913 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.586887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2qxlc\""
Sep 17 13:55:56.587016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.586978    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.589236 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.589217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.590883 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.590864    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.591291 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.591264    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.591868 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.591771    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.591930 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.591886    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 13:55:56.592293 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.592274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7jffz\""
Sep 17 13:55:56.592507 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.592493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.592699 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.592685    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 13:55:56.594299 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.594299 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594291    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.594451 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594297    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 13:55:56.594451 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 13:55:56.594725 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594685    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.594829 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594812    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 13:55:56.594910 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.594894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 13:55:56.595036 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.595019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 13:55:56.595171 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.595019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rvw22\""
Sep 17 13:55:56.595237 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.595170    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wkfzt\""
Sep 17 13:55:56.595999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.595980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.596093 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.596047    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 13:55:56.597030 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.597010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 13:55:56.597030 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.597013    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.597220 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.597057    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h5nkd\""
Sep 17 13:55:56.597220 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.597061    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.597671 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.597627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.598052 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.598019    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:55:56.598191 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.598174    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5p4g4\""
Sep 17 13:55:56.599965 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.599940    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.600057 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.600017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.600295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.600277    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 13:55:56.600380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.600362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.600461 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.600447    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 13:55:56.600699 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.600683    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 13:55:56.602434 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.602402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.602657 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.602638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4p85j\""
Sep 17 13:55:56.602762 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.602745    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.602906 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.602881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 13:55:56.603024 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.603008    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.603952 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.603933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-kubelet\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.603959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-etc-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.603976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-log-socket\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.603990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-netd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-env-overrides\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-system-cni-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-systemd-units\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-node-log\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-device-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfnzk\" (UniqueName: \"kubernetes.io/projected/be719d5c-af1b-41b7-a098-470920b14b9f-kube-api-access-dfnzk\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff9a013f-30ec-4d8a-8200-47d3547cb419-konnectivity-ca\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.604311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21abeff5-a68d-4664-bde1-141b5bb9ace1-host-slash\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-registration-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-sys-fs\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-slash\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604484    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-netns\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67c172b3-f303-4c00-ac4a-02972e52c618-ovn-node-metrics-cert\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-script-lib\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-ovn\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-bin\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be719d5c-af1b-41b7-a098-470920b14b9f-tmp-dir\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604752    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cgk4l\""
Sep 17 13:55:56.604779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6tjg\" (UniqueName: \"kubernetes.io/projected/eca8f0af-2268-4304-9894-fc28c5630f19-kube-api-access-c6tjg\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrjv\" (UniqueName: \"kubernetes.io/projected/21abeff5-a68d-4664-bde1-141b5bb9ace1-kube-api-access-8xrjv\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-systemd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-var-lib-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-config\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drk95\" (UniqueName: \"kubernetes.io/projected/67c172b3-f303-4c00-ac4a-02972e52c618-kube-api-access-drk95\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-socket-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvnc\" (UniqueName: \"kubernetes.io/projected/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kube-api-access-2lvnc\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.604981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-cnibin\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxjf\" (UniqueName: \"kubernetes.io/projected/633034ce-32c0-4674-819a-2665ac7bffee-kube-api-access-7kxjf\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff9a013f-30ec-4d8a-8200-47d3547cb419-agent-certs\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be719d5c-af1b-41b7-a098-470920b14b9f-hosts-file\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.605387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.605194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21abeff5-a68d-4664-bde1-141b5bb9ace1-iptables-alerter-script\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.606349 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.606329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:56.606423 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.606384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8kz7q\""
Sep 17 13:55:56.606423 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.606392    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:55:56.606796 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.606782    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 13:55:56.606796 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.606799    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 13:55:56.615360 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.615343    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 13:55:56.646976 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.646958    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxb2k"
Sep 17 13:55:56.654474 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.654459    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxb2k"
Sep 17 13:55:56.696472 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.696445    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 13:55:56.696752 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.696721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"2611d13780e287da3f7b59700f163628","Type":"ContainerStarted","Data":"d1437c9c98abe56b13300d267f6a853fab92654ea09ae8078445aaa8ba76b471"}
Sep 17 13:55:56.697877 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.697855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" event={"ID":"1154ca9b081a22b9ada33774b1f2200d","Type":"ContainerStarted","Data":"9b264e2f0577b660d1cf9dc5cd3cb04cff1a1d9aaaa7c667d1ebc8300eeea25f"}
Sep 17 13:55:56.705913 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-node-log\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.705968 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.705968 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.705968 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-host\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.705968 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-hostroot\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.705981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-conf-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-multus-certs\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff9a013f-30ec-4d8a-8200-47d3547cb419-konnectivity-ca\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-node-log\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21abeff5-a68d-4664-bde1-141b5bb9ace1-host-slash\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.706194 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-sys-fs\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21abeff5-a68d-4664-bde1-141b5bb9ace1-host-slash\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mphs6\" (UniqueName: \"kubernetes.io/projected/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-kube-api-access-mphs6\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-sys-fs\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxsc\" (UniqueName: \"kubernetes.io/projected/61449f6e-7302-4907-92b0-65f1f4c18a71-kube-api-access-npxsc\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-modprobe-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67c172b3-f303-4c00-ac4a-02972e52c618-ovn-node-metrics-cert\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-system-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-cnibin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-etc-kubernetes\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff9a013f-30ec-4d8a-8200-47d3547cb419-konnectivity-ca\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.706663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706895    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.706977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-run\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-lib-modules\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-host\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-bin\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-serviceca\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-bin\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.707201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-multus\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-systemd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-config\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvnc\" (UniqueName: \"kubernetes.io/projected/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kube-api-access-2lvnc\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-systemd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-cni-binary-copy\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-netns\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-socket-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-cnibin\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-cnibin\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-socket-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-k8s-cni-cncf-io\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff9a013f-30ec-4d8a-8200-47d3547cb419-agent-certs\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.707611 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-kubelet\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-system-cni-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-bin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-kubelet\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysconfig\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-kubelet\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-sys\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-device-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/633034ce-32c0-4674-819a-2665ac7bffee-system-cni-dir\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-config\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-device-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.707852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfnzk\" (UniqueName: \"kubernetes.io/projected/be719d5c-af1b-41b7-a098-470920b14b9f-kube-api-access-dfnzk\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.708241 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-registration-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-dbus\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-slash\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-netns\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-script-lib\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-tmp\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-ovn\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-systemd\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-run-netns\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-var-lib-kubelet\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be719d5c-af1b-41b7-a098-470920b14b9f-tmp-dir\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-ovn\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-registration-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.708975 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6tjg\" (UniqueName: \"kubernetes.io/projected/eca8f0af-2268-4304-9894-fc28c5630f19-kube-api-access-c6tjg\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrjv\" (UniqueName: \"kubernetes.io/projected/21abeff5-a68d-4664-bde1-141b5bb9ace1-kube-api-access-8xrjv\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.708982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-var-lib-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be719d5c-af1b-41b7-a098-470920b14b9f-tmp-dir\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxjf\" (UniqueName: \"kubernetes.io/projected/633034ce-32c0-4674-819a-2665ac7bffee-kube-api-access-7kxjf\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-kubernetes\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/633034ce-32c0-4674-819a-2665ac7bffee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drk95\" (UniqueName: \"kubernetes.io/projected/67c172b3-f303-4c00-ac4a-02972e52c618-kube-api-access-drk95\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-slash\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-var-lib-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-daemon-config\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-conf\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-etc-tuned\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.709838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48qd5\" (UniqueName: \"kubernetes.io/projected/39152184-b5f2-489d-80d0-29b4a22b1136-kube-api-access-48qd5\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be719d5c-af1b-41b7-a098-470920b14b9f-hosts-file\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21abeff5-a68d-4664-bde1-141b5bb9ace1-iptables-alerter-script\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-ovnkube-script-lib\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.709834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-etc-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-log-socket\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-log-socket\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-etc-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.710365    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-netd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.710454    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:57.210426925 +0000 UTC m=+2.984194593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-env-overrides\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-host-cni-netd\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-kubelet-config\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be719d5c-af1b-41b7-a098-470920b14b9f-hosts-file\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-socket-dir-parent\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21abeff5-a68d-4664-bde1-141b5bb9ace1-iptables-alerter-script\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.710690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-systemd-units\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.711539 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-run-openvswitch\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.711539 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.710781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67c172b3-f303-4c00-ac4a-02972e52c618-systemd-units\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.711539 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.711197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67c172b3-f303-4c00-ac4a-02972e52c618-env-overrides\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.711539 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.711340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67c172b3-f303-4c00-ac4a-02972e52c618-ovn-node-metrics-cert\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.711539 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.711533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff9a013f-30ec-4d8a-8200-47d3547cb419-agent-certs\") pod \"konnectivity-agent-tf84j\" (UID: \"ff9a013f-30ec-4d8a-8200-47d3547cb419\") " pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.717720 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.717701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6tjg\" (UniqueName: \"kubernetes.io/projected/eca8f0af-2268-4304-9894-fc28c5630f19-kube-api-access-c6tjg\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:56.717796 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.717774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvnc\" (UniqueName: \"kubernetes.io/projected/b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1-kube-api-access-2lvnc\") pod \"aws-ebs-csi-driver-node-94nj5\" (UID: \"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.718046 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.718029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfnzk\" (UniqueName: \"kubernetes.io/projected/be719d5c-af1b-41b7-a098-470920b14b9f-kube-api-access-dfnzk\") pod \"node-resolver-8lr9q\" (UID: \"be719d5c-af1b-41b7-a098-470920b14b9f\") " pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.728815 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.728779    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrjv\" (UniqueName: \"kubernetes.io/projected/21abeff5-a68d-4664-bde1-141b5bb9ace1-kube-api-access-8xrjv\") pod \"iptables-alerter-swz7c\" (UID: \"21abeff5-a68d-4664-bde1-141b5bb9ace1\") " pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.729450 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.729430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drk95\" (UniqueName: \"kubernetes.io/projected/67c172b3-f303-4c00-ac4a-02972e52c618-kube-api-access-drk95\") pod \"ovnkube-node-2pp7z\" (UID: \"67c172b3-f303-4c00-ac4a-02972e52c618\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.729649 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.729633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxjf\" (UniqueName: \"kubernetes.io/projected/633034ce-32c0-4674-819a-2665ac7bffee-kube-api-access-7kxjf\") pod \"multus-additional-cni-plugins-xwjr4\" (UID: \"633034ce-32c0-4674-819a-2665ac7bffee\") " pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.811923 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-system-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.811923 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-cnibin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.811923 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-etc-kubernetes\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.811923 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-run\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-lib-modules\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-etc-kubernetes\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-host\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-serviceca\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-host\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-system-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-multus\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-lib-modules\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.811993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-cnibin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-multus\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-run\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-cni-binary-copy\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-netns\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-k8s-cni-cncf-io\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-netns\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-k8s-cni-cncf-io\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-cni-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-bin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-serviceca\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-kubelet\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysconfig\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-cni-bin\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-var-lib-kubelet\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-sys\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysconfig\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-dbus\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-sys\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-dbus\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.812663 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-tmp\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-systemd\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-var-lib-kubelet\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.812741    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-kubernetes\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-systemd\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-daemon-config\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.812807    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:57.312789713 +0000 UTC m=+3.086557382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-cni-binary-copy\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-var-lib-kubelet\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-conf\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-etc-tuned\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-kubernetes\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48qd5\" (UniqueName: \"kubernetes.io/projected/39152184-b5f2-489d-80d0-29b4a22b1136-kube-api-access-48qd5\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.812982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-kubelet-config\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.813521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-socket-dir-parent\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-sysctl-conf\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-host\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-hostroot\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be94a50-fb9b-44c3-9738-e310c9e469b9-kubelet-config\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-conf-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-socket-dir-parent\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-host\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-hostroot\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-multus-certs\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-conf-dir\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mphs6\" (UniqueName: \"kubernetes.io/projected/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-kube-api-access-mphs6\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61449f6e-7302-4907-92b0-65f1f4c18a71-host-run-multus-certs\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61449f6e-7302-4907-92b0-65f1f4c18a71-multus-daemon-config\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxsc\" (UniqueName: \"kubernetes.io/projected/61449f6e-7302-4907-92b0-65f1f4c18a71-kube-api-access-npxsc\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-modprobe-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.814029 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.813376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39152184-b5f2-489d-80d0-29b4a22b1136-etc-modprobe-d\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.814900 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.814881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-tmp\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.814997 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.814981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39152184-b5f2-489d-80d0-29b4a22b1136-etc-tuned\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.831107 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.831086    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:55:56.831223 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.831111    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:55:56.831223 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.831155    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:56.831338 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:56.831224    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:57.331207452 +0000 UTC m=+3.104975107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:56.833809 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.833785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxsc\" (UniqueName: \"kubernetes.io/projected/61449f6e-7302-4907-92b0-65f1f4c18a71-kube-api-access-npxsc\") pod \"multus-hdt8z\" (UID: \"61449f6e-7302-4907-92b0-65f1f4c18a71\") " pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.834142 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.834124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mphs6\" (UniqueName: \"kubernetes.io/projected/4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5-kube-api-access-mphs6\") pod \"node-ca-ml2lf\" (UID: \"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5\") " pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.835500 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.835479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48qd5\" (UniqueName: \"kubernetes.io/projected/39152184-b5f2-489d-80d0-29b4a22b1136-kube-api-access-48qd5\") pod \"tuned-cxhlc\" (UID: \"39152184-b5f2-489d-80d0-29b4a22b1136\") " pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.895976 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.895950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lr9q"
Sep 17 13:55:56.904534 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.904497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swz7c"
Sep 17 13:55:56.905906 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.905878    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe719d5c_af1b_41b7_a098_470920b14b9f.slice/crio-f9acffcdef5afae541f01899d73c739be099178253e3f038b759a4301e3d1efe WatchSource:0}: Error finding container f9acffcdef5afae541f01899d73c739be099178253e3f038b759a4301e3d1efe: Status 404 returned error can't find the container with id f9acffcdef5afae541f01899d73c739be099178253e3f038b759a4301e3d1efe
Sep 17 13:55:56.912021 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.911969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:55:56.913663 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.913636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21abeff5_a68d_4664_bde1_141b5bb9ace1.slice/crio-b76d5fb9d5fa0b8e68824584cdde5bbb1b43706363c99b8cf82ffff2db1545ab WatchSource:0}: Error finding container b76d5fb9d5fa0b8e68824584cdde5bbb1b43706363c99b8cf82ffff2db1545ab: Status 404 returned error can't find the container with id b76d5fb9d5fa0b8e68824584cdde5bbb1b43706363c99b8cf82ffff2db1545ab
Sep 17 13:55:56.917147 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.916973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxhlc"
Sep 17 13:55:56.921369 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.921349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c172b3_f303_4c00_ac4a_02972e52c618.slice/crio-afa1cdaec615fd6feb6547162381ade9e1a58aaa36c550c1d1f8bd30c7a7a0f0 WatchSource:0}: Error finding container afa1cdaec615fd6feb6547162381ade9e1a58aaa36c550c1d1f8bd30c7a7a0f0: Status 404 returned error can't find the container with id afa1cdaec615fd6feb6547162381ade9e1a58aaa36c550c1d1f8bd30c7a7a0f0
Sep 17 13:55:56.922545 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.922395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:55:56.927777 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.927722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5"
Sep 17 13:55:56.927923 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.927780    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39152184_b5f2_489d_80d0_29b4a22b1136.slice/crio-ab572d93e703d4a1eb40a12ba4d7102ad0ce72115f7825b6fcb52c2f990b68b2 WatchSource:0}: Error finding container ab572d93e703d4a1eb40a12ba4d7102ad0ce72115f7825b6fcb52c2f990b68b2: Status 404 returned error can't find the container with id ab572d93e703d4a1eb40a12ba4d7102ad0ce72115f7825b6fcb52c2f990b68b2
Sep 17 13:55:56.934037 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.934017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwjr4"
Sep 17 13:55:56.935586 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.935565    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9a013f_30ec_4d8a_8200_47d3547cb419.slice/crio-ae438817e2269fdad321c97fd94aed3b629cc8cb65de7c63cc5cdd2e5a310013 WatchSource:0}: Error finding container ae438817e2269fdad321c97fd94aed3b629cc8cb65de7c63cc5cdd2e5a310013: Status 404 returned error can't find the container with id ae438817e2269fdad321c97fd94aed3b629cc8cb65de7c63cc5cdd2e5a310013
Sep 17 13:55:56.939535 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.939366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml2lf"
Sep 17 13:55:56.942444 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.942276    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c08ff5_f4bb_487e_b86a_7a3fa943c8c1.slice/crio-146f2c5eab737c853d724631f9fcf458b6aa6d9f408b45192a22951a4ed9aa6a WatchSource:0}: Error finding container 146f2c5eab737c853d724631f9fcf458b6aa6d9f408b45192a22951a4ed9aa6a: Status 404 returned error can't find the container with id 146f2c5eab737c853d724631f9fcf458b6aa6d9f408b45192a22951a4ed9aa6a
Sep 17 13:55:56.943813 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:56.943790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hdt8z"
Sep 17 13:55:56.963387 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:55:56.963142    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61449f6e_7302_4907_92b0_65f1f4c18a71.slice/crio-8863fddd07fa6dd8fb36732098f981092e61bf294604d31c2a6a4792bf98092c WatchSource:0}: Error finding container 8863fddd07fa6dd8fb36732098f981092e61bf294604d31c2a6a4792bf98092c: Status 404 returned error can't find the container with id 8863fddd07fa6dd8fb36732098f981092e61bf294604d31c2a6a4792bf98092c
Sep 17 13:55:57.216402 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.216314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:57.216556 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.216487    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:57.216632 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.216566    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:58.216544703 +0000 UTC m=+3.990312369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:57.317746 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.317701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:57.317915 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.317828    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:57.317915 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.317889    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:58.317873856 +0000 UTC m=+4.091641505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:57.419142 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.419083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:57.419319 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.419250    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:55:57.419319 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.419282    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:55:57.419319 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.419298    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:57.419482 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:57.419372    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:55:58.419355154 +0000 UTC m=+4.193122804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:57.657148 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.657028    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 13:50:57 +0000 UTC" deadline="2028-04-21 12:28:15.281158805 +0000 UTC"
Sep 17 13:55:57.657148 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.657084    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13966h32m17.624082318s"
Sep 17 13:55:57.711702 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.711600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml2lf" event={"ID":"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5","Type":"ContainerStarted","Data":"c93988d624c869384a046c6d3eeeafa5e2c317d8ba2da13fe2ad67eea326e060"}
Sep 17 13:55:57.714085 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.714036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5" event={"ID":"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1","Type":"ContainerStarted","Data":"146f2c5eab737c853d724631f9fcf458b6aa6d9f408b45192a22951a4ed9aa6a"}
Sep 17 13:55:57.715575 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.715484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tf84j" event={"ID":"ff9a013f-30ec-4d8a-8200-47d3547cb419","Type":"ContainerStarted","Data":"ae438817e2269fdad321c97fd94aed3b629cc8cb65de7c63cc5cdd2e5a310013"}
Sep 17 13:55:57.717177 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.717147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swz7c" event={"ID":"21abeff5-a68d-4664-bde1-141b5bb9ace1","Type":"ContainerStarted","Data":"b76d5fb9d5fa0b8e68824584cdde5bbb1b43706363c99b8cf82ffff2db1545ab"}
Sep 17 13:55:57.718761 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.718738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hdt8z" event={"ID":"61449f6e-7302-4907-92b0-65f1f4c18a71","Type":"ContainerStarted","Data":"8863fddd07fa6dd8fb36732098f981092e61bf294604d31c2a6a4792bf98092c"}
Sep 17 13:55:57.720298 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.720278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerStarted","Data":"b3fabb54ff5413e9f9a5b845d0ff76b25fb680648f8b3786f91cc604d107cdbf"}
Sep 17 13:55:57.722468 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.722441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxhlc" event={"ID":"39152184-b5f2-489d-80d0-29b4a22b1136","Type":"ContainerStarted","Data":"ab572d93e703d4a1eb40a12ba4d7102ad0ce72115f7825b6fcb52c2f990b68b2"}
Sep 17 13:55:57.723913 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.723889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"afa1cdaec615fd6feb6547162381ade9e1a58aaa36c550c1d1f8bd30c7a7a0f0"}
Sep 17 13:55:57.725147 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:57.725124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lr9q" event={"ID":"be719d5c-af1b-41b7-a098-470920b14b9f","Type":"ContainerStarted","Data":"f9acffcdef5afae541f01899d73c739be099178253e3f038b759a4301e3d1efe"}
Sep 17 13:55:58.225436 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.225397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:58.225626 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.225557    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:58.225702 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.225628    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:00.225608994 +0000 UTC m=+5.999376662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:55:58.326319 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.326165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:58.326525 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.326500    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:58.326622 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.326609    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:00.326567669 +0000 UTC m=+6.100335337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:55:58.427243 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.427203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:58.427428 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.427411    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:55:58.427491 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.427437    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:55:58.427491 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.427450    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:58.427613 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.427508    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:00.427489798 +0000 UTC m=+6.201257453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:55:58.657917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.657787    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 13:50:57 +0000 UTC" deadline="2028-05-27 20:48:46.431850228 +0000 UTC"
Sep 17 13:55:58.657917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.657847    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14838h52m47.774007783s"
Sep 17 13:55:58.696018 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.695989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:55:58.696225 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.696138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:55:58.696587 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.696567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:55:58.696715 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.696693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:55:58.696789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:55:58.696763    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:55:58.696849 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:55:58.696837    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:00.242765 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.241970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:00.242765 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.242196    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:00.242765 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.242262    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:04.242242225 +0000 UTC m=+10.016009878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:00.342816 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.342779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:00.342999 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.342954    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:00.343077 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.343028    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:04.342999771 +0000 UTC m=+10.116767428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:00.443442 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.443405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:00.443623 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.443578    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:56:00.443623 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.443601    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:56:00.443623 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.443614    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:00.443790 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.443670    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:04.443651671 +0000 UTC m=+10.217419326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:00.695357 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.695314    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:00.695548 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.695438    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:00.695548 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.695500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:00.695771 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.695584    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:00.695771 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:00.695626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:00.695771 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:00.695706    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:02.702240 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:02.701436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:02.702240 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:02.701637    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:02.702240 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:02.701940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:02.702240 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:02.702101    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:02.702240 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:02.702205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:02.703091 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:02.702366    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:04.277156 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.277121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:04.277590 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.277269    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:04.277590 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.277332    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:12.277311227 +0000 UTC m=+18.051078877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:04.377933 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.377900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:04.378110 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.378093    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:04.378205 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.378153    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:12.378134668 +0000 UTC m=+18.151902324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:04.478730 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.478695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:04.478928 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.478907    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:56:04.479001 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.478940    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:56:04.479001 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.478955    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:04.479143 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.479036    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:12.479015419 +0000 UTC m=+18.252783075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:04.694224 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.694195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:04.694409 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.694323    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:04.694719 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.694695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:04.694858 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.694838    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:04.694927 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:04.694889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:04.694980 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:04.694964    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:06.693392 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:06.693359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:06.693924 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:06.693362    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:06.693924 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:06.693491    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:06.693924 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:06.693365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:06.693924 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:06.693555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:06.693924 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:06.693614    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:08.693288 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:08.693255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:08.693742 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:08.693267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:08.693742 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:08.693380    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:08.693742 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:08.693495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:08.693742 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:08.693499    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:08.693742 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:08.693576    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:10.692988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:10.692957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:10.692988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:10.692972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:10.693526 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:10.693090    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:10.693526 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:10.693177    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:10.693526 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:10.693235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:10.693526 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:10.693314    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:12.341302 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.341268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:12.341807 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.341420    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:12.341807 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.341487    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:28.34146869 +0000 UTC m=+34.115236343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:12.442630 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.442594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:12.442771 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.442712    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:12.442771 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.442765    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:28.442752363 +0000 UTC m=+34.216520012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:12.543145 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.543118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:12.543281 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.543263    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:56:12.543345 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.543285    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:56:12.543345 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.543303    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:12.543407 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.543355    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:28.543342183 +0000 UTC m=+34.317109832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:12.693071 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.693027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:12.693071 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.693068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:12.693300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:12.693036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:12.693300 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.693170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:12.693300 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.693236    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:12.693300 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:12.693293    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:14.694512 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:14.694475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:14.694900 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:14.694591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:14.694953 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:14.694937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:14.695048 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:14.695024    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:14.695188 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:14.695061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:14.695188 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:14.695146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:16.693911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.693672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:16.694755 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.693673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:16.694755 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:16.694008    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:16.694755 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.693673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:16.694755 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:16.694067    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:16.694755 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:16.694125    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:16.777731 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.777710    2579 generic.go:356] "Generic (PLEG): container finished" podID="2611d13780e287da3f7b59700f163628" containerID="8e63e8611f7d1d32f343d6c1317c23fb8687ce031c6149ac033ea6f391e9c070" exitCode=0
Sep 17 13:56:16.777854 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.777773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"2611d13780e287da3f7b59700f163628","Type":"ContainerDied","Data":"8e63e8611f7d1d32f343d6c1317c23fb8687ce031c6149ac033ea6f391e9c070"}
Sep 17 13:56:16.779315 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.779280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" event={"ID":"1154ca9b081a22b9ada33774b1f2200d","Type":"ContainerStarted","Data":"cc607ffe20b46a350ea95f73ef2c6fe6f349643849f926e35fa69a8cbad6bf55"}
Sep 17 13:56:16.782777 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.782652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml2lf" event={"ID":"4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5","Type":"ContainerStarted","Data":"2a3897472ab6dc25fb139db828fd1f6f2e983105b0209d44d548a2aae466f2e1"}
Sep 17 13:56:16.784081 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.784064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5" event={"ID":"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1","Type":"ContainerStarted","Data":"a307e7ecc4f45f0431da0ca9d743dcfb93979e60eac6aac97671e09339ad83f3"}
Sep 17 13:56:16.785410 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.785393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tf84j" event={"ID":"ff9a013f-30ec-4d8a-8200-47d3547cb419","Type":"ContainerStarted","Data":"f3f4fc65ba9d9cb4d3382f099ccb12e332841abc40ffa92555c0a2509b22e9fc"}
Sep 17 13:56:16.786928 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.786909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hdt8z" event={"ID":"61449f6e-7302-4907-92b0-65f1f4c18a71","Type":"ContainerStarted","Data":"5f7ecb7b76fb2d0cbc907fe0c1955f007490d779166e05356b147ea09ddb57ab"}
Sep 17 13:56:16.788408 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.788387    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="a7cc293ed5990cd6b078ffb5c2d2fdf62525dca4878b0f3b96fa8b5aaa2e3ce6" exitCode=0
Sep 17 13:56:16.788514 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.788448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"a7cc293ed5990cd6b078ffb5c2d2fdf62525dca4878b0f3b96fa8b5aaa2e3ce6"}
Sep 17 13:56:16.790025 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.790004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxhlc" event={"ID":"39152184-b5f2-489d-80d0-29b4a22b1136","Type":"ContainerStarted","Data":"a6a7681946ca087b350a2cce6f3d84989ad6579c30d80422b3dd6f0ebd53ba42"}
Sep 17 13:56:16.793301 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"50e281edf3b0db19e5d9ea643b9eb4e8c56e986b87ada13a552d6f2ceb30dfe4"}
Sep 17 13:56:16.793382 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"385f33cae93729daf5bd9a8b3b3aa9005caa513bcac9357148241c0ea8c2bdc7"}
Sep 17 13:56:16.793382 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"56e731fa528a5afb1b7b15c42129fc2d974c4acf3c23624026a31521a84bfd2f"}
Sep 17 13:56:16.793460 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"03528b9f6f97ac058103ae11fff741bdaf5421b5e90cbd65d5926b26fc5eae84"}
Sep 17 13:56:16.793460 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"43d7686b4558f0350f0092cb1e01ede2522a728d4ac397906f7a011b1e852ed8"}
Sep 17 13:56:16.793528 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.793464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"6f1aa26383baa4a56c89a2793c9eaab0a4b46b55b4196b4088c5d5767027302e"}
Sep 17 13:56:16.794714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.794692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lr9q" event={"ID":"be719d5c-af1b-41b7-a098-470920b14b9f","Type":"ContainerStarted","Data":"1b2e4134da20b4da4eec97f0bffa8172df09a8b49dcc5c07c6e9fd6e0220cfea"}
Sep 17 13:56:16.831058 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.830989    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" podStartSLOduration=20.830973855 podStartE2EDuration="20.830973855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.81399273 +0000 UTC m=+22.587760401" watchObservedRunningTime="2026-09-17 13:56:16.830973855 +0000 UTC m=+22.604741520"
Sep 17 13:56:16.831214 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.831185    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8lr9q" podStartSLOduration=3.302863752 podStartE2EDuration="21.831177035s" totalImagesPullingTime="18.528313283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.830756189 +0000 UTC m=+22.604523859" watchObservedRunningTime="2026-09-17 13:56:16.831177035 +0000 UTC m=+22.604944706"
Sep 17 13:56:16.871134 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.871089    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ml2lf" podStartSLOduration=3.393310948 podStartE2EDuration="21.87107699s" totalImagesPullingTime="18.477766042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.87107125 +0000 UTC m=+22.644838916" watchObservedRunningTime="2026-09-17 13:56:16.87107699 +0000 UTC m=+22.644844659"
Sep 17 13:56:16.906964 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.906913    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hdt8z" podStartSLOduration=3.154748308 podStartE2EDuration="21.906894555s" totalImagesPullingTime="18.752146247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.906723598 +0000 UTC m=+22.680491268" watchObservedRunningTime="2026-09-17 13:56:16.906894555 +0000 UTC m=+22.680662226"
Sep 17 13:56:16.907251 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:16.907199    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tf84j" podStartSLOduration=3.17803766 podStartE2EDuration="21.90718883s" totalImagesPullingTime="18.72915117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.887410924 +0000 UTC m=+22.661178594" watchObservedRunningTime="2026-09-17 13:56:16.90718883 +0000 UTC m=+22.680956501"
Sep 17 13:56:17.273050 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.273017    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 13:56:17.663860 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.663762    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T13:56:17.273036172Z","UUID":"6fbcbd94-c3c4-4ab1-8521-57e5efa6b5db","Handler":null,"Name":"","Endpoint":""}
Sep 17 13:56:17.665322 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.665290    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 13:56:17.665322 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.665327    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 13:56:17.800116 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.800081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"2611d13780e287da3f7b59700f163628","Type":"ContainerStarted","Data":"675abb9756602f8d9acccf3f454276ffe47b11de70dd75a363dc637ad159299f"}
Sep 17 13:56:17.803433 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.803372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5" event={"ID":"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1","Type":"ContainerStarted","Data":"76b774bfe130aacfe98e82690f86569149f8c815a2254034cb3d7555024d163a"}
Sep 17 13:56:17.805572 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.805545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swz7c" event={"ID":"21abeff5-a68d-4664-bde1-141b5bb9ace1","Type":"ContainerStarted","Data":"e1da8e10a5017789f469cb929bbbc19e96ae78ef348986f3040a9d62c8765956"}
Sep 17 13:56:17.820502 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.820462    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cxhlc" podStartSLOduration=4.070870748 podStartE2EDuration="22.820446333s" totalImagesPullingTime="18.749575585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:16.925411921 +0000 UTC m=+22.699179590" watchObservedRunningTime="2026-09-17 13:56:17.820446333 +0000 UTC m=+23.594214004"
Sep 17 13:56:17.820639 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.820574    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" podStartSLOduration=21.820567319 podStartE2EDuration="21.820567319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:17.820052385 +0000 UTC m=+23.593820047" watchObservedRunningTime="2026-09-17 13:56:17.820567319 +0000 UTC m=+23.594334987"
Sep 17 13:56:17.837573 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:17.837531    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-swz7c" podStartSLOduration=4.088368168 podStartE2EDuration="22.83751463s" totalImagesPullingTime="18.749146462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:17.837404716 +0000 UTC m=+23.611172386" watchObservedRunningTime="2026-09-17 13:56:17.83751463 +0000 UTC m=+23.611282304"
Sep 17 13:56:18.693361 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.692878    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:18.693361 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.692881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:18.693361 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:18.693217    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:18.693361 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.692944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:18.693361 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:18.693267    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:18.693689 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:18.693382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:18.811822 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.811787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"ea3fcfb4751c5fac2e4d8347ddb618924e1d2322763dcd178495f18d7ffcea23"}
Sep 17 13:56:18.814275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.814244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5" event={"ID":"b0c08ff5-f4bb-487e-b86a-7a3fa943c8c1","Type":"ContainerStarted","Data":"7f6f9d2d48cb5cc5e63c492ebf649e8722f060716093dc541ed9fd5d44cf0fad"}
Sep 17 13:56:18.836650 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.836611    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-94nj5" podStartSLOduration=3.201422434 podStartE2EDuration="23.836594069s" totalImagesPullingTime="20.635171635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:18.836423315 +0000 UTC m=+24.610190997" watchObservedRunningTime="2026-09-17 13:56:18.836594069 +0000 UTC m=+24.610361739"
Sep 17 13:56:18.982803 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.982701    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:56:18.983610 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:18.983589    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:56:19.816571 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:19.816540    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:56:19.820279 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:19.820245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tf84j"
Sep 17 13:56:20.692889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:20.692857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:20.693075 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:20.692856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:20.693075 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:20.692999    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:20.693075 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:20.692863    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:20.693075 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:20.693057    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:20.693281 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:20.693146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:21.822499 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.822466    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="3e8aeecc9fd62517b7f79bcab06e8dc786ff5156487b2facd2326e91f14e2c0a" exitCode=0
Sep 17 13:56:21.822953 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.822561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"3e8aeecc9fd62517b7f79bcab06e8dc786ff5156487b2facd2326e91f14e2c0a"}
Sep 17 13:56:21.826641 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.826609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" event={"ID":"67c172b3-f303-4c00-ac4a-02972e52c618","Type":"ContainerStarted","Data":"4ac98612e9955ce7ab34949786d1081572d0d569b0da0bae986d1c02f485d58b"}
Sep 17 13:56:21.827030 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.827007    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:21.842146 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.842126    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:21.888263 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:21.888223    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z" podStartSLOduration=8.004898402 podStartE2EDuration="26.888211445s" totalImagesPullingTime="18.883313043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:21.887398448 +0000 UTC m=+27.661166118" watchObservedRunningTime="2026-09-17 13:56:21.888211445 +0000 UTC m=+27.661979115"
Sep 17 13:56:22.695705 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.695681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:22.695811 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.695776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:22.695886 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.695874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:22.695936 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.695894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:22.695970 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.695957    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:22.696031 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.696017    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:22.831500 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.831466    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="001b558ab6676605579bbb5764c7b49bd75dffce42778b6d1e33a876e02cfb69" exitCode=0
Sep 17 13:56:22.832235 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.831553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"001b558ab6676605579bbb5764c7b49bd75dffce42778b6d1e33a876e02cfb69"}
Sep 17 13:56:22.832235 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.832122    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:22.832235 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.832211    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:22.844585 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.844559    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jf4rd"]
Sep 17 13:56:22.844685 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.844641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:22.844761 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.844719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:22.847392 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.847341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6r7m"]
Sep 17 13:56:22.847462 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.847404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:22.847500 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.847470    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:22.848098 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.848056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:22.848891 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.848873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45c6t"]
Sep 17 13:56:22.848999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:22.848940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:22.849058 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:22.849011    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:23.836338 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:23.836258    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="23b418d8237e3076a52d19d80a224ddb266123842ce9e38b64b0ba4787202f86" exitCode=0
Sep 17 13:56:23.836338 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:23.836307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"23b418d8237e3076a52d19d80a224ddb266123842ce9e38b64b0ba4787202f86"}
Sep 17 13:56:24.692906 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:24.692873    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:24.693068 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:24.693016    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:24.693369 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:24.693347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:24.693462 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:24.693427    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:24.693501 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:24.693480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:24.693612 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:24.693591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:26.693183 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:26.692982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:26.693625 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:26.692982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:26.693625 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:26.693257    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jf4rd" podUID="7be94a50-fb9b-44c3-9738-e310c9e469b9"
Sep 17 13:56:26.693625 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:26.692989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:26.693625 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:26.693333    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45c6t" podUID="eca8f0af-2268-4304-9894-fc28c5630f19"
Sep 17 13:56:26.693625 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:26.693412    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6r7m" podUID="f9b9f306-57e1-4629-a2f6-077938b77929"
Sep 17 13:56:28.366826 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.366789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:28.367293 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.366985    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:28.367293 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.367083    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:00.367059869 +0000 UTC m=+66.140827537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 13:56:28.467266 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.467238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:28.467427 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.467362    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:28.467427 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.467418    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret podName:7be94a50-fb9b-44c3-9738-e310c9e469b9 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:00.467405337 +0000 UTC m=+66.241172985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret") pod "global-pull-secret-syncer-jf4rd" (UID: "7be94a50-fb9b-44c3-9738-e310c9e469b9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 13:56:28.543766 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.543696    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeReady"
Sep 17 13:56:28.543890 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.543833    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 13:56:28.568058 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.568020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:28.568204 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.568178    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 13:56:28.568204 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.568202    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 13:56:28.568302 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.568215    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4rxs2 for pod openshift-network-diagnostics/network-check-target-z6r7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:28.568302 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.568272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2 podName:f9b9f306-57e1-4629-a2f6-077938b77929 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:00.568255598 +0000 UTC m=+66.342023252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rxs2" (UniqueName: "kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2") pod "network-check-target-z6r7m" (UID: "f9b9f306-57e1-4629-a2f6-077938b77929") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 13:56:28.599747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.599724    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rc6vk"]
Sep 17 13:56:28.634292 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.634262    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8m4sd"]
Sep 17 13:56:28.634413 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.634393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.636483 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.636464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f8wrh\""
Sep 17 13:56:28.636912 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.636895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 13:56:28.637009 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.636933    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 13:56:28.652480 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.652462    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8m4sd"]
Sep 17 13:56:28.652570 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.652495    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rc6vk"]
Sep 17 13:56:28.652625 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.652586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.661201 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.661179    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 13:56:28.661307 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.661235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 13:56:28.661366 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.661331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wntfx\""
Sep 17 13:56:28.661591 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.661574    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 13:56:28.696523 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.696373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:56:28.696523 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.696384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:56:28.696726 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.696528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:56:28.702627 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.702601    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 13:56:28.702627 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.702619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 13:56:28.702788 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.702712    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gs47f\""
Sep 17 13:56:28.703348 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.703331    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 13:56:28.703754 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.703733    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 13:56:28.706255 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.706238    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpdmf\""
Sep 17 13:56:28.769613 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bde1eaca-c657-4461-b8ac-61bff2a41ac2-cert\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.769747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8j7g\" (UniqueName: \"kubernetes.io/projected/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-kube-api-access-n8j7g\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.769747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-config-volume\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.769747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.769747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlx24\" (UniqueName: \"kubernetes.io/projected/bde1eaca-c657-4461-b8ac-61bff2a41ac2-kube-api-access-mlx24\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.769747 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.769729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-tmp-dir\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.870605 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlx24\" (UniqueName: \"kubernetes.io/projected/bde1eaca-c657-4461-b8ac-61bff2a41ac2-kube-api-access-mlx24\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.870746 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-tmp-dir\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.870746 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bde1eaca-c657-4461-b8ac-61bff2a41ac2-cert\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.870746 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8j7g\" (UniqueName: \"kubernetes.io/projected/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-kube-api-access-n8j7g\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.870910 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-config-volume\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.870910 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.870910 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.870905    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:28.870999 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:28.870971    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:29.370952033 +0000 UTC m=+35.144719696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:28.870999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.870975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-tmp-dir\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.871535 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.871512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-config-volume\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.875600 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.875578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bde1eaca-c657-4461-b8ac-61bff2a41ac2-cert\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.886014 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.885988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlx24\" (UniqueName: \"kubernetes.io/projected/bde1eaca-c657-4461-b8ac-61bff2a41ac2-kube-api-access-mlx24\") pod \"ingress-canary-8m4sd\" (UID: \"bde1eaca-c657-4461-b8ac-61bff2a41ac2\") " pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:28.886265 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.886242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8j7g\" (UniqueName: \"kubernetes.io/projected/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-kube-api-access-n8j7g\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:28.963196 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:28.963175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8m4sd"
Sep 17 13:56:29.276430 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:29.276370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8m4sd"]
Sep 17 13:56:29.306066 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:56:29.306017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde1eaca_c657_4461_b8ac_61bff2a41ac2.slice/crio-1ee66631dc164a32f7c3586606e7d1e309b0126ce311fc952f29406232f459ac WatchSource:0}: Error finding container 1ee66631dc164a32f7c3586606e7d1e309b0126ce311fc952f29406232f459ac: Status 404 returned error can't find the container with id 1ee66631dc164a32f7c3586606e7d1e309b0126ce311fc952f29406232f459ac
Sep 17 13:56:29.374858 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:29.374724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:29.375142 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:29.374863    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:29.375142 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:29.374917    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:30.374902518 +0000 UTC m=+36.148670166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:29.851188 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:29.851157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8m4sd" event={"ID":"bde1eaca-c657-4461-b8ac-61bff2a41ac2","Type":"ContainerStarted","Data":"1ee66631dc164a32f7c3586606e7d1e309b0126ce311fc952f29406232f459ac"}
Sep 17 13:56:29.857314 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:29.857287    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="43705ffa867f04df395b0f6c65c2edc3380529138af18b2b3db226a28dfd4612" exitCode=0
Sep 17 13:56:29.857416 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:29.857339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"43705ffa867f04df395b0f6c65c2edc3380529138af18b2b3db226a28dfd4612"}
Sep 17 13:56:30.381036 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:30.381002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:30.381553 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:30.381152    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:30.381553 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:30.381217    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:32.381198988 +0000 UTC m=+38.154966640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:30.863140 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:30.863109    2579 generic.go:356] "Generic (PLEG): container finished" podID="633034ce-32c0-4674-819a-2665ac7bffee" containerID="a7f6df910b3613b93c430c2e9e5d4c606bbf4190c28e55bd3ef519e8862cfbc4" exitCode=0
Sep 17 13:56:30.863319 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:30.863161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerDied","Data":"a7f6df910b3613b93c430c2e9e5d4c606bbf4190c28e55bd3ef519e8862cfbc4"}
Sep 17 13:56:31.868911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:31.868878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" event={"ID":"633034ce-32c0-4674-819a-2665ac7bffee","Type":"ContainerStarted","Data":"15ebfaff6822a3045c0bb62d75cd0d9e6ac9cc1f81e1b243ee34f982617264aa"}
Sep 17 13:56:31.893794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:31.893753    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwjr4" podStartSLOduration=7.239603878 podStartE2EDuration="36.893740262s" totalImagesPullingTime="29.654136384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:31.892807436 +0000 UTC m=+37.666575105" watchObservedRunningTime="2026-09-17 13:56:31.893740262 +0000 UTC m=+37.667507931"
Sep 17 13:56:32.395165 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:32.395093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:32.395299 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:32.395241    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:32.395339 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:32.395305    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:36.395289492 +0000 UTC m=+42.169057155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:32.872758 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:32.872724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8m4sd" event={"ID":"bde1eaca-c657-4461-b8ac-61bff2a41ac2","Type":"ContainerStarted","Data":"d71210f4caea728a2905a9e653d67f718e3476a7798b7151324f6e2fb8548a09"}
Sep 17 13:56:36.421052 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:36.421000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:36.421420 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:36.421159    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:36.421420 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:36.421222    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:56:44.421208075 +0000 UTC m=+50.194975722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:44.470826 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:44.470794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:56:44.471271 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:44.470943    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:56:44.471271 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:56:44.471013    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:00.470999006 +0000 UTC m=+66.244766654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:56:54.848375 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:54.848350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pp7z"
Sep 17 13:56:54.879906 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:56:54.879864    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8m4sd" podStartSLOduration=24.069214235 podStartE2EDuration="26.879817729s" totalImagesPullingTime="2.810603494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:56:32.901959157 +0000 UTC m=+38.675726828" watchObservedRunningTime="2026-09-17 13:56:54.879817729 +0000 UTC m=+60.653585398"
Sep 17 13:57:00.383662 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.383624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:57:00.386250 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.386230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 13:57:00.394858 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:00.394840    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 13:57:00.394914 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:00.394896    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs podName:eca8f0af-2268-4304-9894-fc28c5630f19 nodeName:}" failed. No retries permitted until 2026-09-17 13:58:04.394881635 +0000 UTC m=+130.168649282 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs") pod "network-metrics-daemon-45c6t" (UID: "eca8f0af-2268-4304-9894-fc28c5630f19") : secret "metrics-daemon-secret" not found
Sep 17 13:57:00.484244 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.484213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:57:00.484383 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.484251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:57:00.484383 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:00.484366    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:57:00.484488 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:00.484418    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:32.484405928 +0000 UTC m=+98.258173575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:57:00.486977 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.486960    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 13:57:00.497533 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.497507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be94a50-fb9b-44c3-9738-e310c9e469b9-original-pull-secret\") pod \"global-pull-secret-syncer-jf4rd\" (UID: \"7be94a50-fb9b-44c3-9738-e310c9e469b9\") " pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:57:00.512677 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.512653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jf4rd"
Sep 17 13:57:00.585576 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.585542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:57:00.588397 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.588368    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 13:57:00.599334 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.599306    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 13:57:00.608875 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.608827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxs2\" (UniqueName: \"kubernetes.io/projected/f9b9f306-57e1-4629-a2f6-077938b77929-kube-api-access-4rxs2\") pod \"network-check-target-z6r7m\" (UID: \"f9b9f306-57e1-4629-a2f6-077938b77929\") " pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:57:00.821547 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.821483    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpdmf\""
Sep 17 13:57:00.828491 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.828464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:57:00.828621 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.828470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jf4rd"]
Sep 17 13:57:00.831653 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:00.831629    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be94a50_fb9b_44c3_9738_e310c9e469b9.slice/crio-5cc296f6099641aa49400b1e467e8c5d4a171c6fb10a1b35562b943be4c1dbe9 WatchSource:0}: Error finding container 5cc296f6099641aa49400b1e467e8c5d4a171c6fb10a1b35562b943be4c1dbe9: Status 404 returned error can't find the container with id 5cc296f6099641aa49400b1e467e8c5d4a171c6fb10a1b35562b943be4c1dbe9
Sep 17 13:57:00.936222 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:00.936185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jf4rd" event={"ID":"7be94a50-fb9b-44c3-9738-e310c9e469b9","Type":"ContainerStarted","Data":"5cc296f6099641aa49400b1e467e8c5d4a171c6fb10a1b35562b943be4c1dbe9"}
Sep 17 13:57:01.127178 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:01.127152    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6r7m"]
Sep 17 13:57:01.129724 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:01.129701    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b9f306_57e1_4629_a2f6_077938b77929.slice/crio-5087bed85b871a98605caf300b8b2925b94b794119bc0fa6705467e8f73e1a89 WatchSource:0}: Error finding container 5087bed85b871a98605caf300b8b2925b94b794119bc0fa6705467e8f73e1a89: Status 404 returned error can't find the container with id 5087bed85b871a98605caf300b8b2925b94b794119bc0fa6705467e8f73e1a89
Sep 17 13:57:01.941573 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:01.941499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6r7m" event={"ID":"f9b9f306-57e1-4629-a2f6-077938b77929","Type":"ContainerStarted","Data":"5087bed85b871a98605caf300b8b2925b94b794119bc0fa6705467e8f73e1a89"}
Sep 17 13:57:05.952727 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:05.952684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6r7m" event={"ID":"f9b9f306-57e1-4629-a2f6-077938b77929","Type":"ContainerStarted","Data":"fb0dae87340eeaba59fa6a247d53ec55f0a53b1e27a347ba7cb3f49a2cbe3c2f"}
Sep 17 13:57:05.953234 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:05.952748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:57:05.954252 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:05.954222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jf4rd" event={"ID":"7be94a50-fb9b-44c3-9738-e310c9e469b9","Type":"ContainerStarted","Data":"6ef1c8546e32f487a270ce819b0aca509e7f1e2ed0592cadb6e844dcb3c9674e"}
Sep 17 13:57:05.968720 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:05.968679    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6r7m" podStartSLOduration=66.377419435 podStartE2EDuration="1m10.96866688s" totalImagesPullingTime="4.591247445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:05.968119147 +0000 UTC m=+71.741886818" watchObservedRunningTime="2026-09-17 13:57:05.96866688 +0000 UTC m=+71.742434550"
Sep 17 13:57:05.983249 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:05.983176    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jf4rd" podStartSLOduration=66.090992348 podStartE2EDuration="1m10.983162708s" totalImagesPullingTime="4.89217036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:05.982927842 +0000 UTC m=+71.756695513" watchObservedRunningTime="2026-09-17 13:57:05.983162708 +0000 UTC m=+71.756930378"
Sep 17 13:57:12.237692 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.237654    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"]
Sep 17 13:57:12.239833 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.239812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.246441 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.246129    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 13:57:12.248249 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.248227    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 13:57:12.248249 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.248237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 13:57:12.249921 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.249903    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 13:57:12.250364 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.250346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8j2rc\""
Sep 17 13:57:12.255024 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.254994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"]
Sep 17 13:57:12.360245 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.360216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.360349 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.360257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.360349 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.360287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdfp\" (UniqueName: \"kubernetes.io/projected/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-kube-api-access-dsdfp\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.461006 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.460982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.461122 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.461013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.461122 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.461033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdfp\" (UniqueName: \"kubernetes.io/projected/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-kube-api-access-dsdfp\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.461197 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:12.461151    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:12.461231 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:12.461225    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:12.961207367 +0000 UTC m=+78.734975041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:12.461619 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.461601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.477089 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.477060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdfp\" (UniqueName: \"kubernetes.io/projected/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-kube-api-access-dsdfp\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.963595 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:12.963561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:12.963741 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:12.963716    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:12.963813 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:12.963800    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:13.963782699 +0000 UTC m=+79.737550348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:13.970227 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:13.970195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:13.970607 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:13.970336    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:13.970607 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:13.970403    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:15.970387769 +0000 UTC m=+81.744155417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:15.962900 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.962867    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5thsn"]
Sep 17 13:57:15.965186 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.965169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:15.967870 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.967823    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 13:57:15.967976 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.967869    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-twkdq\""
Sep 17 13:57:15.968269 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.968252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 13:57:15.968496 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.968482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 13:57:15.968753 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.968739    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 13:57:15.984866 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.984842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:15.984952 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:15.984945    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:15.985011 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:15.985002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:19.98498714 +0000 UTC m=+85.758754791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:15.986742 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:15.986718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5thsn"]
Sep 17 13:57:16.085630 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.085604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18133cd-99fa-4780-b31a-3f2e0e4d5593-crio-socket\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.085630 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.085631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.085789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.085656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18133cd-99fa-4780-b31a-3f2e0e4d5593-data-volume\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.085789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.085694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.085789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.085709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhjfl\" (UniqueName: \"kubernetes.io/projected/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-api-access-zhjfl\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186436 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18133cd-99fa-4780-b31a-3f2e0e4d5593-crio-socket\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186553 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186553 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18133cd-99fa-4780-b31a-3f2e0e4d5593-crio-socket\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186651 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.186575    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:16.186651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18133cd-99fa-4780-b31a-3f2e0e4d5593-data-volume\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186651 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.186615    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:16.686602727 +0000 UTC m=+82.460370379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:16.186800 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186800 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhjfl\" (UniqueName: \"kubernetes.io/projected/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-api-access-zhjfl\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186800 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.186779    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 13:57:16.186913 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.186826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18133cd-99fa-4780-b31a-3f2e0e4d5593-data-volume\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.186913 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.186853    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:16.68683563 +0000 UTC m=+82.460603303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : configmap "kube-rbac-proxy" not found
Sep 17 13:57:16.198974 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.198950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhjfl\" (UniqueName: \"kubernetes.io/projected/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-api-access-zhjfl\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.689785 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.689748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.690025 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:16.689818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:16.690025 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.689889    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:16.690025 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.689945    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:17.689932218 +0000 UTC m=+83.463699865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:16.690025 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.689891    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 13:57:16.690222 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:16.690070    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:17.690033585 +0000 UTC m=+83.463801253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : configmap "kube-rbac-proxy" not found
Sep 17 13:57:17.695954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:17.695911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:17.696338 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:17.695983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:17.696338 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:17.696060    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 13:57:17.696338 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:17.696066    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:17.696338 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:17.696109    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:19.696095926 +0000 UTC m=+85.469863573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : configmap "kube-rbac-proxy" not found
Sep 17 13:57:17.696338 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:17.696121    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:19.696115312 +0000 UTC m=+85.469882960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:17.867687 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:17.867663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lr9q_be719d5c-af1b-41b7-a098-470920b14b9f/dns-node-resolver/0.log"
Sep 17 13:57:18.213196 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.213161    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ctlc8"]
Sep 17 13:57:18.216102 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.216085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.220778 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.220401    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 13:57:18.220917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.220805    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 13:57:18.220917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.220829    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zqnvw\""
Sep 17 13:57:18.221076 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.221062    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 13:57:18.221125 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.221084    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 13:57:18.228339 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.228319    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 13:57:18.231560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.231540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ctlc8"]
Sep 17 13:57:18.300972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.300947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-trusted-ca\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.300972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.300972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xrn2\" (UniqueName: \"kubernetes.io/projected/4f2104af-88ed-429e-9334-5768a8418ab7-kube-api-access-7xrn2\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.301144 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.301009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-config\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.301144 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.301075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2104af-88ed-429e-9334-5768a8418ab7-serving-cert\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.401751 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.401715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-trusted-ca\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.401862 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.401757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xrn2\" (UniqueName: \"kubernetes.io/projected/4f2104af-88ed-429e-9334-5768a8418ab7-kube-api-access-7xrn2\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.401862 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.401817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-config\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.401862 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.401842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2104af-88ed-429e-9334-5768a8418ab7-serving-cert\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.402608 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.402581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-config\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.402688 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.402654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f2104af-88ed-429e-9334-5768a8418ab7-trusted-ca\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.404220 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.404197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2104af-88ed-429e-9334-5768a8418ab7-serving-cert\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.411334 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.411314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xrn2\" (UniqueName: \"kubernetes.io/projected/4f2104af-88ed-429e-9334-5768a8418ab7-kube-api-access-7xrn2\") pod \"console-operator-696884fb9c-ctlc8\" (UID: \"4f2104af-88ed-429e-9334-5768a8418ab7\") " pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.527317 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.527253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:18.801580 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.801511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ctlc8"]
Sep 17 13:57:18.805008 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:18.804984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2104af_88ed_429e_9334_5768a8418ab7.slice/crio-f8dc6354ea1ea5f912cef3dcec5400f94d86d315a554058aca414bc0adbdfb11 WatchSource:0}: Error finding container f8dc6354ea1ea5f912cef3dcec5400f94d86d315a554058aca414bc0adbdfb11: Status 404 returned error can't find the container with id f8dc6354ea1ea5f912cef3dcec5400f94d86d315a554058aca414bc0adbdfb11
Sep 17 13:57:18.867139 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.867115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml2lf_4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5/node-ca/0.log"
Sep 17 13:57:18.984105 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:18.984076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" event={"ID":"4f2104af-88ed-429e-9334-5768a8418ab7","Type":"ContainerStarted","Data":"f8dc6354ea1ea5f912cef3dcec5400f94d86d315a554058aca414bc0adbdfb11"}
Sep 17 13:57:19.267221 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:19.267197    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8m4sd_bde1eaca-c657-4461-b8ac-61bff2a41ac2/serve-healthcheck-canary/0.log"
Sep 17 13:57:19.711374 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:19.711331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:19.711554 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:19.711394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:19.711554 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:19.711499    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:19.711662 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:19.711567    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:23.711548481 +0000 UTC m=+89.485316132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:19.711662 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:19.711579    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 13:57:19.711662 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:19.711652    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:23.71163505 +0000 UTC m=+89.485402714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : configmap "kube-rbac-proxy" not found
Sep 17 13:57:20.013071 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:20.012994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:20.013419 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:20.013144    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:20.013419 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:20.013211    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:28.013193537 +0000 UTC m=+93.786961204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:20.989882 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:20.989850    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/0.log"
Sep 17 13:57:20.990073 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:20.989895    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f2104af-88ed-429e-9334-5768a8418ab7" containerID="229abd1c180e01cd428bd4fd428183d4b0c988fd7f0b5f8e82512b4681f4fc09" exitCode=255
Sep 17 13:57:20.990073 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:20.989929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" event={"ID":"4f2104af-88ed-429e-9334-5768a8418ab7","Type":"ContainerDied","Data":"229abd1c180e01cd428bd4fd428183d4b0c988fd7f0b5f8e82512b4681f4fc09"}
Sep 17 13:57:20.990237 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:20.990224    2579 scope.go:117] "RemoveContainer" containerID="229abd1c180e01cd428bd4fd428183d4b0c988fd7f0b5f8e82512b4681f4fc09"
Sep 17 13:57:21.993954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.993930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 13:57:21.994363 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.994342    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/0.log"
Sep 17 13:57:21.994407 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.994374    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f2104af-88ed-429e-9334-5768a8418ab7" containerID="8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3" exitCode=255
Sep 17 13:57:21.994448 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.994419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" event={"ID":"4f2104af-88ed-429e-9334-5768a8418ab7","Type":"ContainerDied","Data":"8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3"}
Sep 17 13:57:21.994504 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.994492    2579 scope.go:117] "RemoveContainer" containerID="229abd1c180e01cd428bd4fd428183d4b0c988fd7f0b5f8e82512b4681f4fc09"
Sep 17 13:57:21.994705 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:21.994675    2579 scope.go:117] "RemoveContainer" containerID="8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3"
Sep 17 13:57:21.994870 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:21.994846    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ctlc8_openshift-console-operator(4f2104af-88ed-429e-9334-5768a8418ab7)\"" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" podUID="4f2104af-88ed-429e-9334-5768a8418ab7"
Sep 17 13:57:22.216398 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.216364    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"]
Sep 17 13:57:22.219732 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.219713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.229243 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.229224    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 13:57:22.229310 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.229263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fwvc9\""
Sep 17 13:57:22.229487 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.229471    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 13:57:22.229530 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.229473    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 13:57:22.229692 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.229679    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 13:57:22.245632 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.245572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"]
Sep 17 13:57:22.326546 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.326510    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"]
Sep 17 13:57:22.328745 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.328724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.332309 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.332287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7hfz\" (UniqueName: \"kubernetes.io/projected/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-kube-api-access-n7hfz\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.332404 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.332340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-serving-cert\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.332457 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.332423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-config\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.336001 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.335982    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 13:57:22.336001 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.335992    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 13:57:22.336275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.336259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5mbht\""
Sep 17 13:57:22.336706 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.336691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 13:57:22.338032 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.338018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 13:57:22.344590 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.344568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"]
Sep 17 13:57:22.433584 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hfz\" (UniqueName: \"kubernetes.io/projected/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-kube-api-access-n7hfz\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.433769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2714acdf-3521-4516-adc3-d76bf7e4440f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.433769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-serving-cert\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.433769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjjcm\" (UniqueName: \"kubernetes.io/projected/2714acdf-3521-4516-adc3-d76bf7e4440f-kube-api-access-rjjcm\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.433769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2714acdf-3521-4516-adc3-d76bf7e4440f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.433925 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.433806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-config\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.434329 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.434302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-config\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.435776 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.435757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-serving-cert\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.447345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.447319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hfz\" (UniqueName: \"kubernetes.io/projected/55306b37-6e4a-474b-be4e-b5eeeb6a3d5e-kube-api-access-n7hfz\") pod \"service-ca-operator-cf7c776b7-x65sl\" (UID: \"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.528630 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.528549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"
Sep 17 13:57:22.534940 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.534911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2714acdf-3521-4516-adc3-d76bf7e4440f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.535077 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.534963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjjcm\" (UniqueName: \"kubernetes.io/projected/2714acdf-3521-4516-adc3-d76bf7e4440f-kube-api-access-rjjcm\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.535131 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.535079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2714acdf-3521-4516-adc3-d76bf7e4440f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.535463 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.535441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2714acdf-3521-4516-adc3-d76bf7e4440f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.537347 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.537213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2714acdf-3521-4516-adc3-d76bf7e4440f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.543942 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.543915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjjcm\" (UniqueName: \"kubernetes.io/projected/2714acdf-3521-4516-adc3-d76bf7e4440f-kube-api-access-rjjcm\") pod \"kube-storage-version-migrator-operator-6c8f84f897-j9x4l\" (UID: \"2714acdf-3521-4516-adc3-d76bf7e4440f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.636638 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.636597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"
Sep 17 13:57:22.795941 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.795860    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl"]
Sep 17 13:57:22.798552 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:22.798526    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55306b37_6e4a_474b_be4e_b5eeeb6a3d5e.slice/crio-03a0e628ab2ae1ce722d52ff56dfcb2834671084780a157826d1c845fc4e2b0e WatchSource:0}: Error finding container 03a0e628ab2ae1ce722d52ff56dfcb2834671084780a157826d1c845fc4e2b0e: Status 404 returned error can't find the container with id 03a0e628ab2ae1ce722d52ff56dfcb2834671084780a157826d1c845fc4e2b0e
Sep 17 13:57:22.903899 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.903866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l"]
Sep 17 13:57:22.906543 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:22.906519    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2714acdf_3521_4516_adc3_d76bf7e4440f.slice/crio-c7688c382c3cc84fad406b6ab57f021a85a73ca3f90b3a37c06472f7e1027853 WatchSource:0}: Error finding container c7688c382c3cc84fad406b6ab57f021a85a73ca3f90b3a37c06472f7e1027853: Status 404 returned error can't find the container with id c7688c382c3cc84fad406b6ab57f021a85a73ca3f90b3a37c06472f7e1027853
Sep 17 13:57:22.998387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.998350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l" event={"ID":"2714acdf-3521-4516-adc3-d76bf7e4440f","Type":"ContainerStarted","Data":"c7688c382c3cc84fad406b6ab57f021a85a73ca3f90b3a37c06472f7e1027853"}
Sep 17 13:57:22.999910 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:22.999892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 13:57:23.000294 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.000276    2579 scope.go:117] "RemoveContainer" containerID="8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3"
Sep 17 13:57:23.000452 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.000431    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ctlc8_openshift-console-operator(4f2104af-88ed-429e-9334-5768a8418ab7)\"" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" podUID="4f2104af-88ed-429e-9334-5768a8418ab7"
Sep 17 13:57:23.001136 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.001113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl" event={"ID":"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e","Type":"ContainerStarted","Data":"03a0e628ab2ae1ce722d52ff56dfcb2834671084780a157826d1c845fc4e2b0e"}
Sep 17 13:57:23.704311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.704276    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:57:23.706566 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.706544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.710384 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.710361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 13:57:23.710595 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.710581    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 13:57:23.710675 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.710619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjxbg\""
Sep 17 13:57:23.711008 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.710991    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 13:57:23.719524 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.719491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 13:57:23.729838 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.729804    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:57:23.746100 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:23.746367 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746367 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.746293    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 13:57:23.746367 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:23.746367 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.746363    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:31.746343197 +0000 UTC m=+97.520110868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : configmap "kube-rbac-proxy" not found
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.746443    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.746488    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:31.746475424 +0000 UTC m=+97.520243077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746583 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpflt\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.746882 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.746645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847024 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.846985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847216 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847216 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847216 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.847172    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 13:57:23.847216 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.847197    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9: secret "image-registry-tls" not found
Sep 17 13:57:23.847442 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:23.847278    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls podName:3fe25472-9736-47c5-95fb-ddd308d1b390 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:24.347257244 +0000 UTC m=+90.121024897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls") pod "image-registry-7fd7d8c4ff-4jxf9" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390") : secret "image-registry-tls" not found
Sep 17 13:57:23.847442 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847442 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847598 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpflt\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847598 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847598 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.847939 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.847912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.848127 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.848104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.848445 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.848423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.849950 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.849905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.849950 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.849919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.885206 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.885170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:23.885349 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:23.885330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpflt\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:24.352243 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:24.352136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:24.352691 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:24.352282    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 13:57:24.352691 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:24.352308    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9: secret "image-registry-tls" not found
Sep 17 13:57:24.352691 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:24.352372    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls podName:3fe25472-9736-47c5-95fb-ddd308d1b390 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:25.352352749 +0000 UTC m=+91.126120424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls") pod "image-registry-7fd7d8c4ff-4jxf9" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390") : secret "image-registry-tls" not found
Sep 17 13:57:25.009816 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:25.009726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl" event={"ID":"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e","Type":"ContainerStarted","Data":"8dc288cdcc98c02e4e23686bdf662564b94afdc161cb842cdf48e3d59e76962b"}
Sep 17 13:57:25.031781 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:25.031728    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl" podStartSLOduration=1.235525833 podStartE2EDuration="3.031709795s" totalImagesPullingTime="1.796183962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:25.031210473 +0000 UTC m=+90.804978146" watchObservedRunningTime="2026-09-17 13:57:25.031709795 +0000 UTC m=+90.805477506"
Sep 17 13:57:25.361951 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:25.361930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:25.362284 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:25.362104    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 13:57:25.362284 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:25.362123    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9: secret "image-registry-tls" not found
Sep 17 13:57:25.362284 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:25.362182    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls podName:3fe25472-9736-47c5-95fb-ddd308d1b390 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:27.362163667 +0000 UTC m=+93.135931330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls") pod "image-registry-7fd7d8c4ff-4jxf9" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390") : secret "image-registry-tls" not found
Sep 17 13:57:26.015173 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:26.015135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l" event={"ID":"2714acdf-3521-4516-adc3-d76bf7e4440f","Type":"ContainerStarted","Data":"da6b4cf1ca6933f735a210ab13a229f660531ea5721cb6c8e01bae9b6865f029"}
Sep 17 13:57:26.033243 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:26.033198    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l" podStartSLOduration=1.591322524 podStartE2EDuration="4.033182967s" totalImagesPullingTime="2.441860443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:26.03240824 +0000 UTC m=+91.806175921" watchObservedRunningTime="2026-09-17 13:57:26.033182967 +0000 UTC m=+91.806950667"
Sep 17 13:57:27.380835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:27.380787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:27.381329 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:27.380909    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 13:57:27.381329 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:27.380922    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9: secret "image-registry-tls" not found
Sep 17 13:57:27.381329 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:27.380973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls podName:3fe25472-9736-47c5-95fb-ddd308d1b390 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:31.380959783 +0000 UTC m=+97.154727431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls") pod "image-registry-7fd7d8c4ff-4jxf9" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390") : secret "image-registry-tls" not found
Sep 17 13:57:28.086412 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.086359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:28.086592 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:28.086512    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:28.086592 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:28.086574    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls podName:1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:44.086558108 +0000 UTC m=+109.860325763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fd9vw" (UID: "1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7") : secret "cluster-monitoring-operator-tls" not found
Sep 17 13:57:28.528137 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.528101    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:28.528503 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.528159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:28.528503 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.528458    2579 scope.go:117] "RemoveContainer" containerID="8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3"
Sep 17 13:57:28.528613 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:28.528594    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ctlc8_openshift-console-operator(4f2104af-88ed-429e-9334-5768a8418ab7)\"" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" podUID="4f2104af-88ed-429e-9334-5768a8418ab7"
Sep 17 13:57:28.772420 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.772391    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9ptpv"]
Sep 17 13:57:28.774709 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.774692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.776977 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.776953    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 13:57:28.777114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.777086    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 13:57:28.777563 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.777546    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 13:57:28.777668 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.777653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 13:57:28.777736 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.777681    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2c755\""
Sep 17 13:57:28.783826 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.783807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9ptpv"]
Sep 17 13:57:28.892409 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.892387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-key\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.892517 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.892414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-cabundle\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.892517 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.892434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btnd\" (UniqueName: \"kubernetes.io/projected/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-kube-api-access-6btnd\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.993818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.993784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-key\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.993818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.993820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-cabundle\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.994012 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.993837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btnd\" (UniqueName: \"kubernetes.io/projected/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-kube-api-access-6btnd\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.994478 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.994454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-cabundle\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:28.996190 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:28.996165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-signing-key\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:29.005628 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:29.005610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btnd\" (UniqueName: \"kubernetes.io/projected/d28da2b4-861c-46ba-97ed-f2e5ec4842f6-kube-api-access-6btnd\") pod \"service-ca-568869fdc5-9ptpv\" (UID: \"d28da2b4-861c-46ba-97ed-f2e5ec4842f6\") " pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:29.083186 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:29.083115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9ptpv"
Sep 17 13:57:29.353458 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:29.353430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9ptpv"]
Sep 17 13:57:30.029267 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:30.029233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9ptpv" event={"ID":"d28da2b4-861c-46ba-97ed-f2e5ec4842f6","Type":"ContainerStarted","Data":"f1de50e27de9de630707c064b4bd4746e9f835937ca1d9c8ecbb824fbeafc973"}
Sep 17 13:57:30.029625 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:30.029295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9ptpv" event={"ID":"d28da2b4-861c-46ba-97ed-f2e5ec4842f6","Type":"ContainerStarted","Data":"6a56fb0022aaded05b120ee9c3ce165d56829aa29f52f617e6493ccbb1c0e668"}
Sep 17 13:57:30.051836 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:30.051787    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-9ptpv" podStartSLOduration=2.05177225 podStartE2EDuration="2.05177225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:30.049814087 +0000 UTC m=+95.823581755" watchObservedRunningTime="2026-09-17 13:57:30.05177225 +0000 UTC m=+95.825539921"
Sep 17 13:57:31.412222 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:31.412169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:31.412677 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:31.412392    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 13:57:31.412677 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:31.412410    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9: secret "image-registry-tls" not found
Sep 17 13:57:31.412677 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:31.412471    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls podName:3fe25472-9736-47c5-95fb-ddd308d1b390 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:39.412451646 +0000 UTC m=+105.186219316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls") pod "image-registry-7fd7d8c4ff-4jxf9" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390") : secret "image-registry-tls" not found
Sep 17 13:57:31.815149 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:31.815034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:31.815149 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:31.815142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:31.815382 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:31.815284    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:31.815382 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:31.815364    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls podName:f18133cd-99fa-4780-b31a-3f2e0e4d5593 nodeName:}" failed. No retries permitted until 2026-09-17 13:57:47.815335463 +0000 UTC m=+113.589103116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5thsn" (UID: "f18133cd-99fa-4780-b31a-3f2e0e4d5593") : secret "insights-runtime-extractor-tls" not found
Sep 17 13:57:31.815661 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:31.815635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18133cd-99fa-4780-b31a-3f2e0e4d5593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:32.522364 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:32.522321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:57:32.522747 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:32.522495    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 13:57:32.522747 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:32.522575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls podName:9e96b0a5-cab9-41ab-89b4-8c2f49406c52 nodeName:}" failed. No retries permitted until 2026-09-17 13:58:36.52255554 +0000 UTC m=+162.296323194 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls") pod "dns-default-rc6vk" (UID: "9e96b0a5-cab9-41ab-89b4-8c2f49406c52") : secret "dns-default-metrics-tls" not found
Sep 17 13:57:36.958507 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:36.958475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6r7m"
Sep 17 13:57:39.477540 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:39.477498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:39.479873 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:39.479846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"image-registry-7fd7d8c4ff-4jxf9\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") " pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:39.620960 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:39.620924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:39.705361 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:39.705337    2579 scope.go:117] "RemoveContainer" containerID="8854330cb36e4cb4fe03ef25c6a34288aec5de7866a56195fbd14e401560c8d3"
Sep 17 13:57:39.903762 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:39.903727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:57:39.906846 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:39.906817    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe25472_9736_47c5_95fb_ddd308d1b390.slice/crio-ef6778de82b0020c8a0df378fd9e6d59db8b5fbb86c9be57fafb2f0e58e98127 WatchSource:0}: Error finding container ef6778de82b0020c8a0df378fd9e6d59db8b5fbb86c9be57fafb2f0e58e98127: Status 404 returned error can't find the container with id ef6778de82b0020c8a0df378fd9e6d59db8b5fbb86c9be57fafb2f0e58e98127
Sep 17 13:57:40.063250 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.063181    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 13:57:40.063403 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.063310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" event={"ID":"4f2104af-88ed-429e-9334-5768a8418ab7","Type":"ContainerStarted","Data":"c47030f8fd83cdb99d55b8c7e33915aba86fbdf99f0448faa6f28353ca535997"}
Sep 17 13:57:40.063633 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.063614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:40.065267 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.065241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" event={"ID":"3fe25472-9736-47c5-95fb-ddd308d1b390","Type":"ContainerStarted","Data":"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"}
Sep 17 13:57:40.065368 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.065280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" event={"ID":"3fe25472-9736-47c5-95fb-ddd308d1b390","Type":"ContainerStarted","Data":"ef6778de82b0020c8a0df378fd9e6d59db8b5fbb86c9be57fafb2f0e58e98127"}
Sep 17 13:57:40.065431 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.065388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:57:40.069721 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.069698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8"
Sep 17 13:57:40.088125 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.084034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-ctlc8" podStartSLOduration=20.403071733 podStartE2EDuration="22.084016607s" totalImagesPullingTime="1.680944874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:40.083122611 +0000 UTC m=+105.856890282" watchObservedRunningTime="2026-09-17 13:57:40.084016607 +0000 UTC m=+105.857784277"
Sep 17 13:57:40.111744 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:40.111685    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" podStartSLOduration=17.111660779 podStartE2EDuration="17.111660779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:40.110250092 +0000 UTC m=+105.884017774" watchObservedRunningTime="2026-09-17 13:57:40.111660779 +0000 UTC m=+105.885428451"
Sep 17 13:57:44.117141 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:44.117101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:44.119476 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:44.119456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fd9vw\" (UID: \"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:44.349223 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:44.349196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"
Sep 17 13:57:44.634922 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:44.634887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw"]
Sep 17 13:57:44.640552 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:44.640521    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b22f679_85e1_4a60_bf7e_54bfc8d2d5f7.slice/crio-20a055a42956636e11c2ac5d97816c2ad47ac16a62dd0c5bb298a2e926ff7a93 WatchSource:0}: Error finding container 20a055a42956636e11c2ac5d97816c2ad47ac16a62dd0c5bb298a2e926ff7a93: Status 404 returned error can't find the container with id 20a055a42956636e11c2ac5d97816c2ad47ac16a62dd0c5bb298a2e926ff7a93
Sep 17 13:57:45.081716 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:45.081678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw" event={"ID":"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7","Type":"ContainerStarted","Data":"20a055a42956636e11c2ac5d97816c2ad47ac16a62dd0c5bb298a2e926ff7a93"}
Sep 17 13:57:47.089311 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:47.089279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw" event={"ID":"1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7","Type":"ContainerStarted","Data":"ebb00c4b853ea6138592cdb5409b872a1f072665dacc152e92f52433f924368f"}
Sep 17 13:57:47.114590 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:47.114550    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fd9vw" podStartSLOduration=33.490996954 podStartE2EDuration="35.114537834s" totalImagesPullingTime="1.62354088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:47.114472401 +0000 UTC m=+112.888240074" watchObservedRunningTime="2026-09-17 13:57:47.114537834 +0000 UTC m=+112.888305498"
Sep 17 13:57:47.847729 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:47.847692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:47.850256 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:47.850230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18133cd-99fa-4780-b31a-3f2e0e4d5593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5thsn\" (UID: \"f18133cd-99fa-4780-b31a-3f2e0e4d5593\") " pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:48.073545 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:48.073514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5thsn"
Sep 17 13:57:48.364776 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:48.364749    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5thsn"]
Sep 17 13:57:48.365864 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:48.365840    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18133cd_99fa_4780_b31a_3f2e0e4d5593.slice/crio-2f97c08f9300dc203eb5ed498b6648670f5fba5bb379e1bdaf842f3202ebf2ca WatchSource:0}: Error finding container 2f97c08f9300dc203eb5ed498b6648670f5fba5bb379e1bdaf842f3202ebf2ca: Status 404 returned error can't find the container with id 2f97c08f9300dc203eb5ed498b6648670f5fba5bb379e1bdaf842f3202ebf2ca
Sep 17 13:57:49.097645 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:49.097608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5thsn" event={"ID":"f18133cd-99fa-4780-b31a-3f2e0e4d5593","Type":"ContainerStarted","Data":"45cad139104f1416ff9c75167d7b52534e4d7919a350673dcc5c093b90e9e490"}
Sep 17 13:57:49.097795 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:49.097659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5thsn" event={"ID":"f18133cd-99fa-4780-b31a-3f2e0e4d5593","Type":"ContainerStarted","Data":"2f97c08f9300dc203eb5ed498b6648670f5fba5bb379e1bdaf842f3202ebf2ca"}
Sep 17 13:57:50.088032 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.088001    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"]
Sep 17 13:57:50.090132 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.090108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.092264 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.092242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"]
Sep 17 13:57:50.093064 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.093030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 13:57:50.093670 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.093653    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 13:57:50.093782 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.093757    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 13:57:50.094430 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.094413    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.095244 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.095223    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 13:57:50.097207 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.097188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q29sp\""
Sep 17 13:57:50.097483 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.097468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 17 13:57:50.102981 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.102956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5thsn" event={"ID":"f18133cd-99fa-4780-b31a-3f2e0e4d5593","Type":"ContainerStarted","Data":"85b075018b0b6d194fafb0a1c688973958ca567ac6e1a49d35242f61577dcef8"}
Sep 17 13:57:50.126786 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.126764    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"]
Sep 17 13:57:50.138928 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.138909    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:57:50.184854 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.184802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"]
Sep 17 13:57:50.265765 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.265732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxgs\" (UniqueName: \"kubernetes.io/projected/ad9d3e0b-11d6-4966-a106-cace71702147-kube-api-access-rtxgs\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.265911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.265776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4mn9\" (UniqueName: \"kubernetes.io/projected/ffeceed2-688b-451b-871d-0bf9a8598cd9-kube-api-access-z4mn9\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.265911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.265794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9d3e0b-11d6-4966-a106-cace71702147-tmp\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.265911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.265836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad9d3e0b-11d6-4966-a106-cace71702147-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.265911 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.265855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffeceed2-688b-451b-871d-0bf9a8598cd9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.367142 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4mn9\" (UniqueName: \"kubernetes.io/projected/ffeceed2-688b-451b-871d-0bf9a8598cd9-kube-api-access-z4mn9\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.367300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9d3e0b-11d6-4966-a106-cace71702147-tmp\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.367300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad9d3e0b-11d6-4966-a106-cace71702147-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.367300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffeceed2-688b-451b-871d-0bf9a8598cd9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.367300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxgs\" (UniqueName: \"kubernetes.io/projected/ad9d3e0b-11d6-4966-a106-cace71702147-kube-api-access-rtxgs\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.367612 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.367585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9d3e0b-11d6-4966-a106-cace71702147-tmp\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.370140 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.370109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad9d3e0b-11d6-4966-a106-cace71702147-klusterlet-config\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.370943 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.370911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffeceed2-688b-451b-871d-0bf9a8598cd9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.383345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.383320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4mn9\" (UniqueName: \"kubernetes.io/projected/ffeceed2-688b-451b-871d-0bf9a8598cd9-kube-api-access-z4mn9\") pod \"managed-serviceaccount-addon-agent-f4cbbf946-pnmgx\" (UID: \"ffeceed2-688b-451b-871d-0bf9a8598cd9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.394580 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.394553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxgs\" (UniqueName: \"kubernetes.io/projected/ad9d3e0b-11d6-4966-a106-cace71702147-kube-api-access-rtxgs\") pod \"klusterlet-addon-workmgr-787c5589ff-574fz\" (UID: \"ad9d3e0b-11d6-4966-a106-cace71702147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.401167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.401146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:50.420104 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.420082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"
Sep 17 13:57:50.682331 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.682291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"]
Sep 17 13:57:50.685278 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:50.685253    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9d3e0b_11d6_4966_a106_cace71702147.slice/crio-ddd38484f3f50b59470f95bbfb00e8d58e6cab6bf2c42221a4bf10bd7dd43f4f WatchSource:0}: Error finding container ddd38484f3f50b59470f95bbfb00e8d58e6cab6bf2c42221a4bf10bd7dd43f4f: Status 404 returned error can't find the container with id ddd38484f3f50b59470f95bbfb00e8d58e6cab6bf2c42221a4bf10bd7dd43f4f
Sep 17 13:57:50.704715 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:50.704665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx"]
Sep 17 13:57:50.707754 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:57:50.707728    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffeceed2_688b_451b_871d_0bf9a8598cd9.slice/crio-86af69a6fa70d6ac321da82b4167dfe2330e1b8d90b53e57cf7924db130833cc WatchSource:0}: Error finding container 86af69a6fa70d6ac321da82b4167dfe2330e1b8d90b53e57cf7924db130833cc: Status 404 returned error can't find the container with id 86af69a6fa70d6ac321da82b4167dfe2330e1b8d90b53e57cf7924db130833cc
Sep 17 13:57:51.108138 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:51.108101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz" event={"ID":"ad9d3e0b-11d6-4966-a106-cace71702147","Type":"ContainerStarted","Data":"ddd38484f3f50b59470f95bbfb00e8d58e6cab6bf2c42221a4bf10bd7dd43f4f"}
Sep 17 13:57:51.109434 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:51.109408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx" event={"ID":"ffeceed2-688b-451b-871d-0bf9a8598cd9","Type":"ContainerStarted","Data":"86af69a6fa70d6ac321da82b4167dfe2330e1b8d90b53e57cf7924db130833cc"}
Sep 17 13:57:52.119013 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:52.118976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5thsn" event={"ID":"f18133cd-99fa-4780-b31a-3f2e0e4d5593","Type":"ContainerStarted","Data":"d3957c6d88ba785dd74217dc4ee096b39be5ccf5414a113e4c888d22a182bf21"}
Sep 17 13:57:52.144852 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:52.143884    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5thsn" podStartSLOduration=34.454928528 podStartE2EDuration="37.143864116s" totalImagesPullingTime="2.688935588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 13:57:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:52.141754543 +0000 UTC m=+117.915522214" watchObservedRunningTime="2026-09-17 13:57:52.143864116 +0000 UTC m=+117.917631790"
Sep 17 13:57:56.135153 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.135118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz" event={"ID":"ad9d3e0b-11d6-4966-a106-cace71702147","Type":"ContainerStarted","Data":"9ea15338b7f44c38bdfd530192aa4699a2f8049117d3b379da97789e02db6a35"}
Sep 17 13:57:56.135586 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.135282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:56.140971 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.137207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx" event={"ID":"ffeceed2-688b-451b-871d-0bf9a8598cd9","Type":"ContainerStarted","Data":"41fd123b935dc02c8d1d70968180749dab2842436a452417b49c5b94e87903fc"}
Sep 17 13:57:56.140971 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.137540    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz"
Sep 17 13:57:56.166448 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.166408    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787c5589ff-574fz" podStartSLOduration=1.575145434 podStartE2EDuration="6.166391517s" totalImagesPullingTime="4.591246083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:56.16629658 +0000 UTC m=+121.940064250" watchObservedRunningTime="2026-09-17 13:57:56.166391517 +0000 UTC m=+121.940159191"
Sep 17 13:57:56.239583 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:56.239538    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4cbbf946-pnmgx" podStartSLOduration=1.708297635 podStartE2EDuration="6.239525007s" totalImagesPullingTime="4.531227372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:57:56.200727218 +0000 UTC m=+121.974494890" watchObservedRunningTime="2026-09-17 13:57:56.239525007 +0000 UTC m=+122.013292677"
Sep 17 13:57:59.347291 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.347254    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gqxl"]
Sep 17 13:57:59.373634 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.373603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.376246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.375970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 13:57:59.376246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.376005    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 13:57:59.376246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.376077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 13:57:59.376668 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.376650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 13:57:59.377593 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.377343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s544l\""
Sep 17 13:57:59.444261 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-sys\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444365 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-root\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444365 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-metrics-client-ca\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444489 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc2dw\" (UniqueName: \"kubernetes.io/projected/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-kube-api-access-pc2dw\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444489 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444565 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-wtmp\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444605 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444645 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-textfile\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.444702 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.444645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545584 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-sys\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545682 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-root\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545682 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-metrics-client-ca\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545682 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-sys\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-root\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc2dw\" (UniqueName: \"kubernetes.io/projected/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-kube-api-access-pc2dw\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-wtmp\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.545835 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546073 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:59.545847    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 13:57:59.546073 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:57:59.545907    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls podName:2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c nodeName:}" failed. No retries permitted until 2026-09-17 13:58:00.045885896 +0000 UTC m=+125.819653548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls") pod "node-exporter-7gqxl" (UID: "2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c") : secret "node-exporter-tls" not found
Sep 17 13:57:59.546073 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-textfile\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546073 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.545975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546268 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.546142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-textfile\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546268 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.546229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-wtmp\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546362 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.546342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-metrics-client-ca\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.546511 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.546486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.548316 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.548289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:57:59.570469 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:57:59.570443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc2dw\" (UniqueName: \"kubernetes.io/projected/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-kube-api-access-pc2dw\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:58:00.049352 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:00.049318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:58:00.051660 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:00.051629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c-node-exporter-tls\") pod \"node-exporter-7gqxl\" (UID: \"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c\") " pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:58:00.145800 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:00.145773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:58:00.284809 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:00.284776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gqxl"
Sep 17 13:58:00.294943 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:58:00.294919    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb7ee68_cad5_4d21_b5cc_27e9482ebd8c.slice/crio-0c628a4b7626501298417981497c9dc15b0a117f95e7bed3e39124c53443072b WatchSource:0}: Error finding container 0c628a4b7626501298417981497c9dc15b0a117f95e7bed3e39124c53443072b: Status 404 returned error can't find the container with id 0c628a4b7626501298417981497c9dc15b0a117f95e7bed3e39124c53443072b
Sep 17 13:58:01.153389 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:01.153354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqxl" event={"ID":"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c","Type":"ContainerStarted","Data":"0c628a4b7626501298417981497c9dc15b0a117f95e7bed3e39124c53443072b"}
Sep 17 13:58:02.158116 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:02.158083    2579 generic.go:356] "Generic (PLEG): container finished" podID="2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c" containerID="e92782f686f9af2fdaccd9d946c228ddb3a0426ba5ff3a238fb61a63132a4b78" exitCode=0
Sep 17 13:58:02.158499 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:02.158128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqxl" event={"ID":"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c","Type":"ContainerDied","Data":"e92782f686f9af2fdaccd9d946c228ddb3a0426ba5ff3a238fb61a63132a4b78"}
Sep 17 13:58:03.163980 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.163945    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqxl" event={"ID":"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c","Type":"ContainerStarted","Data":"09f1281eb1765c2dcc84f5a960b79ce407025a4198a9ba24176161239368f1ba"}
Sep 17 13:58:03.164397 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.164012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqxl" event={"ID":"2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c","Type":"ContainerStarted","Data":"ebb386a045ec7b435c8b48fc4d5c51b7fe5584057c37c73f0225fed1d9c2b35a"}
Sep 17 13:58:03.219698 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.219651    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gqxl" podStartSLOduration=2.632869869 podStartE2EDuration="4.219637222s" totalImagesPullingTime="1.525853739s" totalInitContainerRuntime="60.913614ms" isStatefulPod=true podCreationTimestamp="2026-09-17 13:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:58:03.219512051 +0000 UTC m=+128.993279720" watchObservedRunningTime="2026-09-17 13:58:03.219637222 +0000 UTC m=+128.993404892"
Sep 17 13:58:03.822186 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.822154    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86f66fd88b-92txb"]
Sep 17 13:58:03.825627 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.825609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.831349 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.831320    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 13:58:03.831505 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.831352    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 13:58:03.831505 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.831404    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4kbzn\""
Sep 17 13:58:03.831505 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.831352    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 13:58:03.831505 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.831443    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 13:58:03.833114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.833097    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-co4c508n5p9c2\""
Sep 17 13:58:03.850584 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.850562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86f66fd88b-92txb"]
Sep 17 13:58:03.877202 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-tls\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877308 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-client-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877357 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877357 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-client-certs\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877357 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-metrics-server-audit-profiles\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877471 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-audit-log\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.877471 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.877411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbrh6\" (UniqueName: \"kubernetes.io/projected/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-kube-api-access-bbrh6\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978156 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-client-certs\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-metrics-server-audit-profiles\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-audit-log\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978275 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbrh6\" (UniqueName: \"kubernetes.io/projected/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-kube-api-access-bbrh6\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978473 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-tls\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978473 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-client-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978717 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-audit-log\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.978972 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.978946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.979297 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.979278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-metrics-server-audit-profiles\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.980697 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.980679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-client-ca-bundle\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.980785 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.980711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-client-certs\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.980785 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.980758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-secret-metrics-server-tls\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:03.995425 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:03.995394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbrh6\" (UniqueName: \"kubernetes.io/projected/73382f35-4ba9-43e0-8e4e-10b8e9064cf3-kube-api-access-bbrh6\") pod \"metrics-server-86f66fd88b-92txb\" (UID: \"73382f35-4ba9-43e0-8e4e-10b8e9064cf3\") " pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:04.134929 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.134899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:04.413114 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.413035    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86f66fd88b-92txb"]
Sep 17 13:58:04.416003 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:58:04.415981    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73382f35_4ba9_43e0_8e4e_10b8e9064cf3.slice/crio-b70a8ce3750c08a2b3370949eab5e2fcadcd6c7c8d489bf38733588841abbf08 WatchSource:0}: Error finding container b70a8ce3750c08a2b3370949eab5e2fcadcd6c7c8d489bf38733588841abbf08: Status 404 returned error can't find the container with id b70a8ce3750c08a2b3370949eab5e2fcadcd6c7c8d489bf38733588841abbf08
Sep 17 13:58:04.482453 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.482426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:58:04.484507 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.484488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca8f0af-2268-4304-9894-fc28c5630f19-metrics-certs\") pod \"network-metrics-daemon-45c6t\" (UID: \"eca8f0af-2268-4304-9894-fc28c5630f19\") " pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:58:04.708858 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.708797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gs47f\""
Sep 17 13:58:04.717087 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.717069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45c6t"
Sep 17 13:58:04.992627 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:04.992567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45c6t"]
Sep 17 13:58:04.997604 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:58:04.997580    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca8f0af_2268_4304_9894_fc28c5630f19.slice/crio-13f60ec92ad664a5444fb7d262a1916b859359d78fc94e462a6a55176af65705 WatchSource:0}: Error finding container 13f60ec92ad664a5444fb7d262a1916b859359d78fc94e462a6a55176af65705: Status 404 returned error can't find the container with id 13f60ec92ad664a5444fb7d262a1916b859359d78fc94e462a6a55176af65705
Sep 17 13:58:05.172472 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.172440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45c6t" event={"ID":"eca8f0af-2268-4304-9894-fc28c5630f19","Type":"ContainerStarted","Data":"13f60ec92ad664a5444fb7d262a1916b859359d78fc94e462a6a55176af65705"}
Sep 17 13:58:05.173556 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.173536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb" event={"ID":"73382f35-4ba9-43e0-8e4e-10b8e9064cf3","Type":"ContainerStarted","Data":"b70a8ce3750c08a2b3370949eab5e2fcadcd6c7c8d489bf38733588841abbf08"}
Sep 17 13:58:05.896218 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.896004    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:58:05.900280 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.900250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.904429 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.904409    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 13:58:05.904691 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.904672    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 13:58:05.905597 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.905572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 13:58:05.905690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.905628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 13:58:05.905841 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.905826    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 13:58:05.906078 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.906026    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 13:58:05.906819 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.906799    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 13:58:05.908550 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.908529    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7q7ti489qtot9\""
Sep 17 13:58:05.908649 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.908568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 13:58:05.908649 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.908585    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 13:58:05.908765 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.908511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 13:58:05.909379 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.908905    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 13:58:05.909379 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.909007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 13:58:05.910535 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.910388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbwl8\""
Sep 17 13:58:05.914559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.914538    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 13:58:05.918827 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.918808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 13:58:05.938818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.938796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:58:05.994598 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994724 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994724 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994724 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.994889 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.994983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpd6x\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995111 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:05.995399 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:05.995268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.096628 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.096760 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.096760 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.096760 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.096760 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.096974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpd6x\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.097954 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.097455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.099380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.098595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.099380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.098716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.099380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.098939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.102141 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.099689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.102840 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.102769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.103308 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.103257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.103440 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.103414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.104786 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.104744    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.105752 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.105681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.105752 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.105681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.105752 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.105723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.105953 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.105812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.105953 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.105854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.106188 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.106132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.106296 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.106273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.106690 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.106630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.106833 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.106813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.107695 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.107673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.114682 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.114661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpd6x\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x\") pod \"prometheus-k8s-0\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.178879 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.178819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45c6t" event={"ID":"eca8f0af-2268-4304-9894-fc28c5630f19","Type":"ContainerStarted","Data":"d1f8d8e08f094b1eda46594d23e5268d8d25db3e16ff67af5d94a516b1ee3b13"}
Sep 17 13:58:06.213459 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.213429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:06.745469 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:06.745439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:58:06.747725 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:58:06.747697    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054beed8_0ff3_41f2_b0c2_2fdf6d028202.slice/crio-bbc245a3a964f6e2b4deaedc0a2dabd84e226b72429b4be00d89cf8f9c9ccce6 WatchSource:0}: Error finding container bbc245a3a964f6e2b4deaedc0a2dabd84e226b72429b4be00d89cf8f9c9ccce6: Status 404 returned error can't find the container with id bbc245a3a964f6e2b4deaedc0a2dabd84e226b72429b4be00d89cf8f9c9ccce6
Sep 17 13:58:07.183990 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:07.183954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb" event={"ID":"73382f35-4ba9-43e0-8e4e-10b8e9064cf3","Type":"ContainerStarted","Data":"94a084a337297d16690703eb01e4ff39df064afc1b2282762f43bbf9d97acd44"}
Sep 17 13:58:07.185303 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:07.185271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"bbc245a3a964f6e2b4deaedc0a2dabd84e226b72429b4be00d89cf8f9c9ccce6"}
Sep 17 13:58:07.187116 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:07.187095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45c6t" event={"ID":"eca8f0af-2268-4304-9894-fc28c5630f19","Type":"ContainerStarted","Data":"4d7a18cafcb049e05d365c7944d2b171175d51c82436e8b475acf8b5e06dfd38"}
Sep 17 13:58:07.203791 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:07.203749    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb" podStartSLOduration=2.120477127 podStartE2EDuration="4.203735629s" totalImagesPullingTime="2.083258502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:58:07.203278095 +0000 UTC m=+132.977045763" watchObservedRunningTime="2026-09-17 13:58:07.203735629 +0000 UTC m=+132.977503281"
Sep 17 13:58:07.224774 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:07.224736    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-45c6t" podStartSLOduration=131.245282149 podStartE2EDuration="2m12.224723336s" totalImagesPullingTime="979.441187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:58:07.224328306 +0000 UTC m=+132.998095988" watchObservedRunningTime="2026-09-17 13:58:07.224723336 +0000 UTC m=+132.998491006"
Sep 17 13:58:08.192149 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:08.192124    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f" exitCode=0
Sep 17 13:58:08.192417 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:08.192226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"}
Sep 17 13:58:12.209919 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:12.209889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"}
Sep 17 13:58:13.216299 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:13.216266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"}
Sep 17 13:58:14.225748 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:14.225708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"}
Sep 17 13:58:14.226160 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:14.225801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"}
Sep 17 13:58:15.157345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.157305    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" podUID="3fe25472-9736-47c5-95fb-ddd308d1b390" containerName="registry" containerID="cri-o://2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74" gracePeriod=30
Sep 17 13:58:15.232099 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.232068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"}
Sep 17 13:58:15.232457 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.232154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerStarted","Data":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"}
Sep 17 13:58:15.284761 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.284710    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.25401447 podStartE2EDuration="10.28468949s" totalImagesPullingTime="7.013162623s" totalInitContainerRuntime="17.512397ms" isStatefulPod=false podCreationTimestamp="2026-09-17 13:58:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:58:15.282931662 +0000 UTC m=+141.056699345" watchObservedRunningTime="2026-09-17 13:58:15.28468949 +0000 UTC m=+141.058457165"
Sep 17 13:58:15.395054 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.395022    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:58:15.481420 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481358    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481420 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481412    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481577 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481433    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481577 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481554    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpflt\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481686 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481643    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481686 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481781 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481781 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets\") pod \"3fe25472-9736-47c5-95fb-ddd308d1b390\" (UID: \"3fe25472-9736-47c5-95fb-ddd308d1b390\") "
Sep 17 13:58:15.481868 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.481801    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:58:15.482033 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.482002    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-trusted-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.482200 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.482173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:58:15.483901 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.483854    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:58:15.483987 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.483934    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 13:58:15.484064 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.484005    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 13:58:15.484064 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.484008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:58:15.484212 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.484190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt" (OuterVolumeSpecName: "kube-api-access-bpflt") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "kube-api-access-bpflt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 13:58:15.490439 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.490419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3fe25472-9736-47c5-95fb-ddd308d1b390" (UID: "3fe25472-9736-47c5-95fb-ddd308d1b390"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 13:58:15.582706 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582686    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpflt\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-kube-api-access-bpflt\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582709    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-image-registry-private-configuration\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582723    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fe25472-9736-47c5-95fb-ddd308d1b390-ca-trust-extracted\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582739    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-certificates\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582751    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fe25472-9736-47c5-95fb-ddd308d1b390-installation-pull-secrets\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582764    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-bound-sa-token\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:15.582794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:15.582777    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fe25472-9736-47c5-95fb-ddd308d1b390-registry-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:58:16.214137 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.214100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:58:16.236640 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.236609    2579 generic.go:356] "Generic (PLEG): container finished" podID="3fe25472-9736-47c5-95fb-ddd308d1b390" containerID="2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74" exitCode=0
Sep 17 13:58:16.236988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.236657    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"
Sep 17 13:58:16.236988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.236689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" event={"ID":"3fe25472-9736-47c5-95fb-ddd308d1b390","Type":"ContainerDied","Data":"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"}
Sep 17 13:58:16.236988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.236728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9" event={"ID":"3fe25472-9736-47c5-95fb-ddd308d1b390","Type":"ContainerDied","Data":"ef6778de82b0020c8a0df378fd9e6d59db8b5fbb86c9be57fafb2f0e58e98127"}
Sep 17 13:58:16.236988 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.236749    2579 scope.go:117] "RemoveContainer" containerID="2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"
Sep 17 13:58:16.245480 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.245347    2579 scope.go:117] "RemoveContainer" containerID="2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"
Sep 17 13:58:16.245715 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:58:16.245696    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74\": container with ID starting with 2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74 not found: ID does not exist" containerID="2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"
Sep 17 13:58:16.245780 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.245725    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74"} err="failed to get container status \"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74\": rpc error: code = NotFound desc = could not find container \"2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74\": container with ID starting with 2380d5721586c9b771a3d66767b53ad2c845efac77d0aec3a17c35a338de3a74 not found: ID does not exist"
Sep 17 13:58:16.265482 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.265462    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:58:16.268762 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.268743    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fd7d8c4ff-4jxf9"]
Sep 17 13:58:16.697303 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:16.697274    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe25472-9736-47c5-95fb-ddd308d1b390" path="/var/lib/kubelet/pods/3fe25472-9736-47c5-95fb-ddd308d1b390/volumes"
Sep 17 13:58:24.135753 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:24.135719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:24.136167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:24.135804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:31.294236 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:31.294200    2579 generic.go:356] "Generic (PLEG): container finished" podID="55306b37-6e4a-474b-be4e-b5eeeb6a3d5e" containerID="8dc288cdcc98c02e4e23686bdf662564b94afdc161cb842cdf48e3d59e76962b" exitCode=0
Sep 17 13:58:31.294741 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:31.294246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl" event={"ID":"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e","Type":"ContainerDied","Data":"8dc288cdcc98c02e4e23686bdf662564b94afdc161cb842cdf48e3d59e76962b"}
Sep 17 13:58:31.294741 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:31.294606    2579 scope.go:117] "RemoveContainer" containerID="8dc288cdcc98c02e4e23686bdf662564b94afdc161cb842cdf48e3d59e76962b"
Sep 17 13:58:31.645105 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:58:31.645036    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rc6vk" podUID="9e96b0a5-cab9-41ab-89b4-8c2f49406c52"
Sep 17 13:58:32.300207 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:32.300170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x65sl" event={"ID":"55306b37-6e4a-474b-be4e-b5eeeb6a3d5e","Type":"ContainerStarted","Data":"f1c9205fe67782fa56e5bad19c730d4dfacc064c9d5f74684275b3111b4cf09c"}
Sep 17 13:58:32.300207 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:32.300204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:58:32.820942 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:32.820915    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lr9q_be719d5c-af1b-41b7-a098-470920b14b9f/dns-node-resolver/0.log"
Sep 17 13:58:33.424794 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:33.424764    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8m4sd_bde1eaca-c657-4461-b8ac-61bff2a41ac2/serve-healthcheck-canary/0.log"
Sep 17 13:58:36.549882 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:36.549839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:58:36.552136 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:36.552114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e96b0a5-cab9-41ab-89b4-8c2f49406c52-metrics-tls\") pod \"dns-default-rc6vk\" (UID: \"9e96b0a5-cab9-41ab-89b4-8c2f49406c52\") " pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:58:36.803213 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:36.803148    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f8wrh\""
Sep 17 13:58:36.811126 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:36.811101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:58:37.082915 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:37.082850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rc6vk"]
Sep 17 13:58:37.086134 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:58:37.086109    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e96b0a5_cab9_41ab_89b4_8c2f49406c52.slice/crio-5003d1f13651fbe8477c96383947f3da3081817f4d27b0d90359e0fb60aecfd5 WatchSource:0}: Error finding container 5003d1f13651fbe8477c96383947f3da3081817f4d27b0d90359e0fb60aecfd5: Status 404 returned error can't find the container with id 5003d1f13651fbe8477c96383947f3da3081817f4d27b0d90359e0fb60aecfd5
Sep 17 13:58:37.318340 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:37.318308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc6vk" event={"ID":"9e96b0a5-cab9-41ab-89b4-8c2f49406c52","Type":"ContainerStarted","Data":"5003d1f13651fbe8477c96383947f3da3081817f4d27b0d90359e0fb60aecfd5"}
Sep 17 13:58:39.328028 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:39.327997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc6vk" event={"ID":"9e96b0a5-cab9-41ab-89b4-8c2f49406c52","Type":"ContainerStarted","Data":"78d7f7acead4081f17251270d1e3826836fd9f113d67b1ff3ce446fe57443311"}
Sep 17 13:58:39.328380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:39.328065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rc6vk" event={"ID":"9e96b0a5-cab9-41ab-89b4-8c2f49406c52","Type":"ContainerStarted","Data":"f4b19aba039f6ade62e097c0e420f38335fd2a34e059eadb9e60cb5bf828d7e4"}
Sep 17 13:58:39.328380 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:39.328107    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:58:39.367810 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:39.367756    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rc6vk" podStartSLOduration=129.755847188 podStartE2EDuration="2m11.367739723s" totalImagesPullingTime="1.611892535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 13:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:58:39.367257864 +0000 UTC m=+165.141051508" watchObservedRunningTime="2026-09-17 13:58:39.367739723 +0000 UTC m=+165.141507393"
Sep 17 13:58:44.141255 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:44.141227    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:44.145213 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:44.145183    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86f66fd88b-92txb"
Sep 17 13:58:46.358033 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:46.358004    2579 generic.go:356] "Generic (PLEG): container finished" podID="2714acdf-3521-4516-adc3-d76bf7e4440f" containerID="da6b4cf1ca6933f735a210ab13a229f660531ea5721cb6c8e01bae9b6865f029" exitCode=0
Sep 17 13:58:46.358405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:46.358067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l" event={"ID":"2714acdf-3521-4516-adc3-d76bf7e4440f","Type":"ContainerDied","Data":"da6b4cf1ca6933f735a210ab13a229f660531ea5721cb6c8e01bae9b6865f029"}
Sep 17 13:58:46.358405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:46.358372    2579 scope.go:117] "RemoveContainer" containerID="da6b4cf1ca6933f735a210ab13a229f660531ea5721cb6c8e01bae9b6865f029"
Sep 17 13:58:47.365643 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:47.365556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-j9x4l" event={"ID":"2714acdf-3521-4516-adc3-d76bf7e4440f","Type":"ContainerStarted","Data":"48daa510f12c617d06704f32ef1cb2caf3b2bb6976a245d8adf288f1218eaf66"}
Sep 17 13:58:49.334429 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:58:49.334398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rc6vk"
Sep 17 13:59:06.214307 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:06.214276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:06.233719 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:06.233693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:06.451233 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:06.451204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:24.417712 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.417666    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418004    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="prometheus" containerID="cri-o://e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1" gracePeriod=600
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418034    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="thanos-sidecar" containerID="cri-o://395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97" gracePeriod=600
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418086    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="config-reloader" containerID="cri-o://00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5" gracePeriod=600
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418142    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-web" containerID="cri-o://f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940" gracePeriod=600
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418030    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy" containerID="cri-o://c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01" gracePeriod=600
Sep 17 13:59:24.418295 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.418096    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13" gracePeriod=600
Sep 17 13:59:24.646620 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.646596    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:24.711888 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.711888 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.711888 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711877    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711946    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.711980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712061    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712092    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712167 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712177    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712214    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712274    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712290    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpd6x\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712360    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712426    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.712559 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs\") pod \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\" (UID: \"054beed8-0ff3-41f2-b0c2-2fdf6d028202\") "
Sep 17 13:59:24.713074 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.713074 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712805    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.713074 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.713074 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.712828    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-metrics-client-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.713280 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.713160    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.713280 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.713182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.713418 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.713387    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.715093 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.714773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 13:59:24.715572 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.715545    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.715768 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.715737    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.715969 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.715943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 13:59:24.716160 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.716123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 13:59:24.716302 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.716279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.716534 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.716508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out" (OuterVolumeSpecName: "config-out") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 13:59:24.716857 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.716839    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.716955 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.716935    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.717892 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.717866    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x" (OuterVolumeSpecName: "kube-api-access-kpd6x") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "kube-api-access-kpd6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 13:59:24.717986 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.717919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config" (OuterVolumeSpecName: "config") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.718386 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.718366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.718488 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.718441    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.727224 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.727204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config" (OuterVolumeSpecName: "web-config") pod "054beed8-0ff3-41f2-b0c2-2fdf6d028202" (UID: "054beed8-0ff3-41f2-b0c2-2fdf6d028202"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 13:59:24.813602 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813582    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813602 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813602    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813611    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-web-config\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813621    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-grpc-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813631    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813639    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813647    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpd6x\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-kube-api-access-kpd6x\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813655    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813663    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813671    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-config-out\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813680    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813688    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-metrics-client-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813696    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813704    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.813714 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813713    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054beed8-0ff3-41f2-b0c2-2fdf6d028202-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.814165 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813721    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054beed8-0ff3-41f2-b0c2-2fdf6d028202-tls-assets\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.814165 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813729    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054beed8-0ff3-41f2-b0c2-2fdf6d028202-prometheus-k8s-db\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:24.814165 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:24.813744    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054beed8-0ff3-41f2-b0c2-2fdf6d028202-secret-kube-rbac-proxy\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 13:59:25.506458 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506423    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13" exitCode=0
Sep 17 13:59:25.506458 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506453    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01" exitCode=0
Sep 17 13:59:25.506458 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506460    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940" exitCode=0
Sep 17 13:59:25.506458 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506466    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97" exitCode=0
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506471    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5" exitCode=0
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506477    2579 generic.go:356] "Generic (PLEG): container finished" podID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1" exitCode=0
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506538    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506652    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"}
Sep 17 13:59:25.507016 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.506712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054beed8-0ff3-41f2-b0c2-2fdf6d028202","Type":"ContainerDied","Data":"bbc245a3a964f6e2b4deaedc0a2dabd84e226b72429b4be00d89cf8f9c9ccce6"}
Sep 17 13:59:25.514645 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.514622    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.521900 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.521880    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.528228 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.528212    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.533513 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.533491    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:25.535466 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.535448    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.536816 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.536793    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:25.544425 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.544405    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.550977 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.550962    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.557017 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.556999    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.557267 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.557250    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.557313 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557276    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.557313 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557293    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.557538 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.557524    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.557590 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557540    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.557590 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557551    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.557735 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.557722    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.557769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557737    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.557769 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557748    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.557950 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.557937    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.557996 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557951    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.557996 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.557961    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.558231 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.558215    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.558286 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558234    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.558286 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558246    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.558470 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.558457    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.558508 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558472    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.558508 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558484    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.558714 ip-10-0-132-81 kubenswrapper[2579]: E0917 13:59:25.558698    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.558763 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558716    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.558763 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558728    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.558920 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558904    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.558961 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.558920    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.559191 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559176    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.559244 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559192    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.559385 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559363    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.559428 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559385    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.559575 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559559    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.559575 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559574    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.559760 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559746    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.559800 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559759    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.559959 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559936    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.559999 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.559961    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.560178 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560162    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.560222 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560178    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.560353 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560337    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.560393 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560353    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.560540 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560525    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.560580 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560541    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.560733 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560718    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.560774 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560732    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.560909 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560894    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.560909 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.560908    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.561142 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561125    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.561190 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561142    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.561307 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561292    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.561350 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561307    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.561519 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561504    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.561519 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561518    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.561695 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561681    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.561745 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561695    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.561910 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561887    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.561959 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.561911    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.562100 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562085    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.562145 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562101    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.562304 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562287    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.562345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562304    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.562481 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562467    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.562523 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562481    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.562683 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562667    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.562683 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562682    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.562858 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562843    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.562901 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.562858    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.563118 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563076    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.563118 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563092    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.563300 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563269    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.563345 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563300    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.563516 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563498    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.563560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563516    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.563730 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563714    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.563730 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563730    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.563936 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563920    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.563936 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.563935    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.564110 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564095    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.564161 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564112    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.564367 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564349    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.564367 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564366    2579 scope.go:117] "RemoveContainer" containerID="c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"
Sep 17 13:59:25.564562 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564544    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13"} err="failed to get container status \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": rpc error: code = NotFound desc = could not find container \"c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13\": container with ID starting with c50b44b1b205f88d7159fbed6324e0f81e446a5a2049259e227186fd1eb36b13 not found: ID does not exist"
Sep 17 13:59:25.564600 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564563    2579 scope.go:117] "RemoveContainer" containerID="c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"
Sep 17 13:59:25.564739 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564722    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01"} err="failed to get container status \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": rpc error: code = NotFound desc = could not find container \"c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01\": container with ID starting with c90b50d1260fe5d4d154448263aae2f8117d0185522254499d71a4a957f41c01 not found: ID does not exist"
Sep 17 13:59:25.564781 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564738    2579 scope.go:117] "RemoveContainer" containerID="f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"
Sep 17 13:59:25.564926 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564910    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940"} err="failed to get container status \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": rpc error: code = NotFound desc = could not find container \"f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940\": container with ID starting with f7573532d8dc501e0070d9b4367d1b8572d093b87e566c925d4167074263d940 not found: ID does not exist"
Sep 17 13:59:25.564967 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.564925    2579 scope.go:117] "RemoveContainer" containerID="395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"
Sep 17 13:59:25.565246 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565224    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97"} err="failed to get container status \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": rpc error: code = NotFound desc = could not find container \"395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97\": container with ID starting with 395d838b82fd885ee7691e1a7410821f5ebe38c37dd418cf59017cac9b564a97 not found: ID does not exist"
Sep 17 13:59:25.565301 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565249    2579 scope.go:117] "RemoveContainer" containerID="00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"
Sep 17 13:59:25.565592 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565572    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5"} err="failed to get container status \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": rpc error: code = NotFound desc = could not find container \"00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5\": container with ID starting with 00a20bdc340b8ec00dbb6e2162237551405be467f5609f240b153e8f8e69ace5 not found: ID does not exist"
Sep 17 13:59:25.565592 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565591    2579 scope.go:117] "RemoveContainer" containerID="e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"
Sep 17 13:59:25.565818 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565799    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1"} err="failed to get container status \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": rpc error: code = NotFound desc = could not find container \"e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1\": container with ID starting with e71474eba4c5cf6492677891552edae5ac83e5afb1510a0a212fb1e94554a9b1 not found: ID does not exist"
Sep 17 13:59:25.565890 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.565819    2579 scope.go:117] "RemoveContainer" containerID="8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"
Sep 17 13:59:25.566084 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.566060    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f"} err="failed to get container status \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": rpc error: code = NotFound desc = could not find container \"8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f\": container with ID starting with 8ab7c6701f278ec4c13e1e880afff4ac4be2615bdda559615c96cbd4ebc32b6f not found: ID does not exist"
Sep 17 13:59:25.577140 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577116    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:25.577355 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577343    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577357    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577366    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="config-reloader"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577371    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="config-reloader"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577378    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-web"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577383    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-web"
Sep 17 13:59:25.577394 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577393    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe25472-9736-47c5-95fb-ddd308d1b390" containerName="registry"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577398    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe25472-9736-47c5-95fb-ddd308d1b390" containerName="registry"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577405    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="init-config-reloader"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577409    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="init-config-reloader"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577414    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-thanos"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577419    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-thanos"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577427    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="prometheus"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577432    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="prometheus"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577436    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="thanos-sidecar"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577441    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="thanos-sidecar"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577481    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-thanos"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577488    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe25472-9736-47c5-95fb-ddd308d1b390" containerName="registry"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577494    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="config-reloader"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577498    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="prometheus"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577503    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy-web"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577509    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="thanos-sidecar"
Sep 17 13:59:25.577560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.577515    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" containerName="kube-rbac-proxy"
Sep 17 13:59:25.581973 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.581958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.584639 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.584623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbwl8\""
Sep 17 13:59:25.585070 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 13:59:25.585430 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585412    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 13:59:25.585485 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7q7ti489qtot9\""
Sep 17 13:59:25.585701 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585680    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 13:59:25.585789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 13:59:25.585789 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.585732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 13:59:25.586113 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.586094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 13:59:25.586406 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.586389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 13:59:25.586521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.586505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 13:59:25.586783 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.586767    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 13:59:25.587168 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.587154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 13:59:25.587606 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.587588    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 13:59:25.590729 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.590706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 13:59:25.590799 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.590773    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 13:59:25.592570 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.592554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 13:59:25.605909 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.605889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:25.722236 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722236 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722236 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-config-out\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722405 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-web-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722651 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.722917 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.722708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dkk4\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-kube-api-access-9dkk4\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823103 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823217 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823217 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823217 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823217 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dkk4\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-kube-api-access-9dkk4\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823484 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-config-out\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-web-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.823779 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.824293 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.824293 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.823927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.824521 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.824487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.825139 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.825116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.825327 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.825305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826445 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826445 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826603 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826603 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826603 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.826878 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.826830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.827957 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.827931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4432f2cf-8880-44cf-aefd-8d154bf57716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.828505 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.828481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.828832 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.828812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4432f2cf-8880-44cf-aefd-8d154bf57716-config-out\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.829136 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.829115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.829214 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.829201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-web-config\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.829263 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.829242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.829302 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.829274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4432f2cf-8880-44cf-aefd-8d154bf57716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.834487 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.834467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dkk4\" (UniqueName: \"kubernetes.io/projected/4432f2cf-8880-44cf-aefd-8d154bf57716-kube-api-access-9dkk4\") pod \"prometheus-k8s-0\" (UID: \"4432f2cf-8880-44cf-aefd-8d154bf57716\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:25.891546 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:25.891525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 13:59:26.175378 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:26.175343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 13:59:26.178721 ip-10-0-132-81 kubenswrapper[2579]: W0917 13:59:26.178697    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4432f2cf_8880_44cf_aefd_8d154bf57716.slice/crio-a557def8d2fdbe987048f083522fc6b169632f6693179296f5275bcd74607718 WatchSource:0}: Error finding container a557def8d2fdbe987048f083522fc6b169632f6693179296f5275bcd74607718: Status 404 returned error can't find the container with id a557def8d2fdbe987048f083522fc6b169632f6693179296f5275bcd74607718
Sep 17 13:59:26.511901 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:26.511819    2579 generic.go:356] "Generic (PLEG): container finished" podID="4432f2cf-8880-44cf-aefd-8d154bf57716" containerID="5134d6a8dba4d0a9c96af70fcb195261182d879806a87d80e9ed13de72ae4631" exitCode=0
Sep 17 13:59:26.511901 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:26.511879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerDied","Data":"5134d6a8dba4d0a9c96af70fcb195261182d879806a87d80e9ed13de72ae4631"}
Sep 17 13:59:26.512387 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:26.511950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"a557def8d2fdbe987048f083522fc6b169632f6693179296f5275bcd74607718"}
Sep 17 13:59:26.701560 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:26.701035    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054beed8-0ff3-41f2-b0c2-2fdf6d028202" path="/var/lib/kubelet/pods/054beed8-0ff3-41f2-b0c2-2fdf6d028202/volumes"
Sep 17 13:59:27.519960 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.519924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"4887616199f91316f6ea65de412879244cead03d90fc3d9fc456b9e466268639"}
Sep 17 13:59:27.520388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.519988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"72eaaa3ac67f1347e83d9354f7c8555df896ecf96082b9f1730441fda77b8bdf"}
Sep 17 13:59:27.520388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.520015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"a68775e54b7ffd5fb62669fce899c222d045cbfbb6797d6309a8ec9523ef7a7b"}
Sep 17 13:59:27.520388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.520059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"ee3e026cb115a8e1faff009380f6592f1da57d33946080a6766c3c394d7c3e1c"}
Sep 17 13:59:27.520388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.520088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"24f4233d3ca95342323f2a80274cec8507df098fa7335c0e426431d39c8f2507"}
Sep 17 13:59:27.520388 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.520110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4432f2cf-8880-44cf-aefd-8d154bf57716","Type":"ContainerStarted","Data":"9174e2302c28785080336232549b15f9e3635571a9ee111ab4172bc691ff57c9"}
Sep 17 13:59:27.556792 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:27.556735    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.540229037 podStartE2EDuration="2.556714051s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.485014ms" isStatefulPod=false podCreationTimestamp="2026-09-17 13:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 13:59:27.555429907 +0000 UTC m=+213.329197570" watchObservedRunningTime="2026-09-17 13:59:27.556714051 +0000 UTC m=+213.330481734"
Sep 17 13:59:30.892520 ip-10-0-132-81 kubenswrapper[2579]: I0917 13:59:30.892484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 14:00:25.892084 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:25.891987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 14:00:25.906991 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:25.906966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 14:00:26.760318 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:26.760292    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 14:00:54.606297 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:54.606268    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:00:54.608468 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:54.608447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:00:54.616388 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:00:54.616367    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 14:03:58.605282 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.605243    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"]
Sep 17 14:03:58.608632 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.608609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.611158 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.611137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d6jtr\""
Sep 17 14:03:58.611284 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.611205    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 14:03:58.611284 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.611240    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 14:03:58.623214 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.623191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"]
Sep 17 14:03:58.734881 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.734852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.734995 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.734914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt7qj\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-kube-api-access-mt7qj\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.835643 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.835612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt7qj\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-kube-api-access-mt7qj\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.835775 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.835668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.844320 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.844299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt7qj\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-kube-api-access-mt7qj\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.844406 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.844386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6vxv\" (UID: \"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:58.917338 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:58.917286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"
Sep 17 14:03:59.192517 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:59.192443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv"]
Sep 17 14:03:59.195451 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:03:59.195424    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5a3bd70_81f2_4f1b_9e15_2ba35bdd1425.slice/crio-1a286c2fbc342124f33f5cecc005ae0148b6bf99a97f643cb2cc3539a59e6fd3 WatchSource:0}: Error finding container 1a286c2fbc342124f33f5cecc005ae0148b6bf99a97f643cb2cc3539a59e6fd3: Status 404 returned error can't find the container with id 1a286c2fbc342124f33f5cecc005ae0148b6bf99a97f643cb2cc3539a59e6fd3
Sep 17 14:03:59.197431 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:59.197413    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:03:59.497499 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:03:59.497425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv" event={"ID":"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425","Type":"ContainerStarted","Data":"1a286c2fbc342124f33f5cecc005ae0148b6bf99a97f643cb2cc3539a59e6fd3"}
Sep 17 14:04:02.512211 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:02.512178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv" event={"ID":"b5a3bd70-81f2-4f1b-9e15-2ba35bdd1425","Type":"ContainerStarted","Data":"c981847b86a32ab9e2f454ebcb90179ae00983617970fbfdf15bc5023b42e439"}
Sep 17 14:04:02.531587 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:02.531543    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6vxv" podStartSLOduration=1.6603226370000002 podStartE2EDuration="4.531528132s" totalImagesPullingTime="2.871205495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:04:02.529488055 +0000 UTC m=+488.303255723" watchObservedRunningTime="2026-09-17 14:04:02.531528132 +0000 UTC m=+488.305295802"
Sep 17 14:04:32.094409 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.094377    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"]
Sep 17 14:04:32.099659 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.099642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.102692 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.102670    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gp7tv\""
Sep 17 14:04:32.102928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.102913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 14:04:32.103169 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.103155    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 14:04:32.103526 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.103512    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 14:04:32.104999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.104980    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 14:04:32.115377 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.115356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"]
Sep 17 14:04:32.159422 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.159396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.159528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.159433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-manifests\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.159528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.159498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-tmp\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.159528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.159521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.159653 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.159597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw88g\" (UniqueName: \"kubernetes.io/projected/04f5ed79-bf6e-4410-a000-d3840faefd1e-kube-api-access-vw88g\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260351 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-tmp\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260465 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260465 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw88g\" (UniqueName: \"kubernetes.io/projected/04f5ed79-bf6e-4410-a000-d3840faefd1e-kube-api-access-vw88g\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-manifests\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.260880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.260860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-manifests\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.262656 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.262633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f5ed79-bf6e-4410-a000-d3840faefd1e-tmp\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.262828 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.262810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.262910 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.262892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f5ed79-bf6e-4410-a000-d3840faefd1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.268499 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.268480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw88g\" (UniqueName: \"kubernetes.io/projected/04f5ed79-bf6e-4410-a000-d3840faefd1e-kube-api-access-vw88g\") pod \"opendatahub-operator-controller-manager-fcc687555-9nl87\" (UID: \"04f5ed79-bf6e-4410-a000-d3840faefd1e\") " pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.409525 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.409470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:32.687062 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:32.686967    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"]
Sep 17 14:04:32.691578 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:04:32.691550    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f5ed79_bf6e_4410_a000_d3840faefd1e.slice/crio-2864b2d63a9374b5ea353eaedbfcd91f528599b509ee5006433a7be0bad69a11 WatchSource:0}: Error finding container 2864b2d63a9374b5ea353eaedbfcd91f528599b509ee5006433a7be0bad69a11: Status 404 returned error can't find the container with id 2864b2d63a9374b5ea353eaedbfcd91f528599b509ee5006433a7be0bad69a11
Sep 17 14:04:33.628796 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:33.628751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87" event={"ID":"04f5ed79-bf6e-4410-a000-d3840faefd1e","Type":"ContainerStarted","Data":"2864b2d63a9374b5ea353eaedbfcd91f528599b509ee5006433a7be0bad69a11"}
Sep 17 14:04:36.643580 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:36.643542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87" event={"ID":"04f5ed79-bf6e-4410-a000-d3840faefd1e","Type":"ContainerStarted","Data":"e8dbbdd79440317f4d0731323532510b16c6964c6a2322a56421987c68696579"}
Sep 17 14:04:37.649551 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:37.649520    2579 generic.go:356] "Generic (PLEG): container finished" podID="04f5ed79-bf6e-4410-a000-d3840faefd1e" containerID="e8dbbdd79440317f4d0731323532510b16c6964c6a2322a56421987c68696579" exitCode=0
Sep 17 14:04:37.649922 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:37.649606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87" event={"ID":"04f5ed79-bf6e-4410-a000-d3840faefd1e","Type":"ContainerDied","Data":"e8dbbdd79440317f4d0731323532510b16c6964c6a2322a56421987c68696579"}
Sep 17 14:04:38.655780 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:38.655746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87" event={"ID":"04f5ed79-bf6e-4410-a000-d3840faefd1e","Type":"ContainerStarted","Data":"18837f28faca2163cffa4e57bfaa9db32ebb0ae68ec763c701e51e3167300d7f"}
Sep 17 14:04:38.656198 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:38.655983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:04:38.679348 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:38.679294    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87" podStartSLOduration=1.806654327 podStartE2EDuration="6.679279784s" totalImagesPullingTime="3.80060162s" totalInitContainerRuntime="1.072023837s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:04:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:04:38.677721486 +0000 UTC m=+524.451489185" watchObservedRunningTime="2026-09-17 14:04:38.679279784 +0000 UTC m=+524.453047454"
Sep 17 14:04:49.662191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:04:49.662100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fcc687555-9nl87"
Sep 17 14:05:09.160597 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.160565    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"]
Sep 17 14:05:09.242564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.242534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"]
Sep 17 14:05:09.242706 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.242622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.245366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 14:05:09.245494 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 14:05:09.245652 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 14:05:09.245724 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245662    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-58db9\""
Sep 17 14:05:09.245724 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245710    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 14:05:09.245967 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.245950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 14:05:09.246092 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.246074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 14:05:09.326061 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c755s\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-kube-api-access-c755s\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326199 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326199 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326199 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326199 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326367 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.326367 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.326254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427256 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c755s\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-kube-api-access-c755s\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427256 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427390 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427390 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427471 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427471 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.427543 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.427475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.428120 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.428098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.429524 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.429505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.429730 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.429701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.430016 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.429997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.430084 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.429997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.439530 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.439507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c755s\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-kube-api-access-c755s\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.448161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.448140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gq57h\" (UID: \"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.554551 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.554512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:09.859123 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:09.859092    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"]
Sep 17 14:05:09.864284 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:05:09.864235    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b7ee79_a1a6_4b43_b1dc_793db1eacf4f.slice/crio-f5525fd58b2fa9ad976b6483625e1c8e550b83c954803de145013c7a20666583 WatchSource:0}: Error finding container f5525fd58b2fa9ad976b6483625e1c8e550b83c954803de145013c7a20666583: Status 404 returned error can't find the container with id f5525fd58b2fa9ad976b6483625e1c8e550b83c954803de145013c7a20666583
Sep 17 14:05:10.745817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.745681    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"]
Sep 17 14:05:10.748387 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.748362    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.751886 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.751862    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 14:05:10.752688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.752498    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 14:05:10.752688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.752536    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 14:05:10.752688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.752550    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vqbp7\""
Sep 17 14:05:10.752688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.752497    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 14:05:10.752980 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.752850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:05:10.770965 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.770944    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"]
Sep 17 14:05:10.782973 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.782945    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h" event={"ID":"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f","Type":"ContainerStarted","Data":"f5525fd58b2fa9ad976b6483625e1c8e550b83c954803de145013c7a20666583"}
Sep 17 14:05:10.839224 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.839189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8qh\" (UniqueName: \"kubernetes.io/projected/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-kube-api-access-pt8qh\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.839369 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.839230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-metrics-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.839437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.839408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.839723 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.839699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-manager-config\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.940282 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.940249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-manager-config\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.940450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.940311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8qh\" (UniqueName: \"kubernetes.io/projected/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-kube-api-access-pt8qh\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.940450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.940339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-metrics-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.940450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.940381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.941093 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.941021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-manager-config\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.943238 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.943214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.943463 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.943436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-metrics-cert\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:10.956118 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:10.956087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8qh\" (UniqueName: \"kubernetes.io/projected/198fe2e8-25a3-4ff4-a264-c6b2acbe17b0-kube-api-access-pt8qh\") pod \"lws-controller-manager-69b649694d-znxzk\" (UID: \"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0\") " pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:11.060773 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:11.060616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:11.373625 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:11.373600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"]
Sep 17 14:05:12.224189 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:05:12.224149    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198fe2e8_25a3_4ff4_a264_c6b2acbe17b0.slice/crio-92e4215e3e9315a4fed71e1e28c4f6cc97064f926cd552ce66f1ca778568e5c7 WatchSource:0}: Error finding container 92e4215e3e9315a4fed71e1e28c4f6cc97064f926cd552ce66f1ca778568e5c7: Status 404 returned error can't find the container with id 92e4215e3e9315a4fed71e1e28c4f6cc97064f926cd552ce66f1ca778568e5c7
Sep 17 14:05:12.267885 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.267845    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 14:05:12.267971 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.267917    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 14:05:12.808563 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.808468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk" event={"ID":"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0","Type":"ContainerStarted","Data":"92e4215e3e9315a4fed71e1e28c4f6cc97064f926cd552ce66f1ca778568e5c7"}
Sep 17 14:05:12.813596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.812737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h" event={"ID":"e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f","Type":"ContainerStarted","Data":"c606844388e0d1aee8d350876fb340f4135d076e59fbfbfbdb05f8840c966d7f"}
Sep 17 14:05:12.813596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.813532    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:12.850859 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:12.850601    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h" podStartSLOduration=1.448637669 podStartE2EDuration="3.850581189s" totalImagesPullingTime="2.40194352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:12.847699385 +0000 UTC m=+558.621467050" watchObservedRunningTime="2026-09-17 14:05:12.850581189 +0000 UTC m=+558.624348864"
Sep 17 14:05:13.820186 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:13.820151    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h"
Sep 17 14:05:14.822939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:14.822857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk" event={"ID":"198fe2e8-25a3-4ff4-a264-c6b2acbe17b0","Type":"ContainerStarted","Data":"780fa659345e6792a206fff14e6911832edc8c9d5554cc4d95f51991da215355"}
Sep 17 14:05:14.822939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:14.822929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:14.846091 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:14.846030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk" podStartSLOduration=2.593079811 podStartE2EDuration="4.846016725s" totalImagesPullingTime="2.252936914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:14.844086776 +0000 UTC m=+560.617854454" watchObservedRunningTime="2026-09-17 14:05:14.846016725 +0000 UTC m=+560.619784389"
Sep 17 14:05:25.828563 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:25.828531    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69b649694d-znxzk"
Sep 17 14:05:54.635029 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:54.635004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:05:54.635615 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:05:54.635596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:07:20.741853 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.741819    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:20.744312 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.744296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.746437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.746409    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 14:07:20.746575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.746463    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mjrpk\""
Sep 17 14:07:20.746575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.746486    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 14:07:20.747093 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.747077    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 14:07:20.755836 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.755817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:20.834222 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.834188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:20.858992 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.858966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvsjc\" (UniqueName: \"kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.859141 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.859004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.959556 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.959526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvsjc\" (UniqueName: \"kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.959700 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.959565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.960177 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.960157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:20.967469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:20.967448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvsjc\" (UniqueName: \"kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc\") pod \"limitador-limitador-8588749977-fj8wt\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") " pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:21.054054 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:21.053991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:21.330515 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:21.330441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:21.333364 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:07:21.333339    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c664e0_7c1d_4bc9_acf8_144448b7100e.slice/crio-c73698065268388debab86da7f0cd2250d8cc52c0a4a795153dff29a31d5b508 WatchSource:0}: Error finding container c73698065268388debab86da7f0cd2250d8cc52c0a4a795153dff29a31d5b508: Status 404 returned error can't find the container with id c73698065268388debab86da7f0cd2250d8cc52c0a4a795153dff29a31d5b508
Sep 17 14:07:22.330369 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:22.330334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" event={"ID":"43c664e0-7c1d-4bc9-acf8-144448b7100e","Type":"ContainerStarted","Data":"c73698065268388debab86da7f0cd2250d8cc52c0a4a795153dff29a31d5b508"}
Sep 17 14:07:25.346306 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:25.346265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" event={"ID":"43c664e0-7c1d-4bc9-acf8-144448b7100e","Type":"ContainerStarted","Data":"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"}
Sep 17 14:07:25.346662 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:25.346381    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:25.365611 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:25.365550    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" podStartSLOduration=1.946417865 podStartE2EDuration="5.365537251s" totalImagesPullingTime="3.419119386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:25.364084044 +0000 UTC m=+691.137851715" watchObservedRunningTime="2026-09-17 14:07:25.365537251 +0000 UTC m=+691.139304920"
Sep 17 14:07:35.837056 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:35.837011    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:35.837428 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:35.837222    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" podUID="43c664e0-7c1d-4bc9-acf8-144448b7100e" containerName="limitador" containerID="cri-o://4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c" gracePeriod=30
Sep 17 14:07:35.837864 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:35.837757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:36.180418 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:07:36.180388    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c664e0_7c1d_4bc9_acf8_144448b7100e.slice/crio-conmon-4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c.scope\": RecentStats: unable to find data in memory cache]"
Sep 17 14:07:36.383521 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.383498    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:36.391655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.391629    2579 generic.go:356] "Generic (PLEG): container finished" podID="43c664e0-7c1d-4bc9-acf8-144448b7100e" containerID="4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c" exitCode=0
Sep 17 14:07:36.391763 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.391667    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt"
Sep 17 14:07:36.391763 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.391696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" event={"ID":"43c664e0-7c1d-4bc9-acf8-144448b7100e","Type":"ContainerDied","Data":"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"}
Sep 17 14:07:36.391763 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.391742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fj8wt" event={"ID":"43c664e0-7c1d-4bc9-acf8-144448b7100e","Type":"ContainerDied","Data":"c73698065268388debab86da7f0cd2250d8cc52c0a4a795153dff29a31d5b508"}
Sep 17 14:07:36.391883 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.391772    2579 scope.go:117] "RemoveContainer" containerID="4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"
Sep 17 14:07:36.399225 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.399208    2579 scope.go:117] "RemoveContainer" containerID="4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"
Sep 17 14:07:36.399507 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:07:36.399489    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c\": container with ID starting with 4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c not found: ID does not exist" containerID="4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"
Sep 17 14:07:36.399554 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.399517    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c"} err="failed to get container status \"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c\": rpc error: code = NotFound desc = could not find container \"4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c\": container with ID starting with 4b506a93d3a34de592472f93a52615656e0118dd6e161828c024a358b9332f4c not found: ID does not exist"
Sep 17 14:07:36.479370 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.479346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file\") pod \"43c664e0-7c1d-4bc9-acf8-144448b7100e\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") "
Sep 17 14:07:36.479468 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.479433    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvsjc\" (UniqueName: \"kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc\") pod \"43c664e0-7c1d-4bc9-acf8-144448b7100e\" (UID: \"43c664e0-7c1d-4bc9-acf8-144448b7100e\") "
Sep 17 14:07:36.479656 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.479635    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file" (OuterVolumeSpecName: "config-file") pod "43c664e0-7c1d-4bc9-acf8-144448b7100e" (UID: "43c664e0-7c1d-4bc9-acf8-144448b7100e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:07:36.481522 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.481498    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc" (OuterVolumeSpecName: "kube-api-access-zvsjc") pod "43c664e0-7c1d-4bc9-acf8-144448b7100e" (UID: "43c664e0-7c1d-4bc9-acf8-144448b7100e"). InnerVolumeSpecName "kube-api-access-zvsjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:07:36.580929 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.580896    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvsjc\" (UniqueName: \"kubernetes.io/projected/43c664e0-7c1d-4bc9-acf8-144448b7100e-kube-api-access-zvsjc\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:07:36.580929 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.580927    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/43c664e0-7c1d-4bc9-acf8-144448b7100e-config-file\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:07:36.716139 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.716111    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:36.720088 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:36.720063    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fj8wt"]
Sep 17 14:07:38.702180 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:38.700372    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c664e0-7c1d-4bc9-acf8-144448b7100e" path="/var/lib/kubelet/pods/43c664e0-7c1d-4bc9-acf8-144448b7100e/volumes"
Sep 17 14:07:42.458733 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.458702    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"]
Sep 17 14:07:42.459151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.459061    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c664e0-7c1d-4bc9-acf8-144448b7100e" containerName="limitador"
Sep 17 14:07:42.459151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.459075    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c664e0-7c1d-4bc9-acf8-144448b7100e" containerName="limitador"
Sep 17 14:07:42.459151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.459124    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c664e0-7c1d-4bc9-acf8-144448b7100e" containerName="limitador"
Sep 17 14:07:42.489142 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.489113    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"]
Sep 17 14:07:42.489274 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.489201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.491353 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.491320    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 14:07:42.491475 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.491445    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 14:07:42.491907 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.491888    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6ttvx\""
Sep 17 14:07:42.491999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.491890    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 14:07:42.525653 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.525630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b661136-b4b2-42a0-8347-f3e2f176ba26-data\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.525778 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.525705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhzf\" (UniqueName: \"kubernetes.io/projected/8b661136-b4b2-42a0-8347-f3e2f176ba26-kube-api-access-9qhzf\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.626662 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.626624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhzf\" (UniqueName: \"kubernetes.io/projected/8b661136-b4b2-42a0-8347-f3e2f176ba26-kube-api-access-9qhzf\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.626785 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.626676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b661136-b4b2-42a0-8347-f3e2f176ba26-data\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.627032 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.627014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b661136-b4b2-42a0-8347-f3e2f176ba26-data\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.634812 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.634783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhzf\" (UniqueName: \"kubernetes.io/projected/8b661136-b4b2-42a0-8347-f3e2f176ba26-kube-api-access-9qhzf\") pod \"postgres-69fb4594cf-ppcgx\" (UID: \"8b661136-b4b2-42a0-8347-f3e2f176ba26\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:42.799186 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:42.799129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:43.069779 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:43.069744    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"]
Sep 17 14:07:43.072411 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:07:43.072383    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b661136_b4b2_42a0_8347_f3e2f176ba26.slice/crio-1f9c070d9fbaba05b4381f518cdb6286e5005a15ae95a07ec3a4456361a9867a WatchSource:0}: Error finding container 1f9c070d9fbaba05b4381f518cdb6286e5005a15ae95a07ec3a4456361a9867a: Status 404 returned error can't find the container with id 1f9c070d9fbaba05b4381f518cdb6286e5005a15ae95a07ec3a4456361a9867a
Sep 17 14:07:43.420842 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:43.420808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx" event={"ID":"8b661136-b4b2-42a0-8347-f3e2f176ba26","Type":"ContainerStarted","Data":"1f9c070d9fbaba05b4381f518cdb6286e5005a15ae95a07ec3a4456361a9867a"}
Sep 17 14:07:48.445505 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:48.445468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx" event={"ID":"8b661136-b4b2-42a0-8347-f3e2f176ba26","Type":"ContainerStarted","Data":"8a6452b8f10a0b23cd50b4cae45646b9ad0489ce47be05ee6169274905353b7e"}
Sep 17 14:07:48.445910 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:48.445631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:07:48.462955 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:48.462901    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx" podStartSLOduration=1.9718753470000001 podStartE2EDuration="6.462883646s" totalImagesPullingTime="4.491008299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:48.462368078 +0000 UTC m=+714.236135807" watchObservedRunningTime="2026-09-17 14:07:48.462883646 +0000 UTC m=+714.236651318"
Sep 17 14:07:54.480197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:07:54.480158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ppcgx"
Sep 17 14:08:01.942056 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.942019    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:01.945761 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.945741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:01.947906 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.947878    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 14:08:01.947906 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.947892    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 14:08:01.948089 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.947940    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r2wnh\""
Sep 17 14:08:01.948516 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.948498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 14:08:01.956118 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.956081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:01.975273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.975252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:01.975407 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.975302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:01.975407 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:01.975372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpkk\" (UniqueName: \"kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.076227 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.076192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpkk\" (UniqueName: \"kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.076355 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.076296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.076355 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.076332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.076472 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:08:02.076428    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 17 14:08:02.076527 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:08:02.076513    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert podName:a05091e2-8abd-437d-8b46-4814e30938e9 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:02.576497221 +0000 UTC m=+728.350264874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert") pod "maas-controller-64b76cd4dc-6wgx7" (UID: "a05091e2-8abd-437d-8b46-4814e30938e9") : secret "maas-controller-webhook-cert" not found
Sep 17 14:08:02.078804 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.078785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.087528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.087502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpkk\" (UniqueName: \"kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.094089 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.094067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:08:02.096505 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.096487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.110718 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.110697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:08:02.177560 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.177532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.177666 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.177580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bh4s\" (UniqueName: \"kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.177666 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.177624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.278912 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.278854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.278994 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.278911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.278994 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.278965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bh4s\" (UniqueName: \"kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.281238 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.281208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.281318 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.281273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.286828 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.286808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bh4s\" (UniqueName: \"kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s\") pod \"maas-controller-68fd759d84-rwqz9\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") " pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.405967 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.405938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:02.581839 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.581764    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.584058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.584021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") pod \"maas-controller-64b76cd4dc-6wgx7\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") " pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:02.676807 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.676786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:08:02.679086 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:08:02.679061    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a4aa6a_c7f9_4668_b722_410f64b90d4a.slice/crio-37418d4130c0c1d930d03b1652cec2dd6772a5ddb3a2e1d6ac0eaa7d5b2ac0f8 WatchSource:0}: Error finding container 37418d4130c0c1d930d03b1652cec2dd6772a5ddb3a2e1d6ac0eaa7d5b2ac0f8: Status 404 returned error can't find the container with id 37418d4130c0c1d930d03b1652cec2dd6772a5ddb3a2e1d6ac0eaa7d5b2ac0f8
Sep 17 14:08:02.857124 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:02.857101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:03.128638 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:03.128575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:03.131596 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:08:03.131569    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05091e2_8abd_437d_8b46_4814e30938e9.slice/crio-106ac874a95b08cbdea06822426da041b07b7f7319355dc2ac26aabfbb6ba009 WatchSource:0}: Error finding container 106ac874a95b08cbdea06822426da041b07b7f7319355dc2ac26aabfbb6ba009: Status 404 returned error can't find the container with id 106ac874a95b08cbdea06822426da041b07b7f7319355dc2ac26aabfbb6ba009
Sep 17 14:08:03.511070 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:03.510975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" event={"ID":"a05091e2-8abd-437d-8b46-4814e30938e9","Type":"ContainerStarted","Data":"106ac874a95b08cbdea06822426da041b07b7f7319355dc2ac26aabfbb6ba009"}
Sep 17 14:08:03.512440 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:03.512409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-rwqz9" event={"ID":"a3a4aa6a-c7f9-4668-b722-410f64b90d4a","Type":"ContainerStarted","Data":"37418d4130c0c1d930d03b1652cec2dd6772a5ddb3a2e1d6ac0eaa7d5b2ac0f8"}
Sep 17 14:08:05.523883 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.523841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" event={"ID":"a05091e2-8abd-437d-8b46-4814e30938e9","Type":"ContainerStarted","Data":"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"}
Sep 17 14:08:05.524388 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.523916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:05.525541 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.525513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-rwqz9" event={"ID":"a3a4aa6a-c7f9-4668-b722-410f64b90d4a","Type":"ContainerStarted","Data":"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"}
Sep 17 14:08:05.525661 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.525569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:05.544419 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.544358    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" podStartSLOduration=2.645429572 podStartE2EDuration="4.544338529s" totalImagesPullingTime="1.898908957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:05.541762585 +0000 UTC m=+731.315530254" watchObservedRunningTime="2026-09-17 14:08:05.544338529 +0000 UTC m=+731.318106200"
Sep 17 14:08:05.565606 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:05.565557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68fd759d84-rwqz9" podStartSLOduration=1.2143313789999999 podStartE2EDuration="3.56554471s" totalImagesPullingTime="2.351213331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:05.564552605 +0000 UTC m=+731.338320275" watchObservedRunningTime="2026-09-17 14:08:05.56554471 +0000 UTC m=+731.339312381"
Sep 17 14:08:16.532408 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.532366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:16.532782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.532440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:08:16.602301 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.602269    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:16.602468 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.602447    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" podUID="a05091e2-8abd-437d-8b46-4814e30938e9" containerName="manager" containerID="cri-o://2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3" gracePeriod=30
Sep 17 14:08:16.842348 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.842327    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:16.909354 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.909326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbpkk\" (UniqueName: \"kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk\") pod \"a05091e2-8abd-437d-8b46-4814e30938e9\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") "
Sep 17 14:08:16.909489 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.909366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs\") pod \"a05091e2-8abd-437d-8b46-4814e30938e9\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") "
Sep 17 14:08:16.909489 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.909411    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") pod \"a05091e2-8abd-437d-8b46-4814e30938e9\" (UID: \"a05091e2-8abd-437d-8b46-4814e30938e9\") "
Sep 17 14:08:16.911550 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.911521    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a05091e2-8abd-437d-8b46-4814e30938e9" (UID: "a05091e2-8abd-437d-8b46-4814e30938e9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:08:16.911659 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.911565    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a05091e2-8abd-437d-8b46-4814e30938e9" (UID: "a05091e2-8abd-437d-8b46-4814e30938e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:08:16.911659 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:16.911605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk" (OuterVolumeSpecName: "kube-api-access-fbpkk") pod "a05091e2-8abd-437d-8b46-4814e30938e9" (UID: "a05091e2-8abd-437d-8b46-4814e30938e9"). InnerVolumeSpecName "kube-api-access-fbpkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:08:17.010742 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.010712    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-webhook-cert\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:08:17.010742 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.010736    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbpkk\" (UniqueName: \"kubernetes.io/projected/a05091e2-8abd-437d-8b46-4814e30938e9-kube-api-access-fbpkk\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:08:17.010742 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.010746    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a05091e2-8abd-437d-8b46-4814e30938e9-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:08:17.577688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.577651    2579 generic.go:356] "Generic (PLEG): container finished" podID="a05091e2-8abd-437d-8b46-4814e30938e9" containerID="2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3" exitCode=0
Sep 17 14:08:17.578173 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.577695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7"
Sep 17 14:08:17.578173 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.577696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" event={"ID":"a05091e2-8abd-437d-8b46-4814e30938e9","Type":"ContainerDied","Data":"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"}
Sep 17 14:08:17.578173 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.577819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64b76cd4dc-6wgx7" event={"ID":"a05091e2-8abd-437d-8b46-4814e30938e9","Type":"ContainerDied","Data":"106ac874a95b08cbdea06822426da041b07b7f7319355dc2ac26aabfbb6ba009"}
Sep 17 14:08:17.578173 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.577847    2579 scope.go:117] "RemoveContainer" containerID="2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"
Sep 17 14:08:17.586619 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.586601    2579 scope.go:117] "RemoveContainer" containerID="2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"
Sep 17 14:08:17.586870 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:08:17.586852    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3\": container with ID starting with 2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3 not found: ID does not exist" containerID="2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"
Sep 17 14:08:17.586917 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.586880    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3"} err="failed to get container status \"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3\": rpc error: code = NotFound desc = could not find container \"2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3\": container with ID starting with 2a732702c26dc0d2bc7035164c4d5f1b181ee2fa47d832ee243518eaa77acbf3 not found: ID does not exist"
Sep 17 14:08:17.598051 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.598014    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:17.604811 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:17.604789    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64b76cd4dc-6wgx7"]
Sep 17 14:08:18.698457 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:18.698422    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05091e2-8abd-437d-8b46-4814e30938e9" path="/var/lib/kubelet/pods/a05091e2-8abd-437d-8b46-4814e30938e9/volumes"
Sep 17 14:08:38.598111 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.598077    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:08:38.598644 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.598514    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05091e2-8abd-437d-8b46-4814e30938e9" containerName="manager"
Sep 17 14:08:38.598644 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.598534    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05091e2-8abd-437d-8b46-4814e30938e9" containerName="manager"
Sep 17 14:08:38.598644 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.598628    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05091e2-8abd-437d-8b46-4814e30938e9" containerName="manager"
Sep 17 14:08:38.606250 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.606228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.609254 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.609226    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 14:08:38.609367 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.609233    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4j8k\""
Sep 17 14:08:38.609367 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.609293    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 14:08:38.616261 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.616236    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:08:38.776960 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.776914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.777167 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.776990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.777167 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.777035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.777167 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.777118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5v4n\" (UniqueName: \"kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.878011 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.877936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.878011 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.877972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.878203 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.878101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.878203 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.878156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5v4n\" (UniqueName: \"kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.878721 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.878696    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.880528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.880507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.880635 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.880615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.886034 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.886012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5v4n\" (UniqueName: \"kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n\") pod \"maas-api-5f544fdfdc-txf2q\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") " pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:38.917633 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:38.917606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:39.196231 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.196156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:08:39.199814 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:08:39.199784    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf34504_9f29_46ab_973a_a1e5c62461c7.slice/crio-2d819ba3127f6e0753d3c7af3828f171353cb8962d37a8f4404b300fd0d4f743 WatchSource:0}: Error finding container 2d819ba3127f6e0753d3c7af3828f171353cb8962d37a8f4404b300fd0d4f743: Status 404 returned error can't find the container with id 2d819ba3127f6e0753d3c7af3828f171353cb8962d37a8f4404b300fd0d4f743
Sep 17 14:08:39.229349 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.229322    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"]
Sep 17 14:08:39.232335 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.232319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.235338 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.235314    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-48d54\""
Sep 17 14:08:39.235563 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.235546    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 14:08:39.245240 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.245219    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"]
Sep 17 14:08:39.311430 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.311397    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"]
Sep 17 14:08:39.313746 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.313727    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.326423 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.326399    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"]
Sep 17 14:08:39.381874 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.381844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3273d9cd-e05a-41e8-a0a7-fbc69858b950-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.382003 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.381882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6tgh\" (UniqueName: \"kubernetes.io/projected/3273d9cd-e05a-41e8-a0a7-fbc69858b950-kube-api-access-m6tgh\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.482655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.482581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3273d9cd-e05a-41e8-a0a7-fbc69858b950-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.482655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.482613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6tgh\" (UniqueName: \"kubernetes.io/projected/3273d9cd-e05a-41e8-a0a7-fbc69858b950-kube-api-access-m6tgh\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.482655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.482634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvft\" (UniqueName: \"kubernetes.io/projected/78d59da8-cc07-424b-8dba-d2670c520f04-kube-api-access-ssvft\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.482925 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.482705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78d59da8-cc07-424b-8dba-d2670c520f04-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.483262 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.483243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3273d9cd-e05a-41e8-a0a7-fbc69858b950-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.492478 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.492458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6tgh\" (UniqueName: \"kubernetes.io/projected/3273d9cd-e05a-41e8-a0a7-fbc69858b950-kube-api-access-m6tgh\") pod \"payload-processing-5b54b7fbb7-nc6v5\" (UID: \"3273d9cd-e05a-41e8-a0a7-fbc69858b950\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.542331 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.542301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:39.584133 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.584100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78d59da8-cc07-424b-8dba-d2670c520f04-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.584267 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.584169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvft\" (UniqueName: \"kubernetes.io/projected/78d59da8-cc07-424b-8dba-d2670c520f04-kube-api-access-ssvft\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.584761 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.584740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78d59da8-cc07-424b-8dba-d2670c520f04-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.593180 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.593128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvft\" (UniqueName: \"kubernetes.io/projected/78d59da8-cc07-424b-8dba-d2670c520f04-kube-api-access-ssvft\") pod \"payload-pre-processing-59fbc47bf8-dtxcn\" (UID: \"78d59da8-cc07-424b-8dba-d2670c520f04\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.622803 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.622780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:39.682400 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.682368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" event={"ID":"4cf34504-9f29-46ab-973a-a1e5c62461c7","Type":"ContainerStarted","Data":"2d819ba3127f6e0753d3c7af3828f171353cb8962d37a8f4404b300fd0d4f743"}
Sep 17 14:08:39.812398 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.812371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"]
Sep 17 14:08:39.814802 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:08:39.814777    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3273d9cd_e05a_41e8_a0a7_fbc69858b950.slice/crio-77b51186cea2267e87326dd9b5c145c40ab3e93dddb37cf4efb181ae5463273a WatchSource:0}: Error finding container 77b51186cea2267e87326dd9b5c145c40ab3e93dddb37cf4efb181ae5463273a: Status 404 returned error can't find the container with id 77b51186cea2267e87326dd9b5c145c40ab3e93dddb37cf4efb181ae5463273a
Sep 17 14:08:39.894349 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:39.894321    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"]
Sep 17 14:08:39.897860 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:08:39.897831    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d59da8_cc07_424b_8dba_d2670c520f04.slice/crio-16337ec6dcabb49b801ae209f92696549e447b8b00f6f2400a6e51f719fc58f5 WatchSource:0}: Error finding container 16337ec6dcabb49b801ae209f92696549e447b8b00f6f2400a6e51f719fc58f5: Status 404 returned error can't find the container with id 16337ec6dcabb49b801ae209f92696549e447b8b00f6f2400a6e51f719fc58f5
Sep 17 14:08:40.687286 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:40.687252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn" event={"ID":"78d59da8-cc07-424b-8dba-d2670c520f04","Type":"ContainerStarted","Data":"16337ec6dcabb49b801ae209f92696549e447b8b00f6f2400a6e51f719fc58f5"}
Sep 17 14:08:40.688453 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:40.688419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5" event={"ID":"3273d9cd-e05a-41e8-a0a7-fbc69858b950","Type":"ContainerStarted","Data":"77b51186cea2267e87326dd9b5c145c40ab3e93dddb37cf4efb181ae5463273a"}
Sep 17 14:08:42.699440 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.699398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" event={"ID":"4cf34504-9f29-46ab-973a-a1e5c62461c7","Type":"ContainerStarted","Data":"81aa163963c3e7a88ee05e5ecd6aa77316595510e9e9ee362c8904c394536649"}
Sep 17 14:08:42.699823 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.699512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:42.701106 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.701078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn" event={"ID":"78d59da8-cc07-424b-8dba-d2670c520f04","Type":"ContainerStarted","Data":"685ddc6ad26fe2a0da317fa664d30de499882b7c901734a0e30319275175d4b6"}
Sep 17 14:08:42.701241 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.701133    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:08:42.702646 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.702626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5" event={"ID":"3273d9cd-e05a-41e8-a0a7-fbc69858b950","Type":"ContainerStarted","Data":"6c5461c09d4e8aad9409d7470418d0fad87a5f5399207aada4e9aa9051bbd714"}
Sep 17 14:08:42.702843 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.702747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:42.719814 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.719771    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" podStartSLOduration=1.90126251 podStartE2EDuration="4.719757769s" totalImagesPullingTime="2.818495259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:42.718255024 +0000 UTC m=+768.492022693" watchObservedRunningTime="2026-09-17 14:08:42.719757769 +0000 UTC m=+768.493525438"
Sep 17 14:08:42.735409 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:42.735367    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5" podStartSLOduration=0.935735069 podStartE2EDuration="3.735352868s" totalImagesPullingTime="2.799617799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:42.734195999 +0000 UTC m=+768.507963670" watchObservedRunningTime="2026-09-17 14:08:42.735352868 +0000 UTC m=+768.509120566"
Sep 17 14:08:48.712946 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:48.712915    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:08:48.731763 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:48.731713    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn" podStartSLOduration=7.609662882 podStartE2EDuration="9.73169224s" totalImagesPullingTime="2.122029358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:42.751113937 +0000 UTC m=+768.524881607" watchObservedRunningTime="2026-09-17 14:08:48.73169224 +0000 UTC m=+774.505459914"
Sep 17 14:08:53.709839 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:53.709803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nc6v5"
Sep 17 14:08:53.710332 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:08:53.709893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn"
Sep 17 14:09:29.312143 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.312059    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"]
Sep 17 14:09:29.314848 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.314828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.317642 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.317614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 14:09:29.317752 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.317677    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 14:09:29.317752 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.317615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 14:09:29.317977 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.317954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-98swh\""
Sep 17 14:09:29.326591 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.326571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"]
Sep 17 14:09:29.504126 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.504126 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.504337 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.504337 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28scs\" (UniqueName: \"kubernetes.io/projected/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-kube-api-access-28scs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.504337 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.504337 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.504305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.604974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605225 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28scs\" (UniqueName: \"kubernetes.io/projected/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-kube-api-access-28scs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605225 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605225 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605389 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605389 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605537 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605664 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.605720 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.605699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.607331 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.607310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.607725 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.607703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.613556 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.613537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28scs\" (UniqueName: \"kubernetes.io/projected/2c80e2b0-98e0-4182-ae28-5a7caf7b65fc-kube-api-access-28scs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jhl9r\" (UID: \"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.625617 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.625595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:29.899144 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.898974    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"]
Sep 17 14:09:29.901297 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:09:29.901268    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c80e2b0_98e0_4182_ae28_5a7caf7b65fc.slice/crio-e3dfb617d6821c2b1dff09e1fb35a7b75246017d30069356b9bcc8c46a37a0a5 WatchSource:0}: Error finding container e3dfb617d6821c2b1dff09e1fb35a7b75246017d30069356b9bcc8c46a37a0a5: Status 404 returned error can't find the container with id e3dfb617d6821c2b1dff09e1fb35a7b75246017d30069356b9bcc8c46a37a0a5
Sep 17 14:09:29.902553 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:29.902537    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:09:30.902390 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:30.902359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r" event={"ID":"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc","Type":"ContainerStarted","Data":"e3dfb617d6821c2b1dff09e1fb35a7b75246017d30069356b9bcc8c46a37a0a5"}
Sep 17 14:09:31.908659 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:31.908624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r" event={"ID":"2c80e2b0-98e0-4182-ae28-5a7caf7b65fc","Type":"ContainerStarted","Data":"bf50e30f654d2dd8fbe7769d251d3dfc9ffdbf7dd0c5afedf62b70616752b075"}
Sep 17 14:09:31.930257 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:31.930204    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r" podStartSLOduration=1.956485545 podStartE2EDuration="2.930188695s" totalImagesPullingTime="973.70315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:31.928793332 +0000 UTC m=+817.702561003" watchObservedRunningTime="2026-09-17 14:09:31.930188695 +0000 UTC m=+817.703956365"
Sep 17 14:09:37.401473 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.401442    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"]
Sep 17 14:09:37.404853 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.404830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.407022 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.407000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 17 14:09:37.420938 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.420913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"]
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsnp\" (UniqueName: \"kubernetes.io/projected/a7212164-71f3-4a92-b9a2-573f33d9f6d2-kube-api-access-wvsnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.470667 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.466632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567611 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567611 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567867 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567867 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567867 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.567867 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.567743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvsnp\" (UniqueName: \"kubernetes.io/projected/a7212164-71f3-4a92-b9a2-573f33d9f6d2-kube-api-access-wvsnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.568119 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.568091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.568168 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.568133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.568226 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.568205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.569987 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.569950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7212164-71f3-4a92-b9a2-573f33d9f6d2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.570179 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.570159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7212164-71f3-4a92-b9a2-573f33d9f6d2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.575419 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.575397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvsnp\" (UniqueName: \"kubernetes.io/projected/a7212164-71f3-4a92-b9a2-573f33d9f6d2-kube-api-access-wvsnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv\" (UID: \"a7212164-71f3-4a92-b9a2-573f33d9f6d2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.715810 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.715723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:37.985894 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:37.985873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"]
Sep 17 14:09:37.988489 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:09:37.988457    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7212164_71f3_4a92_b9a2_573f33d9f6d2.slice/crio-ddb363009ac20cddfd6f21f8c609023f7e51f465d57773c69d6d188840d48ec9 WatchSource:0}: Error finding container ddb363009ac20cddfd6f21f8c609023f7e51f465d57773c69d6d188840d48ec9: Status 404 returned error can't find the container with id ddb363009ac20cddfd6f21f8c609023f7e51f465d57773c69d6d188840d48ec9
Sep 17 14:09:38.941702 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:38.941672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv" event={"ID":"a7212164-71f3-4a92-b9a2-573f33d9f6d2","Type":"ContainerStarted","Data":"733421d50e9c7b0c84594089cb207826641cfec3f4468d574d7bf6d66e117ab2"}
Sep 17 14:09:38.942087 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:38.941727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv" event={"ID":"a7212164-71f3-4a92-b9a2-573f33d9f6d2","Type":"ContainerStarted","Data":"ddb363009ac20cddfd6f21f8c609023f7e51f465d57773c69d6d188840d48ec9"}
Sep 17 14:09:38.967894 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:38.967847    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv" podStartSLOduration=1.782603564 podStartE2EDuration="1.96783365s" totalImagesPullingTime="185.230086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:38.966159977 +0000 UTC m=+824.739927643" watchObservedRunningTime="2026-09-17 14:09:38.96783365 +0000 UTC m=+824.741601317"
Sep 17 14:09:39.626748 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:39.626714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:39.626905 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:39.626777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:39.639237 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:39.639209    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:39.957770 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:39.957695    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jhl9r"
Sep 17 14:09:47.716505 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:47.716466    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:47.717112 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:47.716537    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:47.729147 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:47.729126    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:09:47.992750 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:09:47.992676    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv"
Sep 17 14:10:54.662142 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:10:54.662072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:10:54.663145 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:10:54.663120    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:11:32.701135 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.701101    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:11:32.704787 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.704768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.707438 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.707411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-079b38-serving-cert\""
Sep 17 14:11:32.713492 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.713462    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:11:32.721819 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.721792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.721936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.721822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.721936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.721849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfr6\" (UniqueName: \"kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.722083 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.721956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.823239 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.823201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.823404 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.823286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.823404 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:32.823361    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-serving-cert: secret "maas-api-e2e-worker-w4-079b38-serving-cert" not found
Sep 17 14:11:32.823404 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.823385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.823567 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:32.823417    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls podName:1ad3abe3-5622-4c41-80c8-3724557a1a0a nodeName:}" failed. No retries permitted until 2026-09-17 14:11:33.323402233 +0000 UTC m=+939.097169882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls") pod "maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a") : secret "maas-api-e2e-worker-w4-079b38-serving-cert" not found
Sep 17 14:11:32.823567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.823443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfr6\" (UniqueName: \"kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.823845 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.823825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.825669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.825643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:32.855741 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:32.855714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfr6\" (UniqueName: \"kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:33.327892 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.327862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:33.328055 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:33.328006    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-serving-cert: secret "maas-api-e2e-worker-w4-079b38-serving-cert" not found
Sep 17 14:11:33.328101 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:33.328094    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls podName:1ad3abe3-5622-4c41-80c8-3724557a1a0a nodeName:}" failed. No retries permitted until 2026-09-17 14:11:34.328078868 +0000 UTC m=+940.101846516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls") pod "maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a") : secret "maas-api-e2e-worker-w4-079b38-serving-cert" not found
Sep 17 14:11:33.468946 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.468916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:11:33.472276 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.472255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.477424 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.477400    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-079b38\""
Sep 17 14:11:33.484824 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.484798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:11:33.488104 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.488083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:11:33.488215 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.488164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.490498 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.490479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-079b38-dockercfg-g6hsc\""
Sep 17 14:11:33.513443 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.513414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:11:33.529602 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.529577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.529729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.529609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.529729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.529633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgkgg\" (UniqueName: \"kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.529857 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.529745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xl9\" (UniqueName: \"kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.631223 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.631188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xl9\" (UniqueName: \"kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.631410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.631302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.631410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.631340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.631410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.631385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgkgg\" (UniqueName: \"kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.632149 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.632127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.632230 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.632147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.639871 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.639849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgkgg\" (UniqueName: \"kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg\") pod \"payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.640084 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.640033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xl9\" (UniqueName: \"kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9\") pod \"payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.783181 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.783147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:33.796288 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.796264    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:11:33.798197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.798175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:33.800835 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.800816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.803007 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.802986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-d9b17d-serving-cert\""
Sep 17 14:11:33.814810 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.814642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:11:33.834302 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.834258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.834566 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.834508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.834683 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.834623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.834758 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.834686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gkh\" (UniqueName: \"kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.935786 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.935752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.935786 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.935788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.936250 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.935844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.936250 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.935899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gkh\" (UniqueName: \"kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.937082 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.937031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.938605 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.938576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.938763 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.938742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:33.946003 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:33.945970    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gkh\" (UniqueName: \"kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh\") pod \"maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:34.071770 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.071645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:11:34.074513 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:34.074477    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c07ce5_a221_4a5c_bc4c_1924d08b4510.slice/crio-60dbaa049db1efea0b891c61b5533e7655c65463e01c0d6a8bc662eb68ceb6d7 WatchSource:0}: Error finding container 60dbaa049db1efea0b891c61b5533e7655c65463e01c0d6a8bc662eb68ceb6d7: Status 404 returned error can't find the container with id 60dbaa049db1efea0b891c61b5533e7655c65463e01c0d6a8bc662eb68ceb6d7
Sep 17 14:11:34.091253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.089843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:11:34.094500 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:34.094474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c8db06_69cc_4245_a8c9_03777e02682c.slice/crio-755ab8e48e1a7db48d430d9f0b569f1aa73c99ad89d59f7790a6b85809385f2c WatchSource:0}: Error finding container 755ab8e48e1a7db48d430d9f0b569f1aa73c99ad89d59f7790a6b85809385f2c: Status 404 returned error can't find the container with id 755ab8e48e1a7db48d430d9f0b569f1aa73c99ad89d59f7790a6b85809385f2c
Sep 17 14:11:34.115799 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.115776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:34.339719 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.339685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:34.341956 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.341928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:34.401441 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.401367    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:11:34.403730 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:34.403695    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c24e80_bb83_4148_ad82_72cd3de1ba07.slice/crio-c1c4e7f01825d6a4b78618215ea9f1408f33b68e9bc2b90aec1929a1ccb2a9bf WatchSource:0}: Error finding container c1c4e7f01825d6a4b78618215ea9f1408f33b68e9bc2b90aec1929a1ccb2a9bf: Status 404 returned error can't find the container with id c1c4e7f01825d6a4b78618215ea9f1408f33b68e9bc2b90aec1929a1ccb2a9bf
Sep 17 14:11:34.435943 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.435918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" event={"ID":"77c8db06-69cc-4245-a8c9-03777e02682c","Type":"ContainerStarted","Data":"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"}
Sep 17 14:11:34.436070 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.435967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" event={"ID":"77c8db06-69cc-4245-a8c9-03777e02682c","Type":"ContainerStarted","Data":"755ab8e48e1a7db48d430d9f0b569f1aa73c99ad89d59f7790a6b85809385f2c"}
Sep 17 14:11:34.436070 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.435996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:34.437563 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.437539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" event={"ID":"87c07ce5-a221-4a5c-bc4c-1924d08b4510","Type":"ContainerStarted","Data":"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"}
Sep 17 14:11:34.437670 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.437589    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:34.437670 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.437607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" event={"ID":"87c07ce5-a221-4a5c-bc4c-1924d08b4510","Type":"ContainerStarted","Data":"60dbaa049db1efea0b891c61b5533e7655c65463e01c0d6a8bc662eb68ceb6d7"}
Sep 17 14:11:34.438688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.438668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" event={"ID":"93c24e80-bb83-4148-ad82-72cd3de1ba07","Type":"ContainerStarted","Data":"c1c4e7f01825d6a4b78618215ea9f1408f33b68e9bc2b90aec1929a1ccb2a9bf"}
Sep 17 14:11:34.459653 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.459579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" podStartSLOduration=1.459560929 podStartE2EDuration="1.459560929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:34.457403913 +0000 UTC m=+940.231171583" watchObservedRunningTime="2026-09-17 14:11:34.459560929 +0000 UTC m=+940.233328601"
Sep 17 14:11:34.482734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.482681    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" podStartSLOduration=1.482661665 podStartE2EDuration="1.482661665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:34.480268324 +0000 UTC m=+940.254036006" watchObservedRunningTime="2026-09-17 14:11:34.482661665 +0000 UTC m=+940.256429339"
Sep 17 14:11:34.504011 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.503987    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:11:34.507495 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.507479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.509578 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.509556    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-d9b17d\""
Sep 17 14:11:34.509578 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.509567    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-d9b17d-dockercfg-52wjq\""
Sep 17 14:11:34.518618 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.518547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:34.519574 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.519554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:11:34.541807 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.541215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.543830 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.543800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4tl8\" (UniqueName: \"kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.645136 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.645099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4tl8\" (UniqueName: \"kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.645301 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.645204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.645895 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.645870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.653238 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.653180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4tl8\" (UniqueName: \"kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8\") pod \"payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:34.805634 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.805443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:11:34.807945 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:34.807919    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad3abe3_5622_4c41_80c8_3724557a1a0a.slice/crio-d140bd542a601f4f8fee2e6089273d0afcca9349d2b20d33feefd9773f4a1363 WatchSource:0}: Error finding container d140bd542a601f4f8fee2e6089273d0afcca9349d2b20d33feefd9773f4a1363: Status 404 returned error can't find the container with id d140bd542a601f4f8fee2e6089273d0afcca9349d2b20d33feefd9773f4a1363
Sep 17 14:11:34.816999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:34.816981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:35.091633 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.091572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:11:35.102292 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:35.102262    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65271e4c_6ef4_495d_9ac4_b0a7a7c29130.slice/crio-5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8 WatchSource:0}: Error finding container 5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8: Status 404 returned error can't find the container with id 5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8
Sep 17 14:11:35.446546 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.446488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" event={"ID":"65271e4c-6ef4-495d-9ac4-b0a7a7c29130","Type":"ContainerStarted","Data":"6559f6ac011be0b5475f21bc5af52bb0ad5aefd1618abd7ea012f0e20083d7d0"}
Sep 17 14:11:35.446725 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.446555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" event={"ID":"65271e4c-6ef4-495d-9ac4-b0a7a7c29130","Type":"ContainerStarted","Data":"5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8"}
Sep 17 14:11:35.446725 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.446587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:35.448259 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.448234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" event={"ID":"1ad3abe3-5622-4c41-80c8-3724557a1a0a","Type":"ContainerStarted","Data":"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"}
Sep 17 14:11:35.448380 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.448278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" event={"ID":"1ad3abe3-5622-4c41-80c8-3724557a1a0a","Type":"ContainerStarted","Data":"d140bd542a601f4f8fee2e6089273d0afcca9349d2b20d33feefd9773f4a1363"}
Sep 17 14:11:35.448380 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.448355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:35.450054 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.450017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" event={"ID":"93c24e80-bb83-4148-ad82-72cd3de1ba07","Type":"ContainerStarted","Data":"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"}
Sep 17 14:11:35.450171 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.450091    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:35.463287 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.463238    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" podStartSLOduration=1.463221683 podStartE2EDuration="1.463221683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:35.462895483 +0000 UTC m=+941.236663174" watchObservedRunningTime="2026-09-17 14:11:35.463221683 +0000 UTC m=+941.236989354"
Sep 17 14:11:35.481561 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.481517    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" podStartSLOduration=2.998597314 podStartE2EDuration="3.481504311s" totalImagesPullingTime="482.906997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:35.479887427 +0000 UTC m=+941.253655097" watchObservedRunningTime="2026-09-17 14:11:35.481504311 +0000 UTC m=+941.255271980"
Sep 17 14:11:35.498642 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.498604    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" podStartSLOduration=1.860549322 podStartE2EDuration="2.498590626s" totalImagesPullingTime="638.041304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:35.496445005 +0000 UTC m=+941.270212676" watchObservedRunningTime="2026-09-17 14:11:35.498590626 +0000 UTC m=+941.272358297"
Sep 17 14:11:35.714218 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.714181    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:11:35.717865 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.717842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.719512 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.719455    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:11:35.720863 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.720842    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-96cfc6-dockercfg-k98h9\""
Sep 17 14:11:35.721370 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.721352    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-96cfc6\""
Sep 17 14:11:35.756716 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.756678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdx7\" (UniqueName: \"kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.756919 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.756900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.857590 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.857556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdx7\" (UniqueName: \"kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.858015 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.857612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.858490 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.858469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:35.868422 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:35.868397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdx7\" (UniqueName: \"kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7\") pod \"payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:36.030785 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:36.030712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:36.353319 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:36.353156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:11:36.356143 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:36.356114    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada3ca4a_a86d_4464_ac6c_3822c10cb10d.slice/crio-de3aee8f62bff10a69b638bd730a98029879eb731ecc19ed991cdc2b110996c9 WatchSource:0}: Error finding container de3aee8f62bff10a69b638bd730a98029879eb731ecc19ed991cdc2b110996c9: Status 404 returned error can't find the container with id de3aee8f62bff10a69b638bd730a98029879eb731ecc19ed991cdc2b110996c9
Sep 17 14:11:36.461464 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:36.460465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" event={"ID":"ada3ca4a-a86d-4464-ac6c-3822c10cb10d","Type":"ContainerStarted","Data":"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"}
Sep 17 14:11:36.461464 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:36.460520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" event={"ID":"ada3ca4a-a86d-4464-ac6c-3822c10cb10d","Type":"ContainerStarted","Data":"de3aee8f62bff10a69b638bd730a98029879eb731ecc19ed991cdc2b110996c9"}
Sep 17 14:11:36.461464 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:36.461407    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:41.466341 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:41.466311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:11:41.466852 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:41.466832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:11:41.486901 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:41.486854    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" podStartSLOduration=6.486839346 podStartE2EDuration="6.486839346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:36.483721295 +0000 UTC m=+942.257488965" watchObservedRunningTime="2026-09-17 14:11:41.486839346 +0000 UTC m=+947.260607059"
Sep 17 14:11:44.166914 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.166882    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:11:44.171966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.171930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.174324 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.174305    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1ee55ce9\""
Sep 17 14:11:44.183221 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.183198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:11:44.239362 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.239335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.239488 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.239460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2qs\" (UniqueName: \"kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.340754 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.340723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2qs\" (UniqueName: \"kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.340905 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.340769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.341477 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.341458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.352245 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.352215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2qs\" (UniqueName: \"kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs\") pod \"payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.483275 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.483209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:44.508507 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.508460    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:11:44.513268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.513246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.517364 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.516770    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-0458f0-serving-cert\""
Sep 17 14:11:44.523542 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.523520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:11:44.644633 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.644597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j86kk\" (UniqueName: \"kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.644782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.644641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.644782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.644729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.644854 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.644817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.746019 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.745948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.746197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.746124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.746267 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.746203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j86kk\" (UniqueName: \"kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.746267 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.746257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.746379 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:44.746266    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-serving-cert: secret "maas-api-e2e-autores-0458f0-serving-cert" not found
Sep 17 14:11:44.746379 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:11:44.746371    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls podName:91882885-5530-477d-866a-9370e3ac5654 nodeName:}" failed. No retries permitted until 2026-09-17 14:11:45.246350208 +0000 UTC m=+951.020117861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls") pod "maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" (UID: "91882885-5530-477d-866a-9370e3ac5654") : secret "maas-api-e2e-autores-0458f0-serving-cert" not found
Sep 17 14:11:44.746759 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.746729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.748744 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.748722    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.755155 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.755135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j86kk\" (UniqueName: \"kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:44.774324 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:44.774305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:11:44.776100 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:44.776078    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d68a5e4_ec5a_483a_aed4_ac4c25ccaa19.slice/crio-758fe3ea0ecdfacb5b5f7206a4b62a36a8eb33d5553e8ea431c8f1522b2bba34 WatchSource:0}: Error finding container 758fe3ea0ecdfacb5b5f7206a4b62a36a8eb33d5553e8ea431c8f1522b2bba34: Status 404 returned error can't find the container with id 758fe3ea0ecdfacb5b5f7206a4b62a36a8eb33d5553e8ea431c8f1522b2bba34
Sep 17 14:11:45.251353 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.251310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:45.253703 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.253679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") pod \"maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:45.435468 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.435434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:45.452831 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.452474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:11:45.452831 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.452606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:11:45.513169 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.513137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" event={"ID":"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19","Type":"ContainerStarted","Data":"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"}
Sep 17 14:11:45.513300 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.513196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" event={"ID":"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19","Type":"ContainerStarted","Data":"758fe3ea0ecdfacb5b5f7206a4b62a36a8eb33d5553e8ea431c8f1522b2bba34"}
Sep 17 14:11:45.513300 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.513245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:45.530142 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.530083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" podStartSLOduration=1.530063441 podStartE2EDuration="1.530063441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:45.529512174 +0000 UTC m=+951.303279845" watchObservedRunningTime="2026-09-17 14:11:45.530063441 +0000 UTC m=+951.303831104"
Sep 17 14:11:45.743353 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:45.743327    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:11:45.745785 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:45.745754    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91882885_5530_477d_866a_9370e3ac5654.slice/crio-8cb4477bc122250a2e3cadf2b114ba00023657a22adc7742ed23f61266e6e9c0 WatchSource:0}: Error finding container 8cb4477bc122250a2e3cadf2b114ba00023657a22adc7742ed23f61266e6e9c0: Status 404 returned error can't find the container with id 8cb4477bc122250a2e3cadf2b114ba00023657a22adc7742ed23f61266e6e9c0
Sep 17 14:11:46.463427 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:46.463328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:11:46.520959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:46.520924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" event={"ID":"91882885-5530-477d-866a-9370e3ac5654","Type":"ContainerStarted","Data":"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"}
Sep 17 14:11:46.521251 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:46.521221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:46.521361 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:46.521266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" event={"ID":"91882885-5530-477d-866a-9370e3ac5654","Type":"ContainerStarted","Data":"8cb4477bc122250a2e3cadf2b114ba00023657a22adc7742ed23f61266e6e9c0"}
Sep 17 14:11:46.539427 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:46.539375    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" podStartSLOduration=2.141448327 podStartE2EDuration="2.539349117s" totalImagesPullingTime="397.90079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:46.538089171 +0000 UTC m=+952.311856841" watchObservedRunningTime="2026-09-17 14:11:46.539349117 +0000 UTC m=+952.313116790"
Sep 17 14:11:48.471656 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:48.471624    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:11:52.530682 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:52.530655    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:11:56.523018 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:56.522988    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:11:57.329625 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.329593    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:11:57.335053 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.335018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.337296 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.337273    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fe6ee5-serving-cert\""
Sep 17 14:11:57.345290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.345268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:11:57.465404 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.465371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.465542 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.465406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.465542 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.465439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh8t4\" (UniqueName: \"kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.465542 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.465520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.566375 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.566346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.566375 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.566376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.566815 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.566397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh8t4\" (UniqueName: \"kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.566815 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.566423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.567124 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.567102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.568922 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.568902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.569072 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.569034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.574462 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.574434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh8t4\" (UniqueName: \"kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4\") pod \"maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.647248 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.647228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:57.924524 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:57.924446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:11:57.927566 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:11:57.927528    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd631acd5_061a_40a4_b5d2_1407f22a9f1e.slice/crio-8fd3a203b4ec15e01635cb8851f2fe90ce4e65ad45194380d177055e1f0c8274 WatchSource:0}: Error finding container 8fd3a203b4ec15e01635cb8851f2fe90ce4e65ad45194380d177055e1f0c8274: Status 404 returned error can't find the container with id 8fd3a203b4ec15e01635cb8851f2fe90ce4e65ad45194380d177055e1f0c8274
Sep 17 14:11:58.585522 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:58.585485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" event={"ID":"d631acd5-061a-40a4-b5d2-1407f22a9f1e","Type":"ContainerStarted","Data":"8fd3a203b4ec15e01635cb8851f2fe90ce4e65ad45194380d177055e1f0c8274"}
Sep 17 14:11:59.592222 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:59.592180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" event={"ID":"d631acd5-061a-40a4-b5d2-1407f22a9f1e","Type":"ContainerStarted","Data":"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"}
Sep 17 14:11:59.592599 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:59.592255    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:11:59.611129 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:11:59.611050    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" podStartSLOduration=1.925848909 podStartE2EDuration="2.611020229s" totalImagesPullingTime="685.17132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:59.609460585 +0000 UTC m=+965.383228257" watchObservedRunningTime="2026-09-17 14:11:59.611020229 +0000 UTC m=+965.384787911"
Sep 17 14:12:05.602901 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:05.602867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:12:11.911180 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:11.911146    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:12:11.911644 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:11.911378    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" podUID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" containerName="payload-pre-processing" containerID="cri-o://b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd" gracePeriod=30
Sep 17 14:12:12.171445 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.171385    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:12:12.198641 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.198605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume\") pod \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") "
Sep 17 14:12:12.198817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.198668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x2qs\" (UniqueName: \"kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs\") pod \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\" (UID: \"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19\") "
Sep 17 14:12:12.199337 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.199296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" (UID: "8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:12.201949 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.201925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs" (OuterVolumeSpecName: "kube-api-access-9x2qs") pod "8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" (UID: "8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19"). InnerVolumeSpecName "kube-api-access-9x2qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:12.300346 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.300313    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:12:12.300346 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.300344    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x2qs\" (UniqueName: \"kubernetes.io/projected/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19-kube-api-access-9x2qs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:12:12.658109 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.658067    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" containerID="b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd" exitCode=0
Sep 17 14:12:12.658298 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.658114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" event={"ID":"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19","Type":"ContainerDied","Data":"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"}
Sep 17 14:12:12.658298 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.658134    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"
Sep 17 14:12:12.658298 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.658187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt" event={"ID":"8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19","Type":"ContainerDied","Data":"758fe3ea0ecdfacb5b5f7206a4b62a36a8eb33d5553e8ea431c8f1522b2bba34"}
Sep 17 14:12:12.658298 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.658217    2579 scope.go:117] "RemoveContainer" containerID="b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"
Sep 17 14:12:12.666977 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.666960    2579 scope.go:117] "RemoveContainer" containerID="b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"
Sep 17 14:12:12.667261 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:12:12.667242    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd\": container with ID starting with b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd not found: ID does not exist" containerID="b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"
Sep 17 14:12:12.667334 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.667267    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd"} err="failed to get container status \"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd\": rpc error: code = NotFound desc = could not find container \"b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd\": container with ID starting with b62a988bec8238af445f323a872c149fcd533f2fafb57b3ba8d402457c8640fd not found: ID does not exist"
Sep 17 14:12:12.699944 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.699918    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:12:12.709969 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:12.709948    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt"]
Sep 17 14:12:14.698973 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:14.698939    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" path="/var/lib/kubelet/pods/8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19/volumes"
Sep 17 14:12:19.390592 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.390516    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:19.390938 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.390926    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" containerName="payload-pre-processing"
Sep 17 14:12:19.390982 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.390940    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" containerName="payload-pre-processing"
Sep 17 14:12:19.391025 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.391009    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d68a5e4-ec5a-483a-aed4-ac4c25ccaa19" containerName="payload-pre-processing"
Sep 17 14:12:19.395332 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.395315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.399935 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.399908    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-dd410a86\""
Sep 17 14:12:19.410562 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.410544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-dd410a86-dockercfg-s9m2n\""
Sep 17 14:12:19.475939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.475903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:19.478591 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.478558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.478744 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.478601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989p5\" (UniqueName: \"kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.580008 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.579973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.580183 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.580011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989p5\" (UniqueName: \"kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.580884 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.580860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.597015 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.596985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989p5\" (UniqueName: \"kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5\") pod \"payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.705429 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.705350    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:19.983801 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:19.983776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:19.985665 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:12:19.985638    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673ac0ee_c3ad_443b_9c78_07e7470b7d64.slice/crio-35cf9027e6d6107edc493e85108ee3509baf882fca5f2a8feea9b2719fc8124b WatchSource:0}: Error finding container 35cf9027e6d6107edc493e85108ee3509baf882fca5f2a8feea9b2719fc8124b: Status 404 returned error can't find the container with id 35cf9027e6d6107edc493e85108ee3509baf882fca5f2a8feea9b2719fc8124b
Sep 17 14:12:20.701567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:20.701531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" event={"ID":"673ac0ee-c3ad-443b-9c78-07e7470b7d64","Type":"ContainerStarted","Data":"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"}
Sep 17 14:12:20.701958 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:20.701589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" event={"ID":"673ac0ee-c3ad-443b-9c78-07e7470b7d64","Type":"ContainerStarted","Data":"35cf9027e6d6107edc493e85108ee3509baf882fca5f2a8feea9b2719fc8124b"}
Sep 17 14:12:20.701958 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:20.701629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:20.722680 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:20.722631    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" podStartSLOduration=1.7226153819999999 podStartE2EDuration="1.722615382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:20.721587963 +0000 UTC m=+986.495355635" watchObservedRunningTime="2026-09-17 14:12:20.722615382 +0000 UTC m=+986.496383052"
Sep 17 14:12:31.708980 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:31.708949    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:47.155208 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.155167    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:47.155794 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.155423    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" podUID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" containerName="payload-pre-processing" containerID="cri-o://8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019" gracePeriod=30
Sep 17 14:12:47.424774 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.424737    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:47.443571 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.442483    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-989p5\" (UniqueName: \"kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5\") pod \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") "
Sep 17 14:12:47.455650 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.451495    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5" (OuterVolumeSpecName: "kube-api-access-989p5") pod "673ac0ee-c3ad-443b-9c78-07e7470b7d64" (UID: "673ac0ee-c3ad-443b-9c78-07e7470b7d64"). InnerVolumeSpecName "kube-api-access-989p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:47.543197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.543166    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume\") pod \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\" (UID: \"673ac0ee-c3ad-443b-9c78-07e7470b7d64\") "
Sep 17 14:12:47.543559 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.543533    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "673ac0ee-c3ad-443b-9c78-07e7470b7d64" (UID: "673ac0ee-c3ad-443b-9c78-07e7470b7d64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:47.543627 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.543607    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-989p5\" (UniqueName: \"kubernetes.io/projected/673ac0ee-c3ad-443b-9c78-07e7470b7d64-kube-api-access-989p5\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:12:47.644590 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.644556    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673ac0ee-c3ad-443b-9c78-07e7470b7d64-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:12:47.840189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.840085    2579 generic.go:356] "Generic (PLEG): container finished" podID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" containerID="8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019" exitCode=0
Sep 17 14:12:47.840189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.840165    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"
Sep 17 14:12:47.840366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.840168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" event={"ID":"673ac0ee-c3ad-443b-9c78-07e7470b7d64","Type":"ContainerDied","Data":"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"}
Sep 17 14:12:47.840366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.840301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j" event={"ID":"673ac0ee-c3ad-443b-9c78-07e7470b7d64","Type":"ContainerDied","Data":"35cf9027e6d6107edc493e85108ee3509baf882fca5f2a8feea9b2719fc8124b"}
Sep 17 14:12:47.840366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.840354    2579 scope.go:117] "RemoveContainer" containerID="8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"
Sep 17 14:12:47.850219 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.850202    2579 scope.go:117] "RemoveContainer" containerID="8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"
Sep 17 14:12:47.850484 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:12:47.850468    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019\": container with ID starting with 8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019 not found: ID does not exist" containerID="8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"
Sep 17 14:12:47.850538 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.850492    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019"} err="failed to get container status \"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019\": rpc error: code = NotFound desc = could not find container \"8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019\": container with ID starting with 8ff8acc9b55958cc9c09573f0dfa077904165dc4546cbef1141fa0558795e019 not found: ID does not exist"
Sep 17 14:12:47.861221 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.861192    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:47.862972 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:47.862953    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j"]
Sep 17 14:12:48.699576 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:48.699539    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" path="/var/lib/kubelet/pods/673ac0ee-c3ad-443b-9c78-07e7470b7d64/volumes"
Sep 17 14:12:54.809870 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.809839    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:12:54.810259 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.810244    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" containerName="payload-pre-processing"
Sep 17 14:12:54.810310 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.810262    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" containerName="payload-pre-processing"
Sep 17 14:12:54.810346 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.810327    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="673ac0ee-c3ad-443b-9c78-07e7470b7d64" containerName="payload-pre-processing"
Sep 17 14:12:54.814771 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.814752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:54.817015 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.816993    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1c07ea69\""
Sep 17 14:12:54.823885 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.823864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:12:54.912896 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.912864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stqlv\" (UniqueName: \"kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:54.912896 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:54.912894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.014529 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.014434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stqlv\" (UniqueName: \"kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.014529 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.014471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.015203 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.015178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.022682 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.022655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stqlv\" (UniqueName: \"kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv\") pod \"payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.126759 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.126731    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.399393 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.399309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:12:55.401522 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:12:55.401495    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb354a0fb_9599_4b58_9738_17720f4e6bca.slice/crio-2ca6202c16e37259277d6314b54c4e4a4aeac878b5d20c0b106dc2c09693ce6a WatchSource:0}: Error finding container 2ca6202c16e37259277d6314b54c4e4a4aeac878b5d20c0b106dc2c09693ce6a: Status 404 returned error can't find the container with id 2ca6202c16e37259277d6314b54c4e4a4aeac878b5d20c0b106dc2c09693ce6a
Sep 17 14:12:55.878330 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.878297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" event={"ID":"b354a0fb-9599-4b58-9738-17720f4e6bca","Type":"ContainerStarted","Data":"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"}
Sep 17 14:12:55.878685 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.878348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" event={"ID":"b354a0fb-9599-4b58-9738-17720f4e6bca","Type":"ContainerStarted","Data":"2ca6202c16e37259277d6314b54c4e4a4aeac878b5d20c0b106dc2c09693ce6a"}
Sep 17 14:12:55.878685 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.878431    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:12:55.898210 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:12:55.898164    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" podStartSLOduration=1.898150508 podStartE2EDuration="1.898150508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:55.895569407 +0000 UTC m=+1021.669337076" watchObservedRunningTime="2026-09-17 14:12:55.898150508 +0000 UTC m=+1021.671918178"
Sep 17 14:13:06.886108 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:06.886077    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:13:24.253011 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.252893    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:13:24.253635 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.253240    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" podUID="b354a0fb-9599-4b58-9738-17720f4e6bca" containerName="payload-pre-processing" containerID="cri-o://2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a" gracePeriod=30
Sep 17 14:13:24.506234 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.506173    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:13:24.687526 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.687489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stqlv\" (UniqueName: \"kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv\") pod \"b354a0fb-9599-4b58-9738-17720f4e6bca\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") "
Sep 17 14:13:24.687966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.687624    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume\") pod \"b354a0fb-9599-4b58-9738-17720f4e6bca\" (UID: \"b354a0fb-9599-4b58-9738-17720f4e6bca\") "
Sep 17 14:13:24.687966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.687949    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b354a0fb-9599-4b58-9738-17720f4e6bca" (UID: "b354a0fb-9599-4b58-9738-17720f4e6bca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:13:24.689503 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.689477    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv" (OuterVolumeSpecName: "kube-api-access-stqlv") pod "b354a0fb-9599-4b58-9738-17720f4e6bca" (UID: "b354a0fb-9599-4b58-9738-17720f4e6bca"). InnerVolumeSpecName "kube-api-access-stqlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:24.789399 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.789332    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stqlv\" (UniqueName: \"kubernetes.io/projected/b354a0fb-9599-4b58-9738-17720f4e6bca-kube-api-access-stqlv\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:13:24.789399 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:24.789360    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b354a0fb-9599-4b58-9738-17720f4e6bca-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:13:25.028483 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.028448    2579 generic.go:356] "Generic (PLEG): container finished" podID="b354a0fb-9599-4b58-9738-17720f4e6bca" containerID="2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a" exitCode=0
Sep 17 14:13:25.028483 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.028487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" event={"ID":"b354a0fb-9599-4b58-9738-17720f4e6bca","Type":"ContainerDied","Data":"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"}
Sep 17 14:13:25.028734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.028533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl" event={"ID":"b354a0fb-9599-4b58-9738-17720f4e6bca","Type":"ContainerDied","Data":"2ca6202c16e37259277d6314b54c4e4a4aeac878b5d20c0b106dc2c09693ce6a"}
Sep 17 14:13:25.028734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.028563    2579 scope.go:117] "RemoveContainer" containerID="2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"
Sep 17 14:13:25.028734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.028489    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"
Sep 17 14:13:25.036829 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.036812    2579 scope.go:117] "RemoveContainer" containerID="2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"
Sep 17 14:13:25.037096 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:13:25.037074    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a\": container with ID starting with 2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a not found: ID does not exist" containerID="2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"
Sep 17 14:13:25.037160 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.037105    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a"} err="failed to get container status \"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a\": rpc error: code = NotFound desc = could not find container \"2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a\": container with ID starting with 2e1245717d78bc870977ef0a1485ed8b02dbda117012a042f1be6c687a659d7a not found: ID does not exist"
Sep 17 14:13:25.048514 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.048464    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:13:25.054349 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:25.054326    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl"]
Sep 17 14:13:26.698954 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:26.698914    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b354a0fb-9599-4b58-9738-17720f4e6bca" path="/var/lib/kubelet/pods/b354a0fb-9599-4b58-9738-17720f4e6bca/volumes"
Sep 17 14:13:31.074437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.074405    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:13:31.074865 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.074850    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b354a0fb-9599-4b58-9738-17720f4e6bca" containerName="payload-pre-processing"
Sep 17 14:13:31.074865 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.074863    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b354a0fb-9599-4b58-9738-17720f4e6bca" containerName="payload-pre-processing"
Sep 17 14:13:31.074937 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.074918    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b354a0fb-9599-4b58-9738-17720f4e6bca" containerName="payload-pre-processing"
Sep 17 14:13:31.079446 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.079425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.081665 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.081644    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-9af6d23e\""
Sep 17 14:13:31.081785 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.081651    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-9af6d23e-dockercfg-ml2mn\""
Sep 17 14:13:31.090727 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.090707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:13:31.092638 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.092614    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:13:31.096182 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.096164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.105810 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.105776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:13:31.145049 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.145019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2fv8\" (UniqueName: \"kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.145171 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.145107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.145235 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.145176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.145235 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.145204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xtt\" (UniqueName: \"kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.245955 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.245918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2fv8\" (UniqueName: \"kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.246135 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.245966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.246135 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.245990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.246135 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.246009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xtt\" (UniqueName: \"kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.246743 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.246718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.246853 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.246793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.253829 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.253799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2fv8\" (UniqueName: \"kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8\") pod \"payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") " pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.253934 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.253885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xtt\" (UniqueName: \"kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt\") pod \"payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.390345 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.390319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:31.409131 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.409021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:31.665422 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.665395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:13:31.667349 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:13:31.667323    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb817ec_6315_4104_a74b_1a979040f55e.slice/crio-3a27df53e74c234b00e6b04b039c55fa12145287b83b38e17b44ff1f95184ec6 WatchSource:0}: Error finding container 3a27df53e74c234b00e6b04b039c55fa12145287b83b38e17b44ff1f95184ec6: Status 404 returned error can't find the container with id 3a27df53e74c234b00e6b04b039c55fa12145287b83b38e17b44ff1f95184ec6
Sep 17 14:13:31.703153 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:31.703132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:13:31.704946 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:13:31.704913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971d8d3d_97a5_471a_bd84_c5b29f503bd6.slice/crio-097a639ac42655fc5db097483840d1b9bc2bad9d74383a2fce555b9197ad4c37 WatchSource:0}: Error finding container 097a639ac42655fc5db097483840d1b9bc2bad9d74383a2fce555b9197ad4c37: Status 404 returned error can't find the container with id 097a639ac42655fc5db097483840d1b9bc2bad9d74383a2fce555b9197ad4c37
Sep 17 14:13:32.065218 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.065114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" event={"ID":"971d8d3d-97a5-471a-bd84-c5b29f503bd6","Type":"ContainerStarted","Data":"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"}
Sep 17 14:13:32.065218 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.065179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" event={"ID":"971d8d3d-97a5-471a-bd84-c5b29f503bd6","Type":"ContainerStarted","Data":"097a639ac42655fc5db097483840d1b9bc2bad9d74383a2fce555b9197ad4c37"}
Sep 17 14:13:32.065454 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.065280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:13:32.066758 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.066730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" event={"ID":"6fb817ec-6315-4104-a74b-1a979040f55e","Type":"ContainerStarted","Data":"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"}
Sep 17 14:13:32.066862 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.066781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" event={"ID":"6fb817ec-6315-4104-a74b-1a979040f55e","Type":"ContainerStarted","Data":"3a27df53e74c234b00e6b04b039c55fa12145287b83b38e17b44ff1f95184ec6"}
Sep 17 14:13:32.066862 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.066819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:32.084384 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.084330    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" podStartSLOduration=1.084310304 podStartE2EDuration="1.084310304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:13:32.082712455 +0000 UTC m=+1057.856480127" watchObservedRunningTime="2026-09-17 14:13:32.084310304 +0000 UTC m=+1057.858077980"
Sep 17 14:13:32.112138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:32.112091    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" podStartSLOduration=1.112077113 podStartE2EDuration="1.112077113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:13:32.111342277 +0000 UTC m=+1057.885109949" watchObservedRunningTime="2026-09-17 14:13:32.112077113 +0000 UTC m=+1057.885844783"
Sep 17 14:13:43.073323 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:43.073292    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:13:43.073718 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:13:43.073370    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:14:01.334993 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.334959    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:14:01.335514 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.335193    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" podUID="91882885-5530-477d-866a-9370e3ac5654" containerName="maas-api" containerID="cri-o://d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141" gracePeriod=30
Sep 17 14:14:01.599423 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.599401    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:14:01.726867 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.726835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca\") pod \"91882885-5530-477d-866a-9370e3ac5654\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") "
Sep 17 14:14:01.727073 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.726914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j86kk\" (UniqueName: \"kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk\") pod \"91882885-5530-477d-866a-9370e3ac5654\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") "
Sep 17 14:14:01.727073 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.726973    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs\") pod \"91882885-5530-477d-866a-9370e3ac5654\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") "
Sep 17 14:14:01.727073 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.726991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") pod \"91882885-5530-477d-866a-9370e3ac5654\" (UID: \"91882885-5530-477d-866a-9370e3ac5654\") "
Sep 17 14:14:01.727304 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.727280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91882885-5530-477d-866a-9370e3ac5654" (UID: "91882885-5530-477d-866a-9370e3ac5654"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:14:01.729188 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.729158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91882885-5530-477d-866a-9370e3ac5654" (UID: "91882885-5530-477d-866a-9370e3ac5654"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:14:01.729303 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.729217    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91882885-5530-477d-866a-9370e3ac5654" (UID: "91882885-5530-477d-866a-9370e3ac5654"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:14:01.729303 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.729231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk" (OuterVolumeSpecName: "kube-api-access-j86kk") pod "91882885-5530-477d-866a-9370e3ac5654" (UID: "91882885-5530-477d-866a-9370e3ac5654"). InnerVolumeSpecName "kube-api-access-j86kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:01.828260 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.828233    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91882885-5530-477d-866a-9370e3ac5654-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:01.828495 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.828298    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j86kk\" (UniqueName: \"kubernetes.io/projected/91882885-5530-477d-866a-9370e3ac5654-kube-api-access-j86kk\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:01.828495 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.828313    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:01.828495 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:01.828326    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91882885-5530-477d-866a-9370e3ac5654-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:02.214568 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.214532    2579 generic.go:356] "Generic (PLEG): container finished" podID="91882885-5530-477d-866a-9370e3ac5654" containerID="d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141" exitCode=0
Sep 17 14:14:02.214738 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.214581    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"
Sep 17 14:14:02.214738 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.214613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" event={"ID":"91882885-5530-477d-866a-9370e3ac5654","Type":"ContainerDied","Data":"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"}
Sep 17 14:14:02.214738 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.214666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw" event={"ID":"91882885-5530-477d-866a-9370e3ac5654","Type":"ContainerDied","Data":"8cb4477bc122250a2e3cadf2b114ba00023657a22adc7742ed23f61266e6e9c0"}
Sep 17 14:14:02.214738 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.214688    2579 scope.go:117] "RemoveContainer" containerID="d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"
Sep 17 14:14:02.224284 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.224267    2579 scope.go:117] "RemoveContainer" containerID="d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"
Sep 17 14:14:02.224568 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:14:02.224544    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141\": container with ID starting with d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141 not found: ID does not exist" containerID="d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"
Sep 17 14:14:02.224630 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.224577    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141"} err="failed to get container status \"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141\": rpc error: code = NotFound desc = could not find container \"d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141\": container with ID starting with d28dc428dfdddff6d01d9049908dab4ab839a6249bf2ff240b2cc95d949fb141 not found: ID does not exist"
Sep 17 14:14:02.236710 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.236566    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:14:02.238832 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.238810    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0458f0-65d5cbdb66-vl4jw"]
Sep 17 14:14:02.700099 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:02.700068    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91882885-5530-477d-866a-9370e3ac5654" path="/var/lib/kubelet/pods/91882885-5530-477d-866a-9370e3ac5654/volumes"
Sep 17 14:14:10.528958 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.528922    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:14:10.529394 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.529151    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" podUID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" containerName="payload-processing" containerID="cri-o://dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65" gracePeriod=30
Sep 17 14:14:10.539313 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.539284    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:14:10.540094 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.539525    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" podUID="6fb817ec-6315-4104-a74b-1a979040f55e" containerName="payload-pre-processing" containerID="cri-o://b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33" gracePeriod=30
Sep 17 14:14:10.818922 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.818900    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:14:10.821837 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.821819    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:14:10.910260 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.910233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume\") pod \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") "
Sep 17 14:14:10.910447 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.910294    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2fv8\" (UniqueName: \"kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8\") pod \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\" (UID: \"971d8d3d-97a5-471a-bd84-c5b29f503bd6\") "
Sep 17 14:14:10.910753 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.910683    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "971d8d3d-97a5-471a-bd84-c5b29f503bd6" (UID: "971d8d3d-97a5-471a-bd84-c5b29f503bd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:14:10.913014 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:10.912979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8" (OuterVolumeSpecName: "kube-api-access-x2fv8") pod "971d8d3d-97a5-471a-bd84-c5b29f503bd6" (UID: "971d8d3d-97a5-471a-bd84-c5b29f503bd6"). InnerVolumeSpecName "kube-api-access-x2fv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:11.011633 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.011605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9xtt\" (UniqueName: \"kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt\") pod \"6fb817ec-6315-4104-a74b-1a979040f55e\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") "
Sep 17 14:14:11.011777 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.011676    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume\") pod \"6fb817ec-6315-4104-a74b-1a979040f55e\" (UID: \"6fb817ec-6315-4104-a74b-1a979040f55e\") "
Sep 17 14:14:11.011861 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.011850    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/971d8d3d-97a5-471a-bd84-c5b29f503bd6-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:11.011898 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.011863    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2fv8\" (UniqueName: \"kubernetes.io/projected/971d8d3d-97a5-471a-bd84-c5b29f503bd6-kube-api-access-x2fv8\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:11.012010 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.011986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fb817ec-6315-4104-a74b-1a979040f55e" (UID: "6fb817ec-6315-4104-a74b-1a979040f55e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:14:11.013636 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.013614    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt" (OuterVolumeSpecName: "kube-api-access-x9xtt") pod "6fb817ec-6315-4104-a74b-1a979040f55e" (UID: "6fb817ec-6315-4104-a74b-1a979040f55e"). InnerVolumeSpecName "kube-api-access-x9xtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:11.112552 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.112484    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9xtt\" (UniqueName: \"kubernetes.io/projected/6fb817ec-6315-4104-a74b-1a979040f55e-kube-api-access-x9xtt\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:11.112552 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.112520    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb817ec-6315-4104-a74b-1a979040f55e-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:14:11.270146 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.270109    2579 generic.go:356] "Generic (PLEG): container finished" podID="6fb817ec-6315-4104-a74b-1a979040f55e" containerID="b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33" exitCode=0
Sep 17 14:14:11.270312 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.270155    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"
Sep 17 14:14:11.270312 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.270193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" event={"ID":"6fb817ec-6315-4104-a74b-1a979040f55e","Type":"ContainerDied","Data":"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"}
Sep 17 14:14:11.270312 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.270255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg" event={"ID":"6fb817ec-6315-4104-a74b-1a979040f55e","Type":"ContainerDied","Data":"3a27df53e74c234b00e6b04b039c55fa12145287b83b38e17b44ff1f95184ec6"}
Sep 17 14:14:11.270312 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.270288    2579 scope.go:117] "RemoveContainer" containerID="b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"
Sep 17 14:14:11.271928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.271669    2579 generic.go:356] "Generic (PLEG): container finished" podID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" containerID="dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65" exitCode=0
Sep 17 14:14:11.271928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.271698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" event={"ID":"971d8d3d-97a5-471a-bd84-c5b29f503bd6","Type":"ContainerDied","Data":"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"}
Sep 17 14:14:11.271928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.271725    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"
Sep 17 14:14:11.271928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.271743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd" event={"ID":"971d8d3d-97a5-471a-bd84-c5b29f503bd6","Type":"ContainerDied","Data":"097a639ac42655fc5db097483840d1b9bc2bad9d74383a2fce555b9197ad4c37"}
Sep 17 14:14:11.280468 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.280452    2579 scope.go:117] "RemoveContainer" containerID="b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"
Sep 17 14:14:11.280750 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:14:11.280724    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33\": container with ID starting with b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33 not found: ID does not exist" containerID="b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"
Sep 17 14:14:11.280858 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.280760    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33"} err="failed to get container status \"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33\": rpc error: code = NotFound desc = could not find container \"b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33\": container with ID starting with b3bbd1a4bbfa76f44a72c77d51828f3b3214058884f92d01b57ca9a89e448a33 not found: ID does not exist"
Sep 17 14:14:11.280858 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.280784    2579 scope.go:117] "RemoveContainer" containerID="dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"
Sep 17 14:14:11.289105 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.289080    2579 scope.go:117] "RemoveContainer" containerID="dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"
Sep 17 14:14:11.289350 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:14:11.289332    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65\": container with ID starting with dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65 not found: ID does not exist" containerID="dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"
Sep 17 14:14:11.289434 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.289358    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65"} err="failed to get container status \"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65\": rpc error: code = NotFound desc = could not find container \"dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65\": container with ID starting with dcc5234547c07cd5cb8068135e68a06b66a4798b3818e216a4a65b3e9a412b65 not found: ID does not exist"
Sep 17 14:14:11.305900 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.305877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:14:11.324681 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.324661    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd"]
Sep 17 14:14:11.351739 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.351715    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:14:11.380247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:11.374607    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg"]
Sep 17 14:14:12.700383 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:12.700351    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb817ec-6315-4104-a74b-1a979040f55e" path="/var/lib/kubelet/pods/6fb817ec-6315-4104-a74b-1a979040f55e/volumes"
Sep 17 14:14:12.700744 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:12.700697    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" path="/var/lib/kubelet/pods/971d8d3d-97a5-471a-bd84-c5b29f503bd6/volumes"
Sep 17 14:14:54.649797 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.649763    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650159    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb817ec-6315-4104-a74b-1a979040f55e" containerName="payload-pre-processing"
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650173    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb817ec-6315-4104-a74b-1a979040f55e" containerName="payload-pre-processing"
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650183    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91882885-5530-477d-866a-9370e3ac5654" containerName="maas-api"
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650188    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91882885-5530-477d-866a-9370e3ac5654" containerName="maas-api"
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650208    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" containerName="payload-processing"
Sep 17 14:14:54.650253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650214    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" containerName="payload-processing"
Sep 17 14:14:54.650452 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650278    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91882885-5530-477d-866a-9370e3ac5654" containerName="maas-api"
Sep 17 14:14:54.650452 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650287    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="971d8d3d-97a5-471a-bd84-c5b29f503bd6" containerName="payload-processing"
Sep 17 14:14:54.650452 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.650296    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb817ec-6315-4104-a74b-1a979040f55e" containerName="payload-pre-processing"
Sep 17 14:14:54.654496 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.654457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.657459 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.657429    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-767170\""
Sep 17 14:14:54.657604 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.657466    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-767170-dockercfg-z7r86\""
Sep 17 14:14:54.669138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.669103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:14:54.792086 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.792032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.792213 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.792121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpg9r\" (UniqueName: \"kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.892779 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.892744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.892933 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.892788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpg9r\" (UniqueName: \"kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.893466 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.893446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.901170 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.901113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpg9r\" (UniqueName: \"kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r\") pod \"payload-processing-e2e-explicit-767170-69d8449c69-b7grq\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") " pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:54.969648 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:54.969622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:55.244811 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:55.244726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:14:55.247704 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:14:55.247677    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0695a262_64e0_4a44_8177_8174689e0e54.slice/crio-bc5d845996f29ecb002e65ee992001d3bdb850de3fff8a8b4f8de5d953064fac WatchSource:0}: Error finding container bc5d845996f29ecb002e65ee992001d3bdb850de3fff8a8b4f8de5d953064fac: Status 404 returned error can't find the container with id bc5d845996f29ecb002e65ee992001d3bdb850de3fff8a8b4f8de5d953064fac
Sep 17 14:14:55.493384 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:55.493347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" event={"ID":"0695a262-64e0-4a44-8177-8174689e0e54","Type":"ContainerStarted","Data":"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"}
Sep 17 14:14:55.493567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:55.493408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" event={"ID":"0695a262-64e0-4a44-8177-8174689e0e54","Type":"ContainerStarted","Data":"bc5d845996f29ecb002e65ee992001d3bdb850de3fff8a8b4f8de5d953064fac"}
Sep 17 14:14:55.493567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:55.493529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:14:55.513267 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:14:55.513172    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" podStartSLOduration=1.51315972 podStartE2EDuration="1.51315972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:55.511136055 +0000 UTC m=+1141.284903728" watchObservedRunningTime="2026-09-17 14:14:55.51315972 +0000 UTC m=+1141.286927389"
Sep 17 14:15:06.500705 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:15:06.500677    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:15:54.691978 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:15:54.691947    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:15:54.694232 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:15:54.694207    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:16:08.323574 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.323541    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:08.328383 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.328358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.330341 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.330318    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4a43447e-serving-cert\""
Sep 17 14:16:08.339630 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.339605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:08.418662 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.418636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.418790 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.418673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.418790 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.418691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmftz\" (UniqueName: \"kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.418790 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.418723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.519805 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.519777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.519939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.519818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.519939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.519848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmftz\" (UniqueName: \"kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.519939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.519895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.520794 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.520769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.522734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.522670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.522928 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.522908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.531902 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.531878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmftz\" (UniqueName: \"kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz\") pod \"maas-api-e2e-mt-4a43447e-57c5f46885-85g6r\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.641095 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.641064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:08.915680 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.915653    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:08.918394 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:16:08.918359    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706c5e83_f4ee_4716_8df8_9db6a0b65d2a.slice/crio-5157805aab53f18f90194bf1df7c273599f8ca1d398eaaa50682067a0d569d83 WatchSource:0}: Error finding container 5157805aab53f18f90194bf1df7c273599f8ca1d398eaaa50682067a0d569d83: Status 404 returned error can't find the container with id 5157805aab53f18f90194bf1df7c273599f8ca1d398eaaa50682067a0d569d83
Sep 17 14:16:08.920002 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:08.919983    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:16:09.214736 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.214662    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:09.219290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.219272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.222930 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.222907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4a43447e\""
Sep 17 14:16:09.223308 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.223284    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4a43447e-dockercfg-4mlls\""
Sep 17 14:16:09.232065 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.232026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:09.327501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.327470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.327826 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.327515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfwnw\" (UniqueName: \"kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.428855 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.428819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.429025 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.428871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfwnw\" (UniqueName: \"kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.429530 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.429508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.438515 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.438495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfwnw\" (UniqueName: \"kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw\") pod \"payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.531268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.531206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:09.826726 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.826700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:09.826850 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:16:09.826785    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0c0804_efd5_4b7f_84c5_8611301b04d6.slice/crio-e64c4206de310dbc66d79d539c82c05679c204f507f0683bb30d4af0f55e6422 WatchSource:0}: Error finding container e64c4206de310dbc66d79d539c82c05679c204f507f0683bb30d4af0f55e6422: Status 404 returned error can't find the container with id e64c4206de310dbc66d79d539c82c05679c204f507f0683bb30d4af0f55e6422
Sep 17 14:16:09.864639 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.864607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" event={"ID":"706c5e83-f4ee-4716-8df8-9db6a0b65d2a","Type":"ContainerStarted","Data":"ed69a92671aa20ea6c923ccd49c87c0856a247f8618e95c215269ea86eeed81f"}
Sep 17 14:16:09.864762 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.864667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" event={"ID":"706c5e83-f4ee-4716-8df8-9db6a0b65d2a","Type":"ContainerStarted","Data":"5157805aab53f18f90194bf1df7c273599f8ca1d398eaaa50682067a0d569d83"}
Sep 17 14:16:09.864762 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.864700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:09.866057 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.865980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" event={"ID":"0d0c0804-efd5-4b7f-84c5-8611301b04d6","Type":"ContainerStarted","Data":"e64c4206de310dbc66d79d539c82c05679c204f507f0683bb30d4af0f55e6422"}
Sep 17 14:16:09.895132 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:09.895080    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" podStartSLOduration=1.276544553 podStartE2EDuration="1.895027854s" totalImagesPullingTime="618.483301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:09.890643908 +0000 UTC m=+1215.664411577" watchObservedRunningTime="2026-09-17 14:16:09.895027854 +0000 UTC m=+1215.668795525"
Sep 17 14:16:10.872819 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:10.872780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" event={"ID":"0d0c0804-efd5-4b7f-84c5-8611301b04d6","Type":"ContainerStarted","Data":"9ea1f34817a665d0dedb2774caf6119ea134ebddaad305fac3037752ad3fa6ed"}
Sep 17 14:16:10.897363 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:10.897323    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" podStartSLOduration=1.897307072 podStartE2EDuration="1.897307072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:10.896080041 +0000 UTC m=+1216.669847717" watchObservedRunningTime="2026-09-17 14:16:10.897307072 +0000 UTC m=+1216.671074745"
Sep 17 14:16:11.878669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:11.878633    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:15.878479 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:15.878446    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:22.884927 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:22.884896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:51.909028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:51.908932    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:51.911910 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:51.909170    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" podUID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" containerName="maas-api" containerID="cri-o://ed69a92671aa20ea6c923ccd49c87c0856a247f8618e95c215269ea86eeed81f" gracePeriod=30
Sep 17 14:16:51.945699 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:51.945671    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:51.945926 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:51.945897    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" podUID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" containerName="payload-pre-processing" containerID="cri-o://9ea1f34817a665d0dedb2774caf6119ea134ebddaad305fac3037752ad3fa6ed" gracePeriod=30
Sep 17 14:16:52.071483 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.071456    2579 generic.go:356] "Generic (PLEG): container finished" podID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" containerID="ed69a92671aa20ea6c923ccd49c87c0856a247f8618e95c215269ea86eeed81f" exitCode=0
Sep 17 14:16:52.071604 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.071531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" event={"ID":"706c5e83-f4ee-4716-8df8-9db6a0b65d2a","Type":"ContainerDied","Data":"ed69a92671aa20ea6c923ccd49c87c0856a247f8618e95c215269ea86eeed81f"}
Sep 17 14:16:52.073190 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.073169    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" containerID="9ea1f34817a665d0dedb2774caf6119ea134ebddaad305fac3037752ad3fa6ed" exitCode=0
Sep 17 14:16:52.073284 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.073222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" event={"ID":"0d0c0804-efd5-4b7f-84c5-8611301b04d6","Type":"ContainerDied","Data":"9ea1f34817a665d0dedb2774caf6119ea134ebddaad305fac3037752ad3fa6ed"}
Sep 17 14:16:52.198850 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.198826    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:52.231817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.231796    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:52.321408 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321375    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca\") pod \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") "
Sep 17 14:16:52.321591 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321440    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls\") pod \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") "
Sep 17 14:16:52.321591 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321488    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmftz\" (UniqueName: \"kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz\") pod \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") "
Sep 17 14:16:52.321591 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321565    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfwnw\" (UniqueName: \"kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw\") pod \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") "
Sep 17 14:16:52.321769 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321618    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs\") pod \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\" (UID: \"706c5e83-f4ee-4716-8df8-9db6a0b65d2a\") "
Sep 17 14:16:52.321769 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume\") pod \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\" (UID: \"0d0c0804-efd5-4b7f-84c5-8611301b04d6\") "
Sep 17 14:16:52.321769 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321735    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "706c5e83-f4ee-4716-8df8-9db6a0b65d2a" (UID: "706c5e83-f4ee-4716-8df8-9db6a0b65d2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:16:52.321977 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.321955    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.322252 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.322211    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d0c0804-efd5-4b7f-84c5-8611301b04d6" (UID: "0d0c0804-efd5-4b7f-84c5-8611301b04d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:16:52.323825 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.323802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw" (OuterVolumeSpecName: "kube-api-access-kfwnw") pod "0d0c0804-efd5-4b7f-84c5-8611301b04d6" (UID: "0d0c0804-efd5-4b7f-84c5-8611301b04d6"). InnerVolumeSpecName "kube-api-access-kfwnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:52.324082 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.324064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "706c5e83-f4ee-4716-8df8-9db6a0b65d2a" (UID: "706c5e83-f4ee-4716-8df8-9db6a0b65d2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:16:52.324154 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.324104    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz" (OuterVolumeSpecName: "kube-api-access-wmftz") pod "706c5e83-f4ee-4716-8df8-9db6a0b65d2a" (UID: "706c5e83-f4ee-4716-8df8-9db6a0b65d2a"). InnerVolumeSpecName "kube-api-access-wmftz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:52.324341 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.324324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "706c5e83-f4ee-4716-8df8-9db6a0b65d2a" (UID: "706c5e83-f4ee-4716-8df8-9db6a0b65d2a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:16:52.422493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.422412    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.422493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.422442    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmftz\" (UniqueName: \"kubernetes.io/projected/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-kube-api-access-wmftz\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.422493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.422452    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfwnw\" (UniqueName: \"kubernetes.io/projected/0d0c0804-efd5-4b7f-84c5-8611301b04d6-kube-api-access-kfwnw\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.422493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.422460    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706c5e83-f4ee-4716-8df8-9db6a0b65d2a-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.422493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:52.422470    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d0c0804-efd5-4b7f-84c5-8611301b04d6-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:16:53.079168 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.079085    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"
Sep 17 14:16:53.079580 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.079087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6" event={"ID":"0d0c0804-efd5-4b7f-84c5-8611301b04d6","Type":"ContainerDied","Data":"e64c4206de310dbc66d79d539c82c05679c204f507f0683bb30d4af0f55e6422"}
Sep 17 14:16:53.079580 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.079269    2579 scope.go:117] "RemoveContainer" containerID="9ea1f34817a665d0dedb2774caf6119ea134ebddaad305fac3037752ad3fa6ed"
Sep 17 14:16:53.080744 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.080597    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"
Sep 17 14:16:53.080744 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.080626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r" event={"ID":"706c5e83-f4ee-4716-8df8-9db6a0b65d2a","Type":"ContainerDied","Data":"5157805aab53f18f90194bf1df7c273599f8ca1d398eaaa50682067a0d569d83"}
Sep 17 14:16:53.088204 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.088184    2579 scope.go:117] "RemoveContainer" containerID="ed69a92671aa20ea6c923ccd49c87c0856a247f8618e95c215269ea86eeed81f"
Sep 17 14:16:53.097953 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.097932    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:53.102336 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.102311    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6"]
Sep 17 14:16:53.114194 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.114174    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:53.116501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:53.116482    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a43447e-57c5f46885-85g6r"]
Sep 17 14:16:54.701154 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:54.701127    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" path="/var/lib/kubelet/pods/0d0c0804-efd5-4b7f-84c5-8611301b04d6/volumes"
Sep 17 14:16:54.701567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:16:54.701553    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" path="/var/lib/kubelet/pods/706c5e83-f4ee-4716-8df8-9db6a0b65d2a/volumes"
Sep 17 14:17:03.662236 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:03.662203    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:17:03.662671 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:03.662413    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" podUID="0695a262-64e0-4a44-8177-8174689e0e54" containerName="payload-processing" containerID="cri-o://b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe" gracePeriod=30
Sep 17 14:17:03.906308 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:03.906285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:17:04.021236 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.021155    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpg9r\" (UniqueName: \"kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r\") pod \"0695a262-64e0-4a44-8177-8174689e0e54\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") "
Sep 17 14:17:04.021236 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.021196    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume\") pod \"0695a262-64e0-4a44-8177-8174689e0e54\" (UID: \"0695a262-64e0-4a44-8177-8174689e0e54\") "
Sep 17 14:17:04.021580 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.021550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0695a262-64e0-4a44-8177-8174689e0e54" (UID: "0695a262-64e0-4a44-8177-8174689e0e54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:17:04.023271 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.023249    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r" (OuterVolumeSpecName: "kube-api-access-mpg9r") pod "0695a262-64e0-4a44-8177-8174689e0e54" (UID: "0695a262-64e0-4a44-8177-8174689e0e54"). InnerVolumeSpecName "kube-api-access-mpg9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:17:04.122760 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.122728    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpg9r\" (UniqueName: \"kubernetes.io/projected/0695a262-64e0-4a44-8177-8174689e0e54-kube-api-access-mpg9r\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:17:04.122760 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.122755    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0695a262-64e0-4a44-8177-8174689e0e54-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:17:04.139134 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.139103    2579 generic.go:356] "Generic (PLEG): container finished" podID="0695a262-64e0-4a44-8177-8174689e0e54" containerID="b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe" exitCode=0
Sep 17 14:17:04.139247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.139157    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"
Sep 17 14:17:04.139247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.139185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" event={"ID":"0695a262-64e0-4a44-8177-8174689e0e54","Type":"ContainerDied","Data":"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"}
Sep 17 14:17:04.139247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.139237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq" event={"ID":"0695a262-64e0-4a44-8177-8174689e0e54","Type":"ContainerDied","Data":"bc5d845996f29ecb002e65ee992001d3bdb850de3fff8a8b4f8de5d953064fac"}
Sep 17 14:17:04.139368 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.139268    2579 scope.go:117] "RemoveContainer" containerID="b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"
Sep 17 14:17:04.149477 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.149459    2579 scope.go:117] "RemoveContainer" containerID="b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"
Sep 17 14:17:04.149765 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:17:04.149747    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe\": container with ID starting with b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe not found: ID does not exist" containerID="b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"
Sep 17 14:17:04.149831 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.149772    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe"} err="failed to get container status \"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe\": rpc error: code = NotFound desc = could not find container \"b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe\": container with ID starting with b05f7bbbcc09aff0577fc383fd4c1abbcab0b21636f454e5563b0144839e4bfe not found: ID does not exist"
Sep 17 14:17:04.168351 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.168323    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:17:04.173883 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.173861    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq"]
Sep 17 14:17:04.699625 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:04.699592    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0695a262-64e0-4a44-8177-8174689e0e54" path="/var/lib/kubelet/pods/0695a262-64e0-4a44-8177-8174689e0e54/volumes"
Sep 17 14:17:26.930245 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930214    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:17:26.930805 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930784    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0695a262-64e0-4a44-8177-8174689e0e54" containerName="payload-processing"
Sep 17 14:17:26.930887 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930809    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0695a262-64e0-4a44-8177-8174689e0e54" containerName="payload-processing"
Sep 17 14:17:26.930887 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" containerName="payload-pre-processing"
Sep 17 14:17:26.930887 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930848    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" containerName="payload-pre-processing"
Sep 17 14:17:26.930887 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930866    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" containerName="maas-api"
Sep 17 14:17:26.930887 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930875    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" containerName="maas-api"
Sep 17 14:17:26.931161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930978    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="706c5e83-f4ee-4716-8df8-9db6a0b65d2a" containerName="maas-api"
Sep 17 14:17:26.931161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.930996    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0695a262-64e0-4a44-8177-8174689e0e54" containerName="payload-processing"
Sep 17 14:17:26.931161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.931004    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d0c0804-efd5-4b7f-84c5-8611301b04d6" containerName="payload-pre-processing"
Sep 17 14:17:26.934522 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.934494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:26.936733 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.936708    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-2b8275-serving-cert\""
Sep 17 14:17:26.946161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:26.946137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:17:27.026210 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.026180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k498j\" (UniqueName: \"kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.026210 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.026212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.026386 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.026248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.026428 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.026399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.127483 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.127451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k498j\" (UniqueName: \"kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.127483 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.127484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.127699 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.127511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.127699 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.127586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.128245 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.128219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.129878 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.129857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.129930 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.129916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.135673 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.135652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k498j\" (UniqueName: \"kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j\") pod \"maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.246508 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.246455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:27.523116 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.523091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:17:27.529349 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:17:27.526209    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf675c23d_4822_47ba_9559_81c3979bc834.slice/crio-3331b9a9c85cdd357ed3555770b922af0b871b485db072320299fa09dcc94106 WatchSource:0}: Error finding container 3331b9a9c85cdd357ed3555770b922af0b871b485db072320299fa09dcc94106: Status 404 returned error can't find the container with id 3331b9a9c85cdd357ed3555770b922af0b871b485db072320299fa09dcc94106
Sep 17 14:17:27.690466 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.690429    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:17:27.694884 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.694862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.697181 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.697158    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-2b8275\""
Sep 17 14:17:27.697534 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.697511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-2b8275-dockercfg-b2j7q\""
Sep 17 14:17:27.706539 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.706519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:17:27.734370 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.734346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wljgx\" (UniqueName: \"kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.734502 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.734409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.835357 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.835292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wljgx\" (UniqueName: \"kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.835357 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.835352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.835998 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.835979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:27.848903 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:27.848885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wljgx\" (UniqueName: \"kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx\") pod \"payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:28.006079 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.006055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:28.257027 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.256988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" event={"ID":"f675c23d-4822-47ba-9559-81c3979bc834","Type":"ContainerStarted","Data":"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"}
Sep 17 14:17:28.257254 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.257071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" event={"ID":"f675c23d-4822-47ba-9559-81c3979bc834","Type":"ContainerStarted","Data":"3331b9a9c85cdd357ed3555770b922af0b871b485db072320299fa09dcc94106"}
Sep 17 14:17:28.257254 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.257166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:28.279976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.279850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:17:28.281559 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:28.281516    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" podStartSLOduration=1.856397181 podStartE2EDuration="2.281502194s" totalImagesPullingTime="425.105013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:17:28.280493573 +0000 UTC m=+1294.054261244" watchObservedRunningTime="2026-09-17 14:17:28.281502194 +0000 UTC m=+1294.055269863"
Sep 17 14:17:28.282899 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:17:28.282876    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cc3e05_2797_4542_b65d_2d98e5884275.slice/crio-ddb1c30cff4e4b786b5f8aaba4c455225be8a07550e7be9f2014f0fdb57ff1dc WatchSource:0}: Error finding container ddb1c30cff4e4b786b5f8aaba4c455225be8a07550e7be9f2014f0fdb57ff1dc: Status 404 returned error can't find the container with id ddb1c30cff4e4b786b5f8aaba4c455225be8a07550e7be9f2014f0fdb57ff1dc
Sep 17 14:17:29.263474 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:29.263437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" event={"ID":"21cc3e05-2797-4542-b65d-2d98e5884275","Type":"ContainerStarted","Data":"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"}
Sep 17 14:17:29.263878 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:29.263500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" event={"ID":"21cc3e05-2797-4542-b65d-2d98e5884275","Type":"ContainerStarted","Data":"ddb1c30cff4e4b786b5f8aaba4c455225be8a07550e7be9f2014f0fdb57ff1dc"}
Sep 17 14:17:29.263878 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:29.263529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:17:29.281798 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:29.281748    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" podStartSLOduration=2.281735253 podStartE2EDuration="2.281735253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:17:29.279790657 +0000 UTC m=+1295.053558328" watchObservedRunningTime="2026-09-17 14:17:29.281735253 +0000 UTC m=+1295.055502924"
Sep 17 14:17:34.268972 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:34.268944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:17:40.270778 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:17:40.270744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:18:02.165945 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.165914    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:18:02.169705 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.169683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.172153 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.172136    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-6e2bb9-serving-cert\""
Sep 17 14:18:02.184165 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.184140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:18:02.334383 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.334352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzf6z\" (UniqueName: \"kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.334582 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.334409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.334582 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.334439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.334582 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.334490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.435966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.435892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzf6z\" (UniqueName: \"kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.435966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.435960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.436170 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.435989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.436170 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.436070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.436549 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.436517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.438395 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.438373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.438490 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.438396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.445734 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.445711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzf6z\" (UniqueName: \"kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z\") pod \"maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.480008 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.479982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:02.761125 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.761024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:18:02.764553 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:18:02.764525    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99867bf2_2c56_4ae7_90d1_87e9066463d3.slice/crio-59d97c89fa5c90e6e335e9ae36e37b9b1059281d83ca4ec24c82b1b885e4cc48 WatchSource:0}: Error finding container 59d97c89fa5c90e6e335e9ae36e37b9b1059281d83ca4ec24c82b1b885e4cc48: Status 404 returned error can't find the container with id 59d97c89fa5c90e6e335e9ae36e37b9b1059281d83ca4ec24c82b1b885e4cc48
Sep 17 14:18:02.937668 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.937638    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:18:02.947253 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.947228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:02.949702 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.949669    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6e2bb9\""
Sep 17 14:18:02.951311 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:02.951282    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:18:03.041411 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.041342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.041411 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.041394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzg5\" (UniqueName: \"kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.142996 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.142956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzg5\" (UniqueName: \"kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.143207 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.143185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.144124 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.144099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.151654 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.151633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzg5\" (UniqueName: \"kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5\") pod \"payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.259521 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.259496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:03.433248 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.433215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" event={"ID":"99867bf2-2c56-4ae7-90d1-87e9066463d3","Type":"ContainerStarted","Data":"82b939408b4bbb1b125070e6f608ae5b41fc196599c30cc17eb39bad968c3a19"}
Sep 17 14:18:03.433414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.433264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" event={"ID":"99867bf2-2c56-4ae7-90d1-87e9066463d3","Type":"ContainerStarted","Data":"59d97c89fa5c90e6e335e9ae36e37b9b1059281d83ca4ec24c82b1b885e4cc48"}
Sep 17 14:18:03.433414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.433323    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:03.462096 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.462024    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" podStartSLOduration=1.036744906 podStartE2EDuration="1.462009122s" totalImagesPullingTime="425.264216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:18:03.459915043 +0000 UTC m=+1329.233682712" watchObservedRunningTime="2026-09-17 14:18:03.462009122 +0000 UTC m=+1329.235776792"
Sep 17 14:18:03.537157 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:03.537132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:18:03.539203 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:18:03.539180    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838b7548_1608_460c_85e3_bf31fdabb2e0.slice/crio-a2b22a08463c82309f3b510cad2168a24c173f13387b3fec220afd9092020634 WatchSource:0}: Error finding container a2b22a08463c82309f3b510cad2168a24c173f13387b3fec220afd9092020634: Status 404 returned error can't find the container with id a2b22a08463c82309f3b510cad2168a24c173f13387b3fec220afd9092020634
Sep 17 14:18:04.439619 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:04.439586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" event={"ID":"838b7548-1608-460c-85e3-bf31fdabb2e0","Type":"ContainerStarted","Data":"cc78ecfd4f8cd2a67d53b8642289a15206641067a0909a538723f704bfd1c1fc"}
Sep 17 14:18:04.440028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:04.439846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:04.440028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:04.439891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" event={"ID":"838b7548-1608-460c-85e3-bf31fdabb2e0","Type":"ContainerStarted","Data":"a2b22a08463c82309f3b510cad2168a24c173f13387b3fec220afd9092020634"}
Sep 17 14:18:04.457234 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:04.457191    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" podStartSLOduration=2.457175621 podStartE2EDuration="2.457175621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:18:04.456569374 +0000 UTC m=+1330.230337045" watchObservedRunningTime="2026-09-17 14:18:04.457175621 +0000 UTC m=+1330.230943324"
Sep 17 14:18:09.445354 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:09.445324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:18:15.447094 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:15.447033    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:18:44.999403 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:44.999369    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:18:44.999986 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:44.999588    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" podUID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" containerName="payload-processing" containerID="cri-o://42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068" gracePeriod=30
Sep 17 14:18:45.267491 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.267462    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:18:45.412217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.412185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdx7\" (UniqueName: \"kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7\") pod \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") "
Sep 17 14:18:45.412375 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.412232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume\") pod \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\" (UID: \"ada3ca4a-a86d-4464-ac6c-3822c10cb10d\") "
Sep 17 14:18:45.412576 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.412553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ada3ca4a-a86d-4464-ac6c-3822c10cb10d" (UID: "ada3ca4a-a86d-4464-ac6c-3822c10cb10d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:18:45.412690 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.412674    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:18:45.414244 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.414220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7" (OuterVolumeSpecName: "kube-api-access-7gdx7") pod "ada3ca4a-a86d-4464-ac6c-3822c10cb10d" (UID: "ada3ca4a-a86d-4464-ac6c-3822c10cb10d"). InnerVolumeSpecName "kube-api-access-7gdx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:18:45.514177 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.514101    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdx7\" (UniqueName: \"kubernetes.io/projected/ada3ca4a-a86d-4464-ac6c-3822c10cb10d-kube-api-access-7gdx7\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:18:45.643618 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.643583    2579 generic.go:356] "Generic (PLEG): container finished" podID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" containerID="42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068" exitCode=0
Sep 17 14:18:45.643768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.643622    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"
Sep 17 14:18:45.643768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.643669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" event={"ID":"ada3ca4a-a86d-4464-ac6c-3822c10cb10d","Type":"ContainerDied","Data":"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"}
Sep 17 14:18:45.643768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.643724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq" event={"ID":"ada3ca4a-a86d-4464-ac6c-3822c10cb10d","Type":"ContainerDied","Data":"de3aee8f62bff10a69b638bd730a98029879eb731ecc19ed991cdc2b110996c9"}
Sep 17 14:18:45.643768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.643755    2579 scope.go:117] "RemoveContainer" containerID="42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"
Sep 17 14:18:45.654301 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.654279    2579 scope.go:117] "RemoveContainer" containerID="42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"
Sep 17 14:18:45.654591 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:18:45.654572    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068\": container with ID starting with 42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068 not found: ID does not exist" containerID="42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"
Sep 17 14:18:45.654654 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.654603    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068"} err="failed to get container status \"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068\": rpc error: code = NotFound desc = could not find container \"42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068\": container with ID starting with 42ef5fadf6ca2a063557c22da23ad326482f32a1feec51ad313974a9edde0068 not found: ID does not exist"
Sep 17 14:18:45.666706 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.666681    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:18:45.672872 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:45.672851    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq"]
Sep 17 14:18:46.699912 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:46.699871    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" path="/var/lib/kubelet/pods/ada3ca4a-a86d-4464-ac6c-3822c10cb10d/volumes"
Sep 17 14:18:48.293220 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.293184    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:18:48.293655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.293584    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" containerName="payload-processing"
Sep 17 14:18:48.293655 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.293595    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" containerName="payload-processing"
Sep 17 14:18:48.293749 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.293686    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada3ca4a-a86d-4464-ac6c-3822c10cb10d" containerName="payload-processing"
Sep 17 14:18:48.298230 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.298211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.300354 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.300336    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5cdd59e7\""
Sep 17 14:18:48.300485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.300465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5cdd59e7-dockercfg-2xqs4\""
Sep 17 14:18:48.307269 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.307245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:18:48.439824 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.439788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58thx\" (UniqueName: \"kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.439995 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.439843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.540899 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.540831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58thx\" (UniqueName: \"kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.540899 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.540889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.541789 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.541765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.549777 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.549718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58thx\" (UniqueName: \"kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx\") pod \"payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.609368 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.609346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:48.893368 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:48.893337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:18:48.895857 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:18:48.895834    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8954e05_bc5d_44ed_9d56_9b589f6cf541.slice/crio-b8b974570df3a72ed02e9fcba9b4cfea5d9bc4dde24815671570ef1afef2c095 WatchSource:0}: Error finding container b8b974570df3a72ed02e9fcba9b4cfea5d9bc4dde24815671570ef1afef2c095: Status 404 returned error can't find the container with id b8b974570df3a72ed02e9fcba9b4cfea5d9bc4dde24815671570ef1afef2c095
Sep 17 14:18:49.672845 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:49.672803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" event={"ID":"d8954e05-bc5d-44ed-9d56-9b589f6cf541","Type":"ContainerStarted","Data":"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"}
Sep 17 14:18:49.673325 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:49.672872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" event={"ID":"d8954e05-bc5d-44ed-9d56-9b589f6cf541","Type":"ContainerStarted","Data":"b8b974570df3a72ed02e9fcba9b4cfea5d9bc4dde24815671570ef1afef2c095"}
Sep 17 14:18:49.673325 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:49.672987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:18:49.696793 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:18:49.696743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" podStartSLOduration=1.696728469 podStartE2EDuration="1.696728469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:18:49.694433587 +0000 UTC m=+1375.468201257" watchObservedRunningTime="2026-09-17 14:18:49.696728469 +0000 UTC m=+1375.470496139"
Sep 17 14:19:00.679765 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:00.679735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:19:11.800976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:11.800943    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:19:11.801388 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:11.801175    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" podUID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" containerName="maas-api" containerID="cri-o://722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0" gracePeriod=30
Sep 17 14:19:12.046856 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.046831    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:19:12.150767 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.150738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls\") pod \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") "
Sep 17 14:19:12.150941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.150794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca\") pod \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") "
Sep 17 14:19:12.150941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.150852    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs\") pod \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") "
Sep 17 14:19:12.150941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.150878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh8t4\" (UniqueName: \"kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4\") pod \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\" (UID: \"d631acd5-061a-40a4-b5d2-1407f22a9f1e\") "
Sep 17 14:19:12.151238 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.151216    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d631acd5-061a-40a4-b5d2-1407f22a9f1e" (UID: "d631acd5-061a-40a4-b5d2-1407f22a9f1e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:19:12.153058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.153021    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d631acd5-061a-40a4-b5d2-1407f22a9f1e" (UID: "d631acd5-061a-40a4-b5d2-1407f22a9f1e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:19:12.153168 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.153027    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4" (OuterVolumeSpecName: "kube-api-access-fh8t4") pod "d631acd5-061a-40a4-b5d2-1407f22a9f1e" (UID: "d631acd5-061a-40a4-b5d2-1407f22a9f1e"). InnerVolumeSpecName "kube-api-access-fh8t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:19:12.153372 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.153349    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d631acd5-061a-40a4-b5d2-1407f22a9f1e" (UID: "d631acd5-061a-40a4-b5d2-1407f22a9f1e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:19:12.251941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.251909    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:19:12.251941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.251936    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh8t4\" (UniqueName: \"kubernetes.io/projected/d631acd5-061a-40a4-b5d2-1407f22a9f1e-kube-api-access-fh8t4\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:19:12.251941 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.251946    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d631acd5-061a-40a4-b5d2-1407f22a9f1e-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:19:12.252190 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.251955    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d631acd5-061a-40a4-b5d2-1407f22a9f1e-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:19:12.790079 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.790033    2579 generic.go:356] "Generic (PLEG): container finished" podID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" containerID="722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0" exitCode=0
Sep 17 14:19:12.790217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.790098    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"
Sep 17 14:19:12.790217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.790128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" event={"ID":"d631acd5-061a-40a4-b5d2-1407f22a9f1e","Type":"ContainerDied","Data":"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"}
Sep 17 14:19:12.790217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.790181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4" event={"ID":"d631acd5-061a-40a4-b5d2-1407f22a9f1e","Type":"ContainerDied","Data":"8fd3a203b4ec15e01635cb8851f2fe90ce4e65ad45194380d177055e1f0c8274"}
Sep 17 14:19:12.790217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.790203    2579 scope.go:117] "RemoveContainer" containerID="722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"
Sep 17 14:19:12.799724 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.799707    2579 scope.go:117] "RemoveContainer" containerID="722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"
Sep 17 14:19:12.799983 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:19:12.799963    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0\": container with ID starting with 722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0 not found: ID does not exist" containerID="722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"
Sep 17 14:19:12.800029 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.799991    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0"} err="failed to get container status \"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0\": rpc error: code = NotFound desc = could not find container \"722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0\": container with ID starting with 722f606d39d746a194958895d78e363dfa01a958a9ef30ebf2198b1db12d3bb0 not found: ID does not exist"
Sep 17 14:19:12.807579 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.807552    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:19:12.809409 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:12.809391    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fe6ee5-6546459d8b-tqcx4"]
Sep 17 14:19:14.699671 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:14.699639    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" path="/var/lib/kubelet/pods/d631acd5-061a-40a4-b5d2-1407f22a9f1e/volumes"
Sep 17 14:19:28.915524 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.915480    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:19:28.916148 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.915925    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" containerName="maas-api"
Sep 17 14:19:28.916148 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.915940    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" containerName="maas-api"
Sep 17 14:19:28.916148 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.916020    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d631acd5-061a-40a4-b5d2-1407f22a9f1e" containerName="maas-api"
Sep 17 14:19:28.919158 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.919136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:28.922102 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.922079    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-b88b90-serving-cert\""
Sep 17 14:19:28.929828 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:28.929806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:19:29.008846 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.008815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.008989 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.008852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.008989 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.008877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.009121 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.008980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5ws\" (UniqueName: \"kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.110247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.110214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5ws\" (UniqueName: \"kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.110414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.110308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.110414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.110329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.110414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.110359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.111102 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.111037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.112849 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.112826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.112936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.112867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.118974 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.118953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5ws\" (UniqueName: \"kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws\") pod \"maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.234165 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.234104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:29.511218 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.511155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:19:29.514306 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:19:29.514277    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569a4380_217f_4357_8803_f9da951afa2b.slice/crio-6b48c13bc2caf97339a7ce1aeb6578deb76bd2ba8d152757a52143461f6d0f2f WatchSource:0}: Error finding container 6b48c13bc2caf97339a7ce1aeb6578deb76bd2ba8d152757a52143461f6d0f2f: Status 404 returned error can't find the container with id 6b48c13bc2caf97339a7ce1aeb6578deb76bd2ba8d152757a52143461f6d0f2f
Sep 17 14:19:29.675149 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.675114    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:19:29.679929 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.679910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.682421 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.682402    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-b88b90-dockercfg-fbkqs\""
Sep 17 14:19:29.682499 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.682419    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-b88b90\""
Sep 17 14:19:29.692153 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.692128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:19:29.816782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.816695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.816939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.816795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdxjr\" (UniqueName: \"kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.884251 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.884215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" event={"ID":"569a4380-217f-4357-8803-f9da951afa2b","Type":"ContainerStarted","Data":"6b48c13bc2caf97339a7ce1aeb6578deb76bd2ba8d152757a52143461f6d0f2f"}
Sep 17 14:19:29.917617 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.917591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdxjr\" (UniqueName: \"kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.918008 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.917673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.918354 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.918335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.927668 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.927648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdxjr\" (UniqueName: \"kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr\") pod \"payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:29.992197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:29.992169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:30.278091 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.278011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:19:30.280659 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:19:30.280633    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19514a5_ea6b_4dbf_9629_abdb7a45f0cc.slice/crio-83d5a55e6eda5e22d165ea03e0454b6becd548f797583dfdd7a2b35ec87f09ae WatchSource:0}: Error finding container 83d5a55e6eda5e22d165ea03e0454b6becd548f797583dfdd7a2b35ec87f09ae: Status 404 returned error can't find the container with id 83d5a55e6eda5e22d165ea03e0454b6becd548f797583dfdd7a2b35ec87f09ae
Sep 17 14:19:30.891907 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.891863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" event={"ID":"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc","Type":"ContainerStarted","Data":"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"}
Sep 17 14:19:30.892277 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.891945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:19:30.892277 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.891970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" event={"ID":"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc","Type":"ContainerStarted","Data":"83d5a55e6eda5e22d165ea03e0454b6becd548f797583dfdd7a2b35ec87f09ae"}
Sep 17 14:19:30.893740 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.893709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" event={"ID":"569a4380-217f-4357-8803-f9da951afa2b","Type":"ContainerStarted","Data":"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"}
Sep 17 14:19:30.893875 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.893792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:30.911521 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.911476    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" podStartSLOduration=1.91145761 podStartE2EDuration="1.91145761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:30.909136923 +0000 UTC m=+1416.682904583" watchObservedRunningTime="2026-09-17 14:19:30.91145761 +0000 UTC m=+1416.685225280"
Sep 17 14:19:30.927946 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:30.927904    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" podStartSLOduration=2.30820713 podStartE2EDuration="2.927891012s" totalImagesPullingTime="619.683882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:30.927152157 +0000 UTC m=+1416.700919830" watchObservedRunningTime="2026-09-17 14:19:30.927891012 +0000 UTC m=+1416.701658682"
Sep 17 14:19:36.904442 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:36.904414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:19:41.901976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:19:41.901937    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:20:00.337220 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.337185    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:20:00.342172 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.342151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.344563 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.344542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b79988\""
Sep 17 14:20:00.344699 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.344682    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-b79988-dockercfg-tcdh7\""
Sep 17 14:20:00.351157 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.351134    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:20:00.404013 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.403983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.404160 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.404073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8c7\" (UniqueName: \"kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.504880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.504837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8c7\" (UniqueName: \"kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.505070 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.504942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.505680 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.505661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.513903 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.513871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8c7\" (UniqueName: \"kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7\") pod \"payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.654121 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.654091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:00.945910 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:00.945877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:20:00.947196 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:20:00.947161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002cb747_882a_4cd6_a7c7_997d811f6434.slice/crio-44a3530fe1b39da05b3e45da9f089d6593b204845849112dec05a4c0e73f1eb9 WatchSource:0}: Error finding container 44a3530fe1b39da05b3e45da9f089d6593b204845849112dec05a4c0e73f1eb9: Status 404 returned error can't find the container with id 44a3530fe1b39da05b3e45da9f089d6593b204845849112dec05a4c0e73f1eb9
Sep 17 14:20:01.049082 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:01.049033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" event={"ID":"002cb747-882a-4cd6-a7c7-997d811f6434","Type":"ContainerStarted","Data":"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"}
Sep 17 14:20:01.049245 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:01.049098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" event={"ID":"002cb747-882a-4cd6-a7c7-997d811f6434","Type":"ContainerStarted","Data":"44a3530fe1b39da05b3e45da9f089d6593b204845849112dec05a4c0e73f1eb9"}
Sep 17 14:20:01.049245 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:01.049125    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:01.072332 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:01.072273    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" podStartSLOduration=1.072254005 podStartE2EDuration="1.072254005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:20:01.069577436 +0000 UTC m=+1446.843345122" watchObservedRunningTime="2026-09-17 14:20:01.072254005 +0000 UTC m=+1446.846021676"
Sep 17 14:20:12.058128 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:12.058097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:20:54.724357 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:54.724325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:20:54.727127 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:20:54.727104    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:21:28.688369 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:28.688288    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:21:28.688841 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:28.688532    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" podUID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" containerName="payload-pre-processing" containerID="cri-o://3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9" gracePeriod=30
Sep 17 14:21:28.961006 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:28.960981    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:21:29.021737 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.021708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58thx\" (UniqueName: \"kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx\") pod \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") "
Sep 17 14:21:29.021934 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.021775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume\") pod \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\" (UID: \"d8954e05-bc5d-44ed-9d56-9b589f6cf541\") "
Sep 17 14:21:29.022241 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.022217    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8954e05-bc5d-44ed-9d56-9b589f6cf541" (UID: "d8954e05-bc5d-44ed-9d56-9b589f6cf541"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:21:29.024091 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.024024    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx" (OuterVolumeSpecName: "kube-api-access-58thx") pod "d8954e05-bc5d-44ed-9d56-9b589f6cf541" (UID: "d8954e05-bc5d-44ed-9d56-9b589f6cf541"). InnerVolumeSpecName "kube-api-access-58thx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:21:29.122766 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.122726    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8954e05-bc5d-44ed-9d56-9b589f6cf541-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:21:29.122766 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.122760    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58thx\" (UniqueName: \"kubernetes.io/projected/d8954e05-bc5d-44ed-9d56-9b589f6cf541-kube-api-access-58thx\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:21:29.496108 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.496072    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" containerID="3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9" exitCode=0
Sep 17 14:21:29.496290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.496115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" event={"ID":"d8954e05-bc5d-44ed-9d56-9b589f6cf541","Type":"ContainerDied","Data":"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"}
Sep 17 14:21:29.496290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.496155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f" event={"ID":"d8954e05-bc5d-44ed-9d56-9b589f6cf541","Type":"ContainerDied","Data":"b8b974570df3a72ed02e9fcba9b4cfea5d9bc4dde24815671570ef1afef2c095"}
Sep 17 14:21:29.496290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.496178    2579 scope.go:117] "RemoveContainer" containerID="3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"
Sep 17 14:21:29.496290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.496120    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"
Sep 17 14:21:29.509309 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.509282    2579 scope.go:117] "RemoveContainer" containerID="3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"
Sep 17 14:21:29.509681 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:21:29.509657    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9\": container with ID starting with 3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9 not found: ID does not exist" containerID="3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"
Sep 17 14:21:29.509767 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.509690    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9"} err="failed to get container status \"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9\": rpc error: code = NotFound desc = could not find container \"3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9\": container with ID starting with 3d5ccbeca234111a74298112c94d6972ac02a4af97c3e7afbdbff3bee45d9ea9 not found: ID does not exist"
Sep 17 14:21:29.530796 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.530768    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:21:29.535561 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:29.535537    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f"]
Sep 17 14:21:30.701273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:21:30.701242    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" path="/var/lib/kubelet/pods/d8954e05-bc5d-44ed-9d56-9b589f6cf541/volumes"
Sep 17 14:23:43.637702 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.637657    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:23:43.638291 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.638272    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" containerName="payload-pre-processing"
Sep 17 14:23:43.638353 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.638295    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" containerName="payload-pre-processing"
Sep 17 14:23:43.638431 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.638416    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8954e05-bc5d-44ed-9d56-9b589f6cf541" containerName="payload-pre-processing"
Sep 17 14:23:43.641496 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.641473    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.643608 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.643588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-6fce83-serving-cert\""
Sep 17 14:23:43.652395 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.652374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:23:43.705235 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.705205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.705397 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.705246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.705397 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.705269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.705397 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.705354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8wl\" (UniqueName: \"kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.805946 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.805916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.806155 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.805954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.806155 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.806006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8wl\" (UniqueName: \"kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.806155 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:23:43.806081    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-serving-cert: secret "maas-api-e2e-api-a-6fce83-serving-cert" not found
Sep 17 14:23:43.806155 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.806135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.806155 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:23:43.806154    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls podName:751772bc-e660-4371-bbd4-1821c44d5cb4 nodeName:}" failed. No retries permitted until 2026-09-17 14:23:44.306137208 +0000 UTC m=+1670.079904856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls") pod "maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" (UID: "751772bc-e660-4371-bbd4-1821c44d5cb4") : secret "maas-api-e2e-api-a-6fce83-serving-cert" not found
Sep 17 14:23:43.806777 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.806756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.808508 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.808491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:43.822268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:43.822239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8wl\" (UniqueName: \"kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:44.313515 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:44.313476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:44.315844 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:44.315814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:44.555012 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:44.554971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:44.838690 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:44.838661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:23:44.840025 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:23:44.839994    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751772bc_e660_4371_bbd4_1821c44d5cb4.slice/crio-6d07e59acbcbf0edc9ce88da3547209a2522a897e3f433123f300a85a662b3d0 WatchSource:0}: Error finding container 6d07e59acbcbf0edc9ce88da3547209a2522a897e3f433123f300a85a662b3d0: Status 404 returned error can't find the container with id 6d07e59acbcbf0edc9ce88da3547209a2522a897e3f433123f300a85a662b3d0
Sep 17 14:23:44.841493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:44.841475    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:23:45.168366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:45.168332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" event={"ID":"751772bc-e660-4371-bbd4-1821c44d5cb4","Type":"ContainerStarted","Data":"6d07e59acbcbf0edc9ce88da3547209a2522a897e3f433123f300a85a662b3d0"}
Sep 17 14:23:46.175486 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:46.175454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" event={"ID":"751772bc-e660-4371-bbd4-1821c44d5cb4","Type":"ContainerStarted","Data":"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"}
Sep 17 14:23:46.175868 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:46.175543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:23:46.208747 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:46.208688    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" podStartSLOduration=2.802827958 podStartE2EDuration="3.208668766s" totalImagesPullingTime="405.840808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:23:46.206636557 +0000 UTC m=+1671.980404241" watchObservedRunningTime="2026-09-17 14:23:46.208668766 +0000 UTC m=+1671.982436438"
Sep 17 14:23:52.186234 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:23:52.186204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:24:15.935969 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:15.935931    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:24:15.939585 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:15.939569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:15.944095 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:15.944072    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a77c87-serving-cert\""
Sep 17 14:24:15.965421 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:15.965397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:24:16.101290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.101256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.101492 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.101328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.101492 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.101415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.101492 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.101473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h69kf\" (UniqueName: \"kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.202402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.202322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.202402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.202380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.202579 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.202415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h69kf\" (UniqueName: \"kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.202579 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.202449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.203156 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.203132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.204900 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.204871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.204983 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.204881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.210980 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.210959    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h69kf\" (UniqueName: \"kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf\") pod \"maas-api-e2e-api-b-a77c87-68d8757898-qrzpf\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.250057 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.250010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:16.524515 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.524488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:24:16.526738 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:24:16.526704    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd78915_abfe_4bb9_a168_1e1b4a3b6c93.slice/crio-8b0a11b88cfbac7a72fcf01f516c0fee65799db5b2edbdfba604010c1233219e WatchSource:0}: Error finding container 8b0a11b88cfbac7a72fcf01f516c0fee65799db5b2edbdfba604010c1233219e: Status 404 returned error can't find the container with id 8b0a11b88cfbac7a72fcf01f516c0fee65799db5b2edbdfba604010c1233219e
Sep 17 14:24:16.777776 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.777703    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:24:16.783097 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.783075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:16.785329 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.785307    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a77c87\""
Sep 17 14:24:16.785441 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.785398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a77c87-dockercfg-zsjmx\""
Sep 17 14:24:16.792748 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.792726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:24:16.909177 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.909128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:16.909335 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:16.909203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz24f\" (UniqueName: \"kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.010858 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.010823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.011423 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.010884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz24f\" (UniqueName: \"kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.011654 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.011633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.019747 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.019725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz24f\" (UniqueName: \"kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f\") pod \"payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.094765 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.094738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:17.339213 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.339177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" event={"ID":"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93","Type":"ContainerStarted","Data":"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"}
Sep 17 14:24:17.339402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.339237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" event={"ID":"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93","Type":"ContainerStarted","Data":"8b0a11b88cfbac7a72fcf01f516c0fee65799db5b2edbdfba604010c1233219e"}
Sep 17 14:24:17.339402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.339261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:17.357927 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.357823    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" podStartSLOduration=2.073214085 podStartE2EDuration="2.357794625s" totalImagesPullingTime="284.58054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:17.356864129 +0000 UTC m=+1703.130631792" watchObservedRunningTime="2026-09-17 14:24:17.357794625 +0000 UTC m=+1703.131562293"
Sep 17 14:24:17.372747 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:17.372690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:24:17.375078 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:24:17.375048    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda744ffb4_9e12_428c_8466_aae158d45c7f.slice/crio-48ba823aee637d9bc66456d6bddbcbe1a1f5ab0b271be3b97b4f30eab4bf66b3 WatchSource:0}: Error finding container 48ba823aee637d9bc66456d6bddbcbe1a1f5ab0b271be3b97b4f30eab4bf66b3: Status 404 returned error can't find the container with id 48ba823aee637d9bc66456d6bddbcbe1a1f5ab0b271be3b97b4f30eab4bf66b3
Sep 17 14:24:18.346212 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:18.346174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" event={"ID":"a744ffb4-9e12-428c-8466-aae158d45c7f","Type":"ContainerStarted","Data":"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"}
Sep 17 14:24:18.346730 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:18.346240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:18.346730 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:18.346264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" event={"ID":"a744ffb4-9e12-428c-8466-aae158d45c7f","Type":"ContainerStarted","Data":"48ba823aee637d9bc66456d6bddbcbe1a1f5ab0b271be3b97b4f30eab4bf66b3"}
Sep 17 14:24:18.364463 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:18.364409    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" podStartSLOduration=2.364392176 podStartE2EDuration="2.364392176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:18.362473371 +0000 UTC m=+1704.136241044" watchObservedRunningTime="2026-09-17 14:24:18.364392176 +0000 UTC m=+1704.138159846"
Sep 17 14:24:23.352129 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:23.352094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:24:29.354008 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:29.353976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:24:58.187437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.187402    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:24:58.188329 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.188292    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" podUID="93c24e80-bb83-4148-ad82-72cd3de1ba07" containerName="maas-api" containerID="cri-o://e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca" gracePeriod=30
Sep 17 14:24:58.251649 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.251615    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:24:58.253391 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.253320    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" podUID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" containerName="payload-processing" containerID="cri-o://6559f6ac011be0b5475f21bc5af52bb0ad5aefd1618abd7ea012f0e20083d7d0" gracePeriod=30
Sep 17 14:24:58.514613 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.514585    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:24:58.562829 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.562799    2579 generic.go:356] "Generic (PLEG): container finished" podID="93c24e80-bb83-4148-ad82-72cd3de1ba07" containerID="e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca" exitCode=0
Sep 17 14:24:58.563013 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.562994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" event={"ID":"93c24e80-bb83-4148-ad82-72cd3de1ba07","Type":"ContainerDied","Data":"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"}
Sep 17 14:24:58.563100 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.563084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5" event={"ID":"93c24e80-bb83-4148-ad82-72cd3de1ba07","Type":"ContainerDied","Data":"c1c4e7f01825d6a4b78618215ea9f1408f33b68e9bc2b90aec1929a1ccb2a9bf"}
Sep 17 14:24:58.563145 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.563122    2579 scope.go:117] "RemoveContainer" containerID="e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"
Sep 17 14:24:58.563288 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.563274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"
Sep 17 14:24:58.565025 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.564997    2579 generic.go:356] "Generic (PLEG): container finished" podID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" containerID="6559f6ac011be0b5475f21bc5af52bb0ad5aefd1618abd7ea012f0e20083d7d0" exitCode=0
Sep 17 14:24:58.565151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.565077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" event={"ID":"65271e4c-6ef4-495d-9ac4-b0a7a7c29130","Type":"ContainerDied","Data":"6559f6ac011be0b5475f21bc5af52bb0ad5aefd1618abd7ea012f0e20083d7d0"}
Sep 17 14:24:58.565151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.565121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp" event={"ID":"65271e4c-6ef4-495d-9ac4-b0a7a7c29130","Type":"ContainerDied","Data":"5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8"}
Sep 17 14:24:58.565151 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.565144    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fa77bedf97620f72ab665e56dda1125d42d00e3f16867263ab14ae2258777c8"
Sep 17 14:24:58.570271 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.570230    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:24:58.573238 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.573214    2579 scope.go:117] "RemoveContainer" containerID="e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"
Sep 17 14:24:58.573540 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:24:58.573520    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca\": container with ID starting with e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca not found: ID does not exist" containerID="e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"
Sep 17 14:24:58.573596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.573549    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca"} err="failed to get container status \"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca\": rpc error: code = NotFound desc = could not find container \"e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca\": container with ID starting with e09c3ce4f15c836508adf9292caa69cd78788e2df6cd51c0fa001793595466ca not found: ID does not exist"
Sep 17 14:24:58.705826 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.705800    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4gkh\" (UniqueName: \"kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh\") pod \"93c24e80-bb83-4148-ad82-72cd3de1ba07\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") "
Sep 17 14:24:58.705967 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.705840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume\") pod \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") "
Sep 17 14:24:58.705967 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.705950    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca\") pod \"93c24e80-bb83-4148-ad82-72cd3de1ba07\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") "
Sep 17 14:24:58.706074 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.705990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs\") pod \"93c24e80-bb83-4148-ad82-72cd3de1ba07\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") "
Sep 17 14:24:58.706074 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls\") pod \"93c24e80-bb83-4148-ad82-72cd3de1ba07\" (UID: \"93c24e80-bb83-4148-ad82-72cd3de1ba07\") "
Sep 17 14:24:58.706199 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4tl8\" (UniqueName: \"kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8\") pod \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\" (UID: \"65271e4c-6ef4-495d-9ac4-b0a7a7c29130\") "
Sep 17 14:24:58.706311 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "65271e4c-6ef4-495d-9ac4-b0a7a7c29130" (UID: "65271e4c-6ef4-495d-9ac4-b0a7a7c29130"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:24:58.706311 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706295    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93c24e80-bb83-4148-ad82-72cd3de1ba07" (UID: "93c24e80-bb83-4148-ad82-72cd3de1ba07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:24:58.706429 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706415    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.706493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.706431    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c24e80-bb83-4148-ad82-72cd3de1ba07-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.708240 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.708215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93c24e80-bb83-4148-ad82-72cd3de1ba07" (UID: "93c24e80-bb83-4148-ad82-72cd3de1ba07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:58.708349 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.708234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93c24e80-bb83-4148-ad82-72cd3de1ba07" (UID: "93c24e80-bb83-4148-ad82-72cd3de1ba07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:58.708535 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.708505    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8" (OuterVolumeSpecName: "kube-api-access-v4tl8") pod "65271e4c-6ef4-495d-9ac4-b0a7a7c29130" (UID: "65271e4c-6ef4-495d-9ac4-b0a7a7c29130"). InnerVolumeSpecName "kube-api-access-v4tl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:58.708633 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.708534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh" (OuterVolumeSpecName: "kube-api-access-c4gkh") pod "93c24e80-bb83-4148-ad82-72cd3de1ba07" (UID: "93c24e80-bb83-4148-ad82-72cd3de1ba07"). InnerVolumeSpecName "kube-api-access-c4gkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:58.807564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.807497    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.807564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.807522    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c24e80-bb83-4148-ad82-72cd3de1ba07-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.807564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.807531    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4tl8\" (UniqueName: \"kubernetes.io/projected/65271e4c-6ef4-495d-9ac4-b0a7a7c29130-kube-api-access-v4tl8\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.807564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.807540    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4gkh\" (UniqueName: \"kubernetes.io/projected/93c24e80-bb83-4148-ad82-72cd3de1ba07-kube-api-access-c4gkh\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:24:58.885879 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.885854    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:24:58.889984 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:58.889960    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d9b17d-56f78485c-bd8w5"]
Sep 17 14:24:59.571447 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:59.571357    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"
Sep 17 14:24:59.595133 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:59.595105    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:24:59.601751 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:24:59.601728    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp"]
Sep 17 14:25:00.699280 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:00.699250    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" path="/var/lib/kubelet/pods/65271e4c-6ef4-495d-9ac4-b0a7a7c29130/volumes"
Sep 17 14:25:00.699677 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:00.699668    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c24e80-bb83-4148-ad82-72cd3de1ba07" path="/var/lib/kubelet/pods/93c24e80-bb83-4148-ad82-72cd3de1ba07/volumes"
Sep 17 14:25:02.440308 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.440269    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:25:02.586450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.586386    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" podUID="751772bc-e660-4371-bbd4-1821c44d5cb4" containerName="maas-api" containerID="cri-o://2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e" gracePeriod=30
Sep 17 14:25:02.843159 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.843130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:25:02.944455 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.944416    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj8wl\" (UniqueName: \"kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl\") pod \"751772bc-e660-4371-bbd4-1821c44d5cb4\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") "
Sep 17 14:25:02.944817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.944490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") pod \"751772bc-e660-4371-bbd4-1821c44d5cb4\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") "
Sep 17 14:25:02.944817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.944537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs\") pod \"751772bc-e660-4371-bbd4-1821c44d5cb4\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") "
Sep 17 14:25:02.944817 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.944605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca\") pod \"751772bc-e660-4371-bbd4-1821c44d5cb4\" (UID: \"751772bc-e660-4371-bbd4-1821c44d5cb4\") "
Sep 17 14:25:02.945138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.945114    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "751772bc-e660-4371-bbd4-1821c44d5cb4" (UID: "751772bc-e660-4371-bbd4-1821c44d5cb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:02.946494 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.946465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl" (OuterVolumeSpecName: "kube-api-access-nj8wl") pod "751772bc-e660-4371-bbd4-1821c44d5cb4" (UID: "751772bc-e660-4371-bbd4-1821c44d5cb4"). InnerVolumeSpecName "kube-api-access-nj8wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:02.946701 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.946681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "751772bc-e660-4371-bbd4-1821c44d5cb4" (UID: "751772bc-e660-4371-bbd4-1821c44d5cb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:02.946752 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:02.946710    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "751772bc-e660-4371-bbd4-1821c44d5cb4" (UID: "751772bc-e660-4371-bbd4-1821c44d5cb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:03.046469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.046394    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:03.046469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.046424    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751772bc-e660-4371-bbd4-1821c44d5cb4-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:03.046469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.046436    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj8wl\" (UniqueName: \"kubernetes.io/projected/751772bc-e660-4371-bbd4-1821c44d5cb4-kube-api-access-nj8wl\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:03.046469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.046444    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751772bc-e660-4371-bbd4-1821c44d5cb4-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:03.592400 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.592367    2579 generic.go:356] "Generic (PLEG): container finished" podID="751772bc-e660-4371-bbd4-1821c44d5cb4" containerID="2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e" exitCode=0
Sep 17 14:25:03.592797 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.592413    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"
Sep 17 14:25:03.592797 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.592449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" event={"ID":"751772bc-e660-4371-bbd4-1821c44d5cb4","Type":"ContainerDied","Data":"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"}
Sep 17 14:25:03.592797 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.592498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44" event={"ID":"751772bc-e660-4371-bbd4-1821c44d5cb4","Type":"ContainerDied","Data":"6d07e59acbcbf0edc9ce88da3547209a2522a897e3f433123f300a85a662b3d0"}
Sep 17 14:25:03.592797 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.592521    2579 scope.go:117] "RemoveContainer" containerID="2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"
Sep 17 14:25:03.601848 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.601830    2579 scope.go:117] "RemoveContainer" containerID="2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"
Sep 17 14:25:03.602110 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:25:03.602091    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e\": container with ID starting with 2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e not found: ID does not exist" containerID="2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"
Sep 17 14:25:03.602175 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.602123    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e"} err="failed to get container status \"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e\": rpc error: code = NotFound desc = could not find container \"2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e\": container with ID starting with 2236c2b7c3d6f862708dc570593128c5d739527735a362b87bb79bb290181a4e not found: ID does not exist"
Sep 17 14:25:03.614254 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.614230    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:25:03.618144 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:03.618126    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6fce83-7f4d4d8db5-ngf44"]
Sep 17 14:25:04.699229 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:04.699193    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751772bc-e660-4371-bbd4-1821c44d5cb4" path="/var/lib/kubelet/pods/751772bc-e660-4371-bbd4-1821c44d5cb4/volumes"
Sep 17 14:25:27.646492 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:27.646454    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:25:27.646962 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:27.646723    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" podUID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" containerName="maas-api" containerID="cri-o://5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57" gracePeriod=30
Sep 17 14:25:27.711772 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:27.711732    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:25:27.712028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:27.711993    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" podUID="a744ffb4-9e12-428c-8466-aae158d45c7f" containerName="payload-pre-processing" containerID="cri-o://3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36" gracePeriod=30
Sep 17 14:25:27.980785 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:27.980757    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:25:28.016424 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.016313    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:25:28.077924 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.077890    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca\") pod \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") "
Sep 17 14:25:28.078122 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.077941    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs\") pod \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") "
Sep 17 14:25:28.078122 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.078052    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls\") pod \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") "
Sep 17 14:25:28.078267 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.078123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h69kf\" (UniqueName: \"kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf\") pod \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\" (UID: \"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93\") "
Sep 17 14:25:28.078368 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.078337    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" (UID: "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:28.078551 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.078529    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.080099 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.080077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" (UID: "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:28.080604 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.080575    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" (UID: "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:28.080679 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.080662    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf" (OuterVolumeSpecName: "kube-api-access-h69kf") pod "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" (UID: "fbd78915-abfe-4bb9-a168-1e1b4a3b6c93"). InnerVolumeSpecName "kube-api-access-h69kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:28.179842 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.179763    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume\") pod \"a744ffb4-9e12-428c-8466-aae158d45c7f\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") "
Sep 17 14:25:28.179842 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.179810    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz24f\" (UniqueName: \"kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f\") pod \"a744ffb4-9e12-428c-8466-aae158d45c7f\" (UID: \"a744ffb4-9e12-428c-8466-aae158d45c7f\") "
Sep 17 14:25:28.180028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.179981    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.180028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.179992    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.180028 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.180000    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h69kf\" (UniqueName: \"kubernetes.io/projected/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93-kube-api-access-h69kf\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.180161 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.180119    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a744ffb4-9e12-428c-8466-aae158d45c7f" (UID: "a744ffb4-9e12-428c-8466-aae158d45c7f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:28.181748 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.181729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f" (OuterVolumeSpecName: "kube-api-access-xz24f") pod "a744ffb4-9e12-428c-8466-aae158d45c7f" (UID: "a744ffb4-9e12-428c-8466-aae158d45c7f"). InnerVolumeSpecName "kube-api-access-xz24f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:28.280806 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.280772    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a744ffb4-9e12-428c-8466-aae158d45c7f-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.280806 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.280800    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz24f\" (UniqueName: \"kubernetes.io/projected/a744ffb4-9e12-428c-8466-aae158d45c7f-kube-api-access-xz24f\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:28.729805 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.729780    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" containerID="5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57" exitCode=0
Sep 17 14:25:28.730156 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.729825    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"
Sep 17 14:25:28.730156 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.729866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" event={"ID":"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93","Type":"ContainerDied","Data":"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"}
Sep 17 14:25:28.730156 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.729914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf" event={"ID":"fbd78915-abfe-4bb9-a168-1e1b4a3b6c93","Type":"ContainerDied","Data":"8b0a11b88cfbac7a72fcf01f516c0fee65799db5b2edbdfba604010c1233219e"}
Sep 17 14:25:28.730156 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.729941    2579 scope.go:117] "RemoveContainer" containerID="5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"
Sep 17 14:25:28.731402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.731381    2579 generic.go:356] "Generic (PLEG): container finished" podID="a744ffb4-9e12-428c-8466-aae158d45c7f" containerID="3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36" exitCode=0
Sep 17 14:25:28.731482 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.731408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" event={"ID":"a744ffb4-9e12-428c-8466-aae158d45c7f","Type":"ContainerDied","Data":"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"}
Sep 17 14:25:28.731482 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.731430    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"
Sep 17 14:25:28.731482 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.731466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22" event={"ID":"a744ffb4-9e12-428c-8466-aae158d45c7f","Type":"ContainerDied","Data":"48ba823aee637d9bc66456d6bddbcbe1a1f5ab0b271be3b97b4f30eab4bf66b3"}
Sep 17 14:25:28.739036 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.739019    2579 scope.go:117] "RemoveContainer" containerID="5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"
Sep 17 14:25:28.739335 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:25:28.739315    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57\": container with ID starting with 5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57 not found: ID does not exist" containerID="5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"
Sep 17 14:25:28.739429 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.739348    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57"} err="failed to get container status \"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57\": rpc error: code = NotFound desc = could not find container \"5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57\": container with ID starting with 5118135d0c709a557c2c6e0539ef0ca5a1b61ea1f01bb4652c34eedfbe301d57 not found: ID does not exist"
Sep 17 14:25:28.739429 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.739377    2579 scope.go:117] "RemoveContainer" containerID="3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"
Sep 17 14:25:28.747918 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.747900    2579 scope.go:117] "RemoveContainer" containerID="3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"
Sep 17 14:25:28.748197 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:25:28.748176    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36\": container with ID starting with 3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36 not found: ID does not exist" containerID="3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"
Sep 17 14:25:28.748285 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.748201    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36"} err="failed to get container status \"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36\": rpc error: code = NotFound desc = could not find container \"3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36\": container with ID starting with 3d951a1eedf8bfc0d7742cdae95b9592b0a0a547e238266498c052b9cf0fdf36 not found: ID does not exist"
Sep 17 14:25:28.748906 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.748716    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:25:28.750981 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.750962    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22"]
Sep 17 14:25:28.760258 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.760239    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:25:28.764516 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:28.764494    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a77c87-68d8757898-qrzpf"]
Sep 17 14:25:30.699637 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:30.699605    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a744ffb4-9e12-428c-8466-aae158d45c7f" path="/var/lib/kubelet/pods/a744ffb4-9e12-428c-8466-aae158d45c7f/volumes"
Sep 17 14:25:30.700264 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:30.700244    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" path="/var/lib/kubelet/pods/fbd78915-abfe-4bb9-a168-1e1b4a3b6c93/volumes"
Sep 17 14:25:46.123340 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.123308    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:25:46.123726 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.123537    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" podUID="f675c23d-4822-47ba-9559-81c3979bc834" containerName="maas-api" containerID="cri-o://9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1" gracePeriod=30
Sep 17 14:25:46.179789 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.179758    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:25:46.180092 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.180063    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" podUID="21cc3e05-2797-4542-b65d-2d98e5884275" containerName="payload-pre-processing" containerID="cri-o://5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9" gracePeriod=30
Sep 17 14:25:46.437448 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.437420    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:25:46.472457 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.472433    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:25:46.547781 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.547752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wljgx\" (UniqueName: \"kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx\") pod \"21cc3e05-2797-4542-b65d-2d98e5884275\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") "
Sep 17 14:25:46.547959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.547815    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca\") pod \"f675c23d-4822-47ba-9559-81c3979bc834\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") "
Sep 17 14:25:46.547959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.547860    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls\") pod \"f675c23d-4822-47ba-9559-81c3979bc834\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") "
Sep 17 14:25:46.547959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.547931    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs\") pod \"f675c23d-4822-47ba-9559-81c3979bc834\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") "
Sep 17 14:25:46.547959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.547956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume\") pod \"21cc3e05-2797-4542-b65d-2d98e5884275\" (UID: \"21cc3e05-2797-4542-b65d-2d98e5884275\") "
Sep 17 14:25:46.548222 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.548070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k498j\" (UniqueName: \"kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j\") pod \"f675c23d-4822-47ba-9559-81c3979bc834\" (UID: \"f675c23d-4822-47ba-9559-81c3979bc834\") "
Sep 17 14:25:46.548287 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.548230    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f675c23d-4822-47ba-9559-81c3979bc834" (UID: "f675c23d-4822-47ba-9559-81c3979bc834"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:46.548363 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.548340    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21cc3e05-2797-4542-b65d-2d98e5884275" (UID: "21cc3e05-2797-4542-b65d-2d98e5884275"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:46.548570 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.548552    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f675c23d-4822-47ba-9559-81c3979bc834-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.548637 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.548578    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e05-2797-4542-b65d-2d98e5884275-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.549878 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.549856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx" (OuterVolumeSpecName: "kube-api-access-wljgx") pod "21cc3e05-2797-4542-b65d-2d98e5884275" (UID: "21cc3e05-2797-4542-b65d-2d98e5884275"). InnerVolumeSpecName "kube-api-access-wljgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:46.550011 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.549988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f675c23d-4822-47ba-9559-81c3979bc834" (UID: "f675c23d-4822-47ba-9559-81c3979bc834"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:46.550321 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.550300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f675c23d-4822-47ba-9559-81c3979bc834" (UID: "f675c23d-4822-47ba-9559-81c3979bc834"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:46.550414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.550388    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j" (OuterVolumeSpecName: "kube-api-access-k498j") pod "f675c23d-4822-47ba-9559-81c3979bc834" (UID: "f675c23d-4822-47ba-9559-81c3979bc834"). InnerVolumeSpecName "kube-api-access-k498j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:46.650328 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.650248    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.650328 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.650282    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f675c23d-4822-47ba-9559-81c3979bc834-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.650328 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.650296    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k498j\" (UniqueName: \"kubernetes.io/projected/f675c23d-4822-47ba-9559-81c3979bc834-kube-api-access-k498j\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.650328 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.650312    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wljgx\" (UniqueName: \"kubernetes.io/projected/21cc3e05-2797-4542-b65d-2d98e5884275-kube-api-access-wljgx\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:25:46.835350 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.835310    2579 generic.go:356] "Generic (PLEG): container finished" podID="f675c23d-4822-47ba-9559-81c3979bc834" containerID="9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1" exitCode=0
Sep 17 14:25:46.835544 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.835376    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"
Sep 17 14:25:46.835544 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.835399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" event={"ID":"f675c23d-4822-47ba-9559-81c3979bc834","Type":"ContainerDied","Data":"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"}
Sep 17 14:25:46.835544 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.835488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps" event={"ID":"f675c23d-4822-47ba-9559-81c3979bc834","Type":"ContainerDied","Data":"3331b9a9c85cdd357ed3555770b922af0b871b485db072320299fa09dcc94106"}
Sep 17 14:25:46.835544 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.835517    2579 scope.go:117] "RemoveContainer" containerID="9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"
Sep 17 14:25:46.836819 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.836794    2579 generic.go:356] "Generic (PLEG): container finished" podID="21cc3e05-2797-4542-b65d-2d98e5884275" containerID="5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9" exitCode=0
Sep 17 14:25:46.836950 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.836852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" event={"ID":"21cc3e05-2797-4542-b65d-2d98e5884275","Type":"ContainerDied","Data":"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"}
Sep 17 14:25:46.836950 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.836858    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"
Sep 17 14:25:46.836950 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.836892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf" event={"ID":"21cc3e05-2797-4542-b65d-2d98e5884275","Type":"ContainerDied","Data":"ddb1c30cff4e4b786b5f8aaba4c455225be8a07550e7be9f2014f0fdb57ff1dc"}
Sep 17 14:25:46.847473 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.847452    2579 scope.go:117] "RemoveContainer" containerID="9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"
Sep 17 14:25:46.847809 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:25:46.847787    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1\": container with ID starting with 9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1 not found: ID does not exist" containerID="9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"
Sep 17 14:25:46.847897 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.847816    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1"} err="failed to get container status \"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1\": rpc error: code = NotFound desc = could not find container \"9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1\": container with ID starting with 9df346467cbe397d8c67b369cf460a245798ba9c2608628d57621a3c16dd11b1 not found: ID does not exist"
Sep 17 14:25:46.847897 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.847833    2579 scope.go:117] "RemoveContainer" containerID="5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"
Sep 17 14:25:46.856268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.856252    2579 scope.go:117] "RemoveContainer" containerID="5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"
Sep 17 14:25:46.856525 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:25:46.856503    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9\": container with ID starting with 5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9 not found: ID does not exist" containerID="5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"
Sep 17 14:25:46.856599 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.856534    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9"} err="failed to get container status \"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9\": rpc error: code = NotFound desc = could not find container \"5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9\": container with ID starting with 5ce1231312f697e9f99c62fdfbd4a0cafa144df859412806c707f3d73dbe36e9 not found: ID does not exist"
Sep 17 14:25:46.857559 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.857541    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:25:46.861288 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.861267    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf"]
Sep 17 14:25:46.871776 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.871755    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:25:46.877636 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:46.877617    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2b8275-6d95fdb49-kznps"]
Sep 17 14:25:48.700064 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:48.700018    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21cc3e05-2797-4542-b65d-2d98e5884275" path="/var/lib/kubelet/pods/21cc3e05-2797-4542-b65d-2d98e5884275/volumes"
Sep 17 14:25:48.700509 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:48.700493    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f675c23d-4822-47ba-9559-81c3979bc834" path="/var/lib/kubelet/pods/f675c23d-4822-47ba-9559-81c3979bc834/volumes"
Sep 17 14:25:54.758833 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:54.758806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:25:54.763943 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:54.763918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:25:54.867307 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:25:54.867280    2579 scope.go:117] "RemoveContainer" containerID="6559f6ac011be0b5475f21bc5af52bb0ad5aefd1618abd7ea012f0e20083d7d0"
Sep 17 14:26:05.682164 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.682121    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:26:05.682648 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.682399    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" podUID="99867bf2-2c56-4ae7-90d1-87e9066463d3" containerName="maas-api" containerID="cri-o://82b939408b4bbb1b125070e6f608ae5b41fc196599c30cc17eb39bad968c3a19" gracePeriod=30
Sep 17 14:26:05.747773 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.747735    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:26:05.748012 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.747980    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" podUID="838b7548-1608-460c-85e3-bf31fdabb2e0" containerName="payload-pre-processing" containerID="cri-o://cc78ecfd4f8cd2a67d53b8642289a15206641067a0909a538723f704bfd1c1fc" gracePeriod=30
Sep 17 14:26:05.937999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.937762    2579 generic.go:356] "Generic (PLEG): container finished" podID="99867bf2-2c56-4ae7-90d1-87e9066463d3" containerID="82b939408b4bbb1b125070e6f608ae5b41fc196599c30cc17eb39bad968c3a19" exitCode=0
Sep 17 14:26:05.937999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.937867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" event={"ID":"99867bf2-2c56-4ae7-90d1-87e9066463d3","Type":"ContainerDied","Data":"82b939408b4bbb1b125070e6f608ae5b41fc196599c30cc17eb39bad968c3a19"}
Sep 17 14:26:05.940173 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.940147    2579 generic.go:356] "Generic (PLEG): container finished" podID="838b7548-1608-460c-85e3-bf31fdabb2e0" containerID="cc78ecfd4f8cd2a67d53b8642289a15206641067a0909a538723f704bfd1c1fc" exitCode=0
Sep 17 14:26:05.940330 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:05.940243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" event={"ID":"838b7548-1608-460c-85e3-bf31fdabb2e0","Type":"ContainerDied","Data":"cc78ecfd4f8cd2a67d53b8642289a15206641067a0909a538723f704bfd1c1fc"}
Sep 17 14:26:06.001976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.001947    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:26:06.047234 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.047211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:26:06.133327 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca\") pod \"99867bf2-2c56-4ae7-90d1-87e9066463d3\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") "
Sep 17 14:26:06.133501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133361    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tzg5\" (UniqueName: \"kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5\") pod \"838b7548-1608-460c-85e3-bf31fdabb2e0\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") "
Sep 17 14:26:06.133501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133417    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume\") pod \"838b7548-1608-460c-85e3-bf31fdabb2e0\" (UID: \"838b7548-1608-460c-85e3-bf31fdabb2e0\") "
Sep 17 14:26:06.133501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133451    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs\") pod \"99867bf2-2c56-4ae7-90d1-87e9066463d3\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") "
Sep 17 14:26:06.133501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzf6z\" (UniqueName: \"kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z\") pod \"99867bf2-2c56-4ae7-90d1-87e9066463d3\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") "
Sep 17 14:26:06.133728 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls\") pod \"99867bf2-2c56-4ae7-90d1-87e9066463d3\" (UID: \"99867bf2-2c56-4ae7-90d1-87e9066463d3\") "
Sep 17 14:26:06.133795 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99867bf2-2c56-4ae7-90d1-87e9066463d3" (UID: "99867bf2-2c56-4ae7-90d1-87e9066463d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:06.133848 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.133798    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "838b7548-1608-460c-85e3-bf31fdabb2e0" (UID: "838b7548-1608-460c-85e3-bf31fdabb2e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:06.134100 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.134077    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99867bf2-2c56-4ae7-90d1-87e9066463d3-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.134204 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.134103    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838b7548-1608-460c-85e3-bf31fdabb2e0-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.135596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.135569    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5" (OuterVolumeSpecName: "kube-api-access-2tzg5") pod "838b7548-1608-460c-85e3-bf31fdabb2e0" (UID: "838b7548-1608-460c-85e3-bf31fdabb2e0"). InnerVolumeSpecName "kube-api-access-2tzg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:06.135596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.135570    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99867bf2-2c56-4ae7-90d1-87e9066463d3" (UID: "99867bf2-2c56-4ae7-90d1-87e9066463d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:06.135596 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.135587    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99867bf2-2c56-4ae7-90d1-87e9066463d3" (UID: "99867bf2-2c56-4ae7-90d1-87e9066463d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:06.135751 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.135605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z" (OuterVolumeSpecName: "kube-api-access-jzf6z") pod "99867bf2-2c56-4ae7-90d1-87e9066463d3" (UID: "99867bf2-2c56-4ae7-90d1-87e9066463d3"). InnerVolumeSpecName "kube-api-access-jzf6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:06.235352 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.235282    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tzg5\" (UniqueName: \"kubernetes.io/projected/838b7548-1608-460c-85e3-bf31fdabb2e0-kube-api-access-2tzg5\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.235352 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.235306    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.235352 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.235317    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzf6z\" (UniqueName: \"kubernetes.io/projected/99867bf2-2c56-4ae7-90d1-87e9066463d3-kube-api-access-jzf6z\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.235352 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.235325    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99867bf2-2c56-4ae7-90d1-87e9066463d3-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:06.946356 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.946327    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"
Sep 17 14:26:06.946792 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.946368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2" event={"ID":"99867bf2-2c56-4ae7-90d1-87e9066463d3","Type":"ContainerDied","Data":"59d97c89fa5c90e6e335e9ae36e37b9b1059281d83ca4ec24c82b1b885e4cc48"}
Sep 17 14:26:06.946792 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.946431    2579 scope.go:117] "RemoveContainer" containerID="82b939408b4bbb1b125070e6f608ae5b41fc196599c30cc17eb39bad968c3a19"
Sep 17 14:26:06.947827 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.947809    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"
Sep 17 14:26:06.947933 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.947805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db" event={"ID":"838b7548-1608-460c-85e3-bf31fdabb2e0","Type":"ContainerDied","Data":"a2b22a08463c82309f3b510cad2168a24c173f13387b3fec220afd9092020634"}
Sep 17 14:26:06.955513 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.955497    2579 scope.go:117] "RemoveContainer" containerID="cc78ecfd4f8cd2a67d53b8642289a15206641067a0909a538723f704bfd1c1fc"
Sep 17 14:26:06.963292 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.963266    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:26:06.970293 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.970272    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e2bb9-755c6f58d4-mdlf2"]
Sep 17 14:26:06.979540 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.979520    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:26:06.983877 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:06.983856    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db"]
Sep 17 14:26:08.698673 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:08.698642    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="838b7548-1608-460c-85e3-bf31fdabb2e0" path="/var/lib/kubelet/pods/838b7548-1608-460c-85e3-bf31fdabb2e0/volumes"
Sep 17 14:26:08.699077 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:08.699059    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99867bf2-2c56-4ae7-90d1-87e9066463d3" path="/var/lib/kubelet/pods/99867bf2-2c56-4ae7-90d1-87e9066463d3/volumes"
Sep 17 14:26:29.067061 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.067012    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:26:29.067493 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.067240    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" podUID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" containerName="maas-api" containerID="cri-o://d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff" gracePeriod=30
Sep 17 14:26:29.137157 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.137117    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:26:29.137430 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.137403    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" podUID="77c8db06-69cc-4245-a8c9-03777e02682c" containerName="payload-processing" containerID="cri-o://ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977" gracePeriod=30
Sep 17 14:26:29.147955 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.147926    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:26:29.148197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.148171    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" podUID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" containerName="payload-pre-processing" containerID="cri-o://33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31" gracePeriod=30
Sep 17 14:26:29.432393 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.432368    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:26:29.441738 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.441713    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:26:29.456560 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.456530    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:26:29.562479 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs\") pod \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562499    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsfr6\" (UniqueName: \"kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6\") pod \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume\") pod \"77c8db06-69cc-4245-a8c9-03777e02682c\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2xl9\" (UniqueName: \"kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9\") pod \"77c8db06-69cc-4245-a8c9-03777e02682c\" (UID: \"77c8db06-69cc-4245-a8c9-03777e02682c\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562577    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca\") pod \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562615    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgkgg\" (UniqueName: \"kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg\") pod \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") "
Sep 17 14:26:29.562669 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume\") pod \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\" (UID: \"87c07ce5-a221-4a5c-bc4c-1924d08b4510\") "
Sep 17 14:26:29.562996 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562732    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") pod \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\" (UID: \"1ad3abe3-5622-4c41-80c8-3724557a1a0a\") "
Sep 17 14:26:29.562996 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562900    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ad3abe3-5622-4c41-80c8-3724557a1a0a" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:29.562996 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.562963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77c8db06-69cc-4245-a8c9-03777e02682c" (UID: "77c8db06-69cc-4245-a8c9-03777e02682c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:29.563178 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.563132    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77c8db06-69cc-4245-a8c9-03777e02682c-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.563280 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.563264    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad3abe3-5622-4c41-80c8-3724557a1a0a-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.563414 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.563380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87c07ce5-a221-4a5c-bc4c-1924d08b4510" (UID: "87c07ce5-a221-4a5c-bc4c-1924d08b4510"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:29.564975 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.564954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ad3abe3-5622-4c41-80c8-3724557a1a0a" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:29.565256 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.565232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg" (OuterVolumeSpecName: "kube-api-access-tgkgg") pod "87c07ce5-a221-4a5c-bc4c-1924d08b4510" (UID: "87c07ce5-a221-4a5c-bc4c-1924d08b4510"). InnerVolumeSpecName "kube-api-access-tgkgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:29.565341 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.565245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9" (OuterVolumeSpecName: "kube-api-access-v2xl9") pod "77c8db06-69cc-4245-a8c9-03777e02682c" (UID: "77c8db06-69cc-4245-a8c9-03777e02682c"). InnerVolumeSpecName "kube-api-access-v2xl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:29.565408 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.565372    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6" (OuterVolumeSpecName: "kube-api-access-fsfr6") pod "1ad3abe3-5622-4c41-80c8-3724557a1a0a" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a"). InnerVolumeSpecName "kube-api-access-fsfr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:29.565408 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.565376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ad3abe3-5622-4c41-80c8-3724557a1a0a" (UID: "1ad3abe3-5622-4c41-80c8-3724557a1a0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664186    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsfr6\" (UniqueName: \"kubernetes.io/projected/1ad3abe3-5622-4c41-80c8-3724557a1a0a-kube-api-access-fsfr6\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664214    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2xl9\" (UniqueName: \"kubernetes.io/projected/77c8db06-69cc-4245-a8c9-03777e02682c-kube-api-access-v2xl9\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664223    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgkgg\" (UniqueName: \"kubernetes.io/projected/87c07ce5-a221-4a5c-bc4c-1924d08b4510-kube-api-access-tgkgg\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664232    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87c07ce5-a221-4a5c-bc4c-1924d08b4510-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664241    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:29.664268 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:29.664249    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad3abe3-5622-4c41-80c8-3724557a1a0a-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:26:30.064020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.063912    2579 generic.go:356] "Generic (PLEG): container finished" podID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" containerID="33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31" exitCode=0
Sep 17 14:26:30.064020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.063948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" event={"ID":"87c07ce5-a221-4a5c-bc4c-1924d08b4510","Type":"ContainerDied","Data":"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"}
Sep 17 14:26:30.064020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.063978    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"
Sep 17 14:26:30.064020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.064014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n" event={"ID":"87c07ce5-a221-4a5c-bc4c-1924d08b4510","Type":"ContainerDied","Data":"60dbaa049db1efea0b891c61b5533e7655c65463e01c0d6a8bc662eb68ceb6d7"}
Sep 17 14:26:30.064377 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.064071    2579 scope.go:117] "RemoveContainer" containerID="33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"
Sep 17 14:26:30.065496 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.065474    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" containerID="d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff" exitCode=0
Sep 17 14:26:30.065600 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.065504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" event={"ID":"1ad3abe3-5622-4c41-80c8-3724557a1a0a","Type":"ContainerDied","Data":"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"}
Sep 17 14:26:30.065600 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.065547    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"
Sep 17 14:26:30.065600 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.065567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j" event={"ID":"1ad3abe3-5622-4c41-80c8-3724557a1a0a","Type":"ContainerDied","Data":"d140bd542a601f4f8fee2e6089273d0afcca9349d2b20d33feefd9773f4a1363"}
Sep 17 14:26:30.067854 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.067809    2579 generic.go:356] "Generic (PLEG): container finished" podID="77c8db06-69cc-4245-a8c9-03777e02682c" containerID="ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977" exitCode=0
Sep 17 14:26:30.068273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.067866    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"
Sep 17 14:26:30.068273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.067881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" event={"ID":"77c8db06-69cc-4245-a8c9-03777e02682c","Type":"ContainerDied","Data":"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"}
Sep 17 14:26:30.068273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.067925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl" event={"ID":"77c8db06-69cc-4245-a8c9-03777e02682c","Type":"ContainerDied","Data":"755ab8e48e1a7db48d430d9f0b569f1aa73c99ad89d59f7790a6b85809385f2c"}
Sep 17 14:26:30.074646 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.074433    2579 scope.go:117] "RemoveContainer" containerID="33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"
Sep 17 14:26:30.074718 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:26:30.074703    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31\": container with ID starting with 33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31 not found: ID does not exist" containerID="33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"
Sep 17 14:26:30.074761 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.074729    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31"} err="failed to get container status \"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31\": rpc error: code = NotFound desc = could not find container \"33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31\": container with ID starting with 33f1abfdaf1b33c844c6047284ef6758e2ce213bc113d6ae907141686576ab31 not found: ID does not exist"
Sep 17 14:26:30.074761 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.074744    2579 scope.go:117] "RemoveContainer" containerID="d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"
Sep 17 14:26:30.093709 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.093675    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:26:30.097338 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.097315    2579 scope.go:117] "RemoveContainer" containerID="d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"
Sep 17 14:26:30.097693 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:26:30.097674    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff\": container with ID starting with d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff not found: ID does not exist" containerID="d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"
Sep 17 14:26:30.097776 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.097701    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff"} err="failed to get container status \"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff\": rpc error: code = NotFound desc = could not find container \"d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff\": container with ID starting with d992f25e0cfd885a59043652de0ea07b47eb1af5dca0b3d15845dc10102e61ff not found: ID does not exist"
Sep 17 14:26:30.097776 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.097724    2579 scope.go:117] "RemoveContainer" containerID="ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"
Sep 17 14:26:30.098617 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.098594    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n"]
Sep 17 14:26:30.105441 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.105421    2579 scope.go:117] "RemoveContainer" containerID="ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"
Sep 17 14:26:30.105765 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:26:30.105744    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977\": container with ID starting with ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977 not found: ID does not exist" containerID="ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"
Sep 17 14:26:30.105839 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.105771    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977"} err="failed to get container status \"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977\": rpc error: code = NotFound desc = could not find container \"ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977\": container with ID starting with ff9fab87d848ebaeb5ccba35cbfb15e4af083f8a78dbcd2fe8384cf1e8514977 not found: ID does not exist"
Sep 17 14:26:30.110068 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.110026    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:26:30.119029 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.119009    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-079b38-ff5c5b7d5-nw52j"]
Sep 17 14:26:30.132545 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.132524    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:26:30.141506 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.141480    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl"]
Sep 17 14:26:30.699567 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.699538    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" path="/var/lib/kubelet/pods/1ad3abe3-5622-4c41-80c8-3724557a1a0a/volumes"
Sep 17 14:26:30.699907 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.699894    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c8db06-69cc-4245-a8c9-03777e02682c" path="/var/lib/kubelet/pods/77c8db06-69cc-4245-a8c9-03777e02682c/volumes"
Sep 17 14:26:30.700247 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:26:30.700234    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" path="/var/lib/kubelet/pods/87c07ce5-a221-4a5c-bc4c-1924d08b4510/volumes"
Sep 17 14:29:28.851611 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.851574    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852124    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a744ffb4-9e12-428c-8466-aae158d45c7f" containerName="payload-pre-processing"
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852145    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a744ffb4-9e12-428c-8466-aae158d45c7f" containerName="payload-pre-processing"
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852160    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" containerName="payload-processing"
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852169    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" containerName="payload-processing"
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852183    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751772bc-e660-4371-bbd4-1821c44d5cb4" containerName="maas-api"
Sep 17 14:29:28.852191 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852192    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="751772bc-e660-4371-bbd4-1821c44d5cb4" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852203    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852211    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cc3e05-2797-4542-b65d-2d98e5884275" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852228    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cc3e05-2797-4542-b65d-2d98e5884275" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852250    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f675c23d-4822-47ba-9559-81c3979bc834" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852259    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f675c23d-4822-47ba-9559-81c3979bc834" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852268    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852275    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852286    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99867bf2-2c56-4ae7-90d1-87e9066463d3" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852295    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99867bf2-2c56-4ae7-90d1-87e9066463d3" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852316    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852326    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c8db06-69cc-4245-a8c9-03777e02682c" containerName="payload-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852334    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c8db06-69cc-4245-a8c9-03777e02682c" containerName="payload-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852344    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838b7548-1608-460c-85e3-bf31fdabb2e0" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852352    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="838b7548-1608-460c-85e3-bf31fdabb2e0" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852367    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c24e80-bb83-4148-ad82-72cd3de1ba07" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852375    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c24e80-bb83-4148-ad82-72cd3de1ba07" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852455    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c8db06-69cc-4245-a8c9-03777e02682c" containerName="payload-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852469    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd78915-abfe-4bb9-a168-1e1b4a3b6c93" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852478    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad3abe3-5622-4c41-80c8-3724557a1a0a" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852485    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f675c23d-4822-47ba-9559-81c3979bc834" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852495    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c24e80-bb83-4148-ad82-72cd3de1ba07" containerName="maas-api"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852503    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65271e4c-6ef4-495d-9ac4-b0a7a7c29130" containerName="payload-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852511    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="838b7548-1608-460c-85e3-bf31fdabb2e0" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852520    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c07ce5-a221-4a5c-bc4c-1924d08b4510" containerName="payload-pre-processing"
Sep 17 14:29:28.852519 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852528    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="99867bf2-2c56-4ae7-90d1-87e9066463d3" containerName="maas-api"
Sep 17 14:29:28.853768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852538    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="751772bc-e660-4371-bbd4-1821c44d5cb4" containerName="maas-api"
Sep 17 14:29:28.853768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852547    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a744ffb4-9e12-428c-8466-aae158d45c7f" containerName="payload-pre-processing"
Sep 17 14:29:28.853768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.852557    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cc3e05-2797-4542-b65d-2d98e5884275" containerName="payload-pre-processing"
Sep 17 14:29:28.855726 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.855707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:28.858061 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.858029    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-911a82-serving-cert\""
Sep 17 14:29:28.868284 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.868260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:29:28.979391 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.979360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:28.979575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.979395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpkpl\" (UniqueName: \"kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:28.979575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.979421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:28.979575 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:28.979499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.080347 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.080324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.080470 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.080382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.080470 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.080401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpkpl\" (UniqueName: \"kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.080470 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.080424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.080604 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:29:29.080468    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-serving-cert: secret "maas-api-e2e-ipp-a-911a82-serving-cert" not found
Sep 17 14:29:29.080604 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:29:29.080539    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls podName:ce341bfe-e414-4cb8-9ab3-53a66a5a106e nodeName:}" failed. No retries permitted until 2026-09-17 14:29:29.580519774 +0000 UTC m=+2015.354287428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls") pod "maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" (UID: "ce341bfe-e414-4cb8-9ab3-53a66a5a106e") : secret "maas-api-e2e-ipp-a-911a82-serving-cert" not found
Sep 17 14:29:29.081170 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.081149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.082821 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.082793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.088777 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.088757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpkpl\" (UniqueName: \"kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.519579 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.519544    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:29:29.522877 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.522857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.525309 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.525283    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-911a82\""
Sep 17 14:29:29.525410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.525368    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-911a82-dockercfg-n6swz\""
Sep 17 14:29:29.533971 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.533948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:29:29.545249 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.545227    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:29:29.548250 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.548235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.559219 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.559195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:29:29.585076 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.585031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.587330 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.587313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.685905 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.685865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.686075 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.685913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbsp\" (UniqueName: \"kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.686075 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.685935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.686075 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.685964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9948\" (UniqueName: \"kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.767211 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.767179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:29.787356 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.787308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.787485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.787365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbsp\" (UniqueName: \"kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.787485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.787398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.787485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.787426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9948\" (UniqueName: \"kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.788212 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.788190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.788300 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.788214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.795594 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.795574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbsp\" (UniqueName: \"kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp\") pod \"payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.796157 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.796132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9948\" (UniqueName: \"kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948\") pod \"payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:29.833396 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.833366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:29.858782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:29.858738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:30.041179 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.041153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:29:30.043492 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:29:30.043458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce341bfe_e414_4cb8_9ab3_53a66a5a106e.slice/crio-5bc417c4848be3849e8d9fcaedb4a99e2333f7ace44105f755af2dfb9c08508e WatchSource:0}: Error finding container 5bc417c4848be3849e8d9fcaedb4a99e2333f7ace44105f755af2dfb9c08508e: Status 404 returned error can't find the container with id 5bc417c4848be3849e8d9fcaedb4a99e2333f7ace44105f755af2dfb9c08508e
Sep 17 14:29:30.044768 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.044750    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:29:30.114634 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.114605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:29:30.117186 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:29:30.117161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1808fafa_4061_4562_959e_212aeddfa605.slice/crio-b600928011fd797eeb0f88ca58933c9dc2be85ef6c26a206ec9c33651ca37be7 WatchSource:0}: Error finding container b600928011fd797eeb0f88ca58933c9dc2be85ef6c26a206ec9c33651ca37be7: Status 404 returned error can't find the container with id b600928011fd797eeb0f88ca58933c9dc2be85ef6c26a206ec9c33651ca37be7
Sep 17 14:29:30.145909 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.145884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:29:30.152091 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:29:30.152067    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45bd073_4131_46fa_a146_8b332db4a0d2.slice/crio-0236cdd417e720c14a8bdf77534399e2ccdab48a3c71e7b860f1e11b0873c90c WatchSource:0}: Error finding container 0236cdd417e720c14a8bdf77534399e2ccdab48a3c71e7b860f1e11b0873c90c: Status 404 returned error can't find the container with id 0236cdd417e720c14a8bdf77534399e2ccdab48a3c71e7b860f1e11b0873c90c
Sep 17 14:29:30.917261 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.917161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" event={"ID":"b45bd073-4131-46fa-a146-8b332db4a0d2","Type":"ContainerStarted","Data":"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"}
Sep 17 14:29:30.917261 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.917230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" event={"ID":"b45bd073-4131-46fa-a146-8b332db4a0d2","Type":"ContainerStarted","Data":"0236cdd417e720c14a8bdf77534399e2ccdab48a3c71e7b860f1e11b0873c90c"}
Sep 17 14:29:30.917751 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.917262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:29:30.918829 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.918799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" event={"ID":"ce341bfe-e414-4cb8-9ab3-53a66a5a106e","Type":"ContainerStarted","Data":"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"}
Sep 17 14:29:30.918957 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.918851    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" event={"ID":"ce341bfe-e414-4cb8-9ab3-53a66a5a106e","Type":"ContainerStarted","Data":"5bc417c4848be3849e8d9fcaedb4a99e2333f7ace44105f755af2dfb9c08508e"}
Sep 17 14:29:30.918957 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.918893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:30.920419 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.920398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" event={"ID":"1808fafa-4061-4562-959e-212aeddfa605","Type":"ContainerStarted","Data":"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"}
Sep 17 14:29:30.920553 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.920438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" event={"ID":"1808fafa-4061-4562-959e-212aeddfa605","Type":"ContainerStarted","Data":"b600928011fd797eeb0f88ca58933c9dc2be85ef6c26a206ec9c33651ca37be7"}
Sep 17 14:29:30.920553 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.920464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:30.938896 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.938848    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" podStartSLOduration=1.9388356839999998 podStartE2EDuration="1.938835684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:30.938206916 +0000 UTC m=+2016.711974586" watchObservedRunningTime="2026-09-17 14:29:30.938835684 +0000 UTC m=+2016.712603353"
Sep 17 14:29:30.957327 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.957289    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" podStartSLOduration=2.398574576 podStartE2EDuration="2.957276921s" totalImagesPullingTime="558.702345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:30.956964859 +0000 UTC m=+2016.730732533" watchObservedRunningTime="2026-09-17 14:29:30.957276921 +0000 UTC m=+2016.731044585"
Sep 17 14:29:30.977209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:30.977169    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" podStartSLOduration=1.977157354 podStartE2EDuration="1.977157354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:30.976950982 +0000 UTC m=+2016.750718651" watchObservedRunningTime="2026-09-17 14:29:30.977157354 +0000 UTC m=+2016.750925024"
Sep 17 14:29:36.930756 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:36.930720    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:29:41.927810 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:41.927780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:29:41.928216 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:29:41.927844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:30:05.658166 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.658131    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:30:05.661784 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.661765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.664246 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.664221    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-166f16\""
Sep 17 14:30:05.664367 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.664346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-166f16-dockercfg-wv8d4\""
Sep 17 14:30:05.672944 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.672920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:30:05.800452 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.800415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wvp\" (UniqueName: \"kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.800635 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.800500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.901681 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.901649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.901845 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.901748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wvp\" (UniqueName: \"kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.902413 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.902389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.910894 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.910847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wvp\" (UniqueName: \"kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp\") pod \"payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:05.972412 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:05.972387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:06.244539 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:06.244516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:30:06.246591 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:30:06.246558    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedac1388_f81d_4894_a9d5_4576b914bce5.slice/crio-c44b5248a14513a047c10fa2cb6d8dc95e36c5d79076e6e18b7b4035289c2a0a WatchSource:0}: Error finding container c44b5248a14513a047c10fa2cb6d8dc95e36c5d79076e6e18b7b4035289c2a0a: Status 404 returned error can't find the container with id c44b5248a14513a047c10fa2cb6d8dc95e36c5d79076e6e18b7b4035289c2a0a
Sep 17 14:30:07.095266 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:07.095231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" event={"ID":"edac1388-f81d-4894-a9d5-4576b914bce5","Type":"ContainerStarted","Data":"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"}
Sep 17 14:30:07.095698 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:07.095279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" event={"ID":"edac1388-f81d-4894-a9d5-4576b914bce5","Type":"ContainerStarted","Data":"c44b5248a14513a047c10fa2cb6d8dc95e36c5d79076e6e18b7b4035289c2a0a"}
Sep 17 14:30:07.095698 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:07.095309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:07.114626 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:07.114578    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" podStartSLOduration=2.11456401 podStartE2EDuration="2.11456401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:30:07.113114263 +0000 UTC m=+2052.886881936" watchObservedRunningTime="2026-09-17 14:30:07.11456401 +0000 UTC m=+2052.888331679"
Sep 17 14:30:18.102164 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:18.102082    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:30:36.833485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:36.833455    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:30:36.958202 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:36.958176    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl_edac1388-f81d-4894-a9d5-4576b914bce5/payload-processing/0.log"
Sep 17 14:30:54.788645 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:54.788611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:30:54.795327 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:30:54.795304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:31:13.350833 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:31:13.350799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8_b45bd073-4131-46fa-a146-8b332db4a0d2/payload-processing/0.log"
Sep 17 14:31:13.492959 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:31:13.492918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:31:13.621489 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:31:13.621422    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl_edac1388-f81d-4894-a9d5-4576b914bce5/payload-processing/0.log"
Sep 17 14:31:13.746078 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:31:13.746036    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl_edac1388-f81d-4894-a9d5-4576b914bce5/payload-processing/0.log"
Sep 17 14:32:26.936169 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:26.936027    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:32:26.939077 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:26.936271    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" podUID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" containerName="maas-api" containerID="cri-o://690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a" gracePeriod=30
Sep 17 14:32:27.012320 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.012285    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:32:27.012614 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.012578    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" podUID="b45bd073-4131-46fa-a146-8b332db4a0d2" containerName="payload-processing" containerID="cri-o://df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a" gracePeriod=30
Sep 17 14:32:27.014720 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.014644    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:32:27.014878 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.014853    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" podUID="1808fafa-4061-4562-959e-212aeddfa605" containerName="payload-pre-processing" containerID="cri-o://8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036" gracePeriod=30
Sep 17 14:32:27.268074 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.268024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:32:27.332448 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.332423    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:32:27.335680 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.335658    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:32:27.455259 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455219    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") pod \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") "
Sep 17 14:32:27.455460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca\") pod \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") "
Sep 17 14:32:27.455460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume\") pod \"1808fafa-4061-4562-959e-212aeddfa605\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") "
Sep 17 14:32:27.455460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs\") pod \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") "
Sep 17 14:32:27.455460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455423    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9948\" (UniqueName: \"kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948\") pod \"b45bd073-4131-46fa-a146-8b332db4a0d2\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") "
Sep 17 14:32:27.455707 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpkpl\" (UniqueName: \"kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl\") pod \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\" (UID: \"ce341bfe-e414-4cb8-9ab3-53a66a5a106e\") "
Sep 17 14:32:27.455707 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume\") pod \"b45bd073-4131-46fa-a146-8b332db4a0d2\" (UID: \"b45bd073-4131-46fa-a146-8b332db4a0d2\") "
Sep 17 14:32:27.455707 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455524    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbsp\" (UniqueName: \"kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp\") pod \"1808fafa-4061-4562-959e-212aeddfa605\" (UID: \"1808fafa-4061-4562-959e-212aeddfa605\") "
Sep 17 14:32:27.455873 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455705    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce341bfe-e414-4cb8-9ab3-53a66a5a106e" (UID: "ce341bfe-e414-4cb8-9ab3-53a66a5a106e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:27.455873 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455732    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1808fafa-4061-4562-959e-212aeddfa605" (UID: "1808fafa-4061-4562-959e-212aeddfa605"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:27.455992 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455909    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.455992 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.455929    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1808fafa-4061-4562-959e-212aeddfa605-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.456732 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.456660    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b45bd073-4131-46fa-a146-8b332db4a0d2" (UID: "b45bd073-4131-46fa-a146-8b332db4a0d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:27.458189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.458065    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce341bfe-e414-4cb8-9ab3-53a66a5a106e" (UID: "ce341bfe-e414-4cb8-9ab3-53a66a5a106e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:32:27.458189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.458108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce341bfe-e414-4cb8-9ab3-53a66a5a106e" (UID: "ce341bfe-e414-4cb8-9ab3-53a66a5a106e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:32:27.458189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.458168    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp" (OuterVolumeSpecName: "kube-api-access-ffbsp") pod "1808fafa-4061-4562-959e-212aeddfa605" (UID: "1808fafa-4061-4562-959e-212aeddfa605"). InnerVolumeSpecName "kube-api-access-ffbsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:27.458189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.458176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl" (OuterVolumeSpecName: "kube-api-access-hpkpl") pod "ce341bfe-e414-4cb8-9ab3-53a66a5a106e" (UID: "ce341bfe-e414-4cb8-9ab3-53a66a5a106e"). InnerVolumeSpecName "kube-api-access-hpkpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:27.458671 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.458645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948" (OuterVolumeSpecName: "kube-api-access-q9948") pod "b45bd073-4131-46fa-a146-8b332db4a0d2" (UID: "b45bd073-4131-46fa-a146-8b332db4a0d2"). InnerVolumeSpecName "kube-api-access-q9948". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:27.556450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556409    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.556450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556443    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9948\" (UniqueName: \"kubernetes.io/projected/b45bd073-4131-46fa-a146-8b332db4a0d2-kube-api-access-q9948\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.556450 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556454    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpkpl\" (UniqueName: \"kubernetes.io/projected/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-kube-api-access-hpkpl\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.556731 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556464    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b45bd073-4131-46fa-a146-8b332db4a0d2-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.556731 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556477    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbsp\" (UniqueName: \"kubernetes.io/projected/1808fafa-4061-4562-959e-212aeddfa605-kube-api-access-ffbsp\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.556731 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.556484    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce341bfe-e414-4cb8-9ab3-53a66a5a106e-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:32:27.754406 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.754322    2579 generic.go:356] "Generic (PLEG): container finished" podID="b45bd073-4131-46fa-a146-8b332db4a0d2" containerID="df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a" exitCode=0
Sep 17 14:32:27.754406 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.754364    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"
Sep 17 14:32:27.754616 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.754407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" event={"ID":"b45bd073-4131-46fa-a146-8b332db4a0d2","Type":"ContainerDied","Data":"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"}
Sep 17 14:32:27.754616 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.754463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8" event={"ID":"b45bd073-4131-46fa-a146-8b332db4a0d2","Type":"ContainerDied","Data":"0236cdd417e720c14a8bdf77534399e2ccdab48a3c71e7b860f1e11b0873c90c"}
Sep 17 14:32:27.754616 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.754495    2579 scope.go:117] "RemoveContainer" containerID="df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"
Sep 17 14:32:27.755778 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.755749    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" containerID="690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a" exitCode=0
Sep 17 14:32:27.755778 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.755776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" event={"ID":"ce341bfe-e414-4cb8-9ab3-53a66a5a106e","Type":"ContainerDied","Data":"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"}
Sep 17 14:32:27.755952 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.755818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7" event={"ID":"ce341bfe-e414-4cb8-9ab3-53a66a5a106e","Type":"ContainerDied","Data":"5bc417c4848be3849e8d9fcaedb4a99e2333f7ace44105f755af2dfb9c08508e"}
Sep 17 14:32:27.755952 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.755821    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"
Sep 17 14:32:27.757342 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.757319    2579 generic.go:356] "Generic (PLEG): container finished" podID="1808fafa-4061-4562-959e-212aeddfa605" containerID="8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036" exitCode=0
Sep 17 14:32:27.757469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.757368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" event={"ID":"1808fafa-4061-4562-959e-212aeddfa605","Type":"ContainerDied","Data":"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"}
Sep 17 14:32:27.757469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.757376    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"
Sep 17 14:32:27.757469 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.757405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d" event={"ID":"1808fafa-4061-4562-959e-212aeddfa605","Type":"ContainerDied","Data":"b600928011fd797eeb0f88ca58933c9dc2be85ef6c26a206ec9c33651ca37be7"}
Sep 17 14:32:27.764546 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.764525    2579 scope.go:117] "RemoveContainer" containerID="df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"
Sep 17 14:32:27.764829 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:32:27.764811    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a\": container with ID starting with df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a not found: ID does not exist" containerID="df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"
Sep 17 14:32:27.764898 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.764836    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a"} err="failed to get container status \"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a\": rpc error: code = NotFound desc = could not find container \"df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a\": container with ID starting with df524b4f4cf4bde0f56679262ebb4bd2d74b9a9f4afc24ce1453512a3fa44b9a not found: ID does not exist"
Sep 17 14:32:27.764898 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.764853    2579 scope.go:117] "RemoveContainer" containerID="690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"
Sep 17 14:32:27.773804 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.773789    2579 scope.go:117] "RemoveContainer" containerID="690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"
Sep 17 14:32:27.774064 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:32:27.774029    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a\": container with ID starting with 690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a not found: ID does not exist" containerID="690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"
Sep 17 14:32:27.774123 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.774068    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a"} err="failed to get container status \"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a\": rpc error: code = NotFound desc = could not find container \"690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a\": container with ID starting with 690d6576f6f012c7382d0a2068756b9282a9fd732b0409a6219316c11d39d83a not found: ID does not exist"
Sep 17 14:32:27.774123 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.774083    2579 scope.go:117] "RemoveContainer" containerID="8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"
Sep 17 14:32:27.782645 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.782623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:32:27.783672 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.783576    2579 scope.go:117] "RemoveContainer" containerID="8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"
Sep 17 14:32:27.784357 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:32:27.784026    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036\": container with ID starting with 8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036 not found: ID does not exist" containerID="8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"
Sep 17 14:32:27.784357 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.784154    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036"} err="failed to get container status \"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036\": rpc error: code = NotFound desc = could not find container \"8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036\": container with ID starting with 8c70c43a0e0b9d8735900ed4eed1c24ab8f4d5d09bafdab1231056ec2822f036 not found: ID does not exist"
Sep 17 14:32:27.785796 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.785776    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8"]
Sep 17 14:32:27.795922 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.795900    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:32:27.800730 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.800709    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-911a82-6df9c6c487-pjzg7"]
Sep 17 14:32:27.810650 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.810630    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:32:27.814838 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:27.814820    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d"]
Sep 17 14:32:28.698796 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:28.698762    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1808fafa-4061-4562-959e-212aeddfa605" path="/var/lib/kubelet/pods/1808fafa-4061-4562-959e-212aeddfa605/volumes"
Sep 17 14:32:28.699333 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:28.699312    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45bd073-4131-46fa-a146-8b332db4a0d2" path="/var/lib/kubelet/pods/b45bd073-4131-46fa-a146-8b332db4a0d2/volumes"
Sep 17 14:32:28.699758 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:32:28.699740    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" path="/var/lib/kubelet/pods/ce341bfe-e414-4cb8-9ab3-53a66a5a106e/volumes"
Sep 17 14:33:14.323573 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.323531    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:33:14.324193 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.323766    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" podUID="edac1388-f81d-4894-a9d5-4576b914bce5" containerName="payload-processing" containerID="cri-o://9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7" gracePeriod=30
Sep 17 14:33:14.587236 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.587181    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:33:14.755229 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.755193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6wvp\" (UniqueName: \"kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp\") pod \"edac1388-f81d-4894-a9d5-4576b914bce5\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") "
Sep 17 14:33:14.755398 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.755341    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume\") pod \"edac1388-f81d-4894-a9d5-4576b914bce5\" (UID: \"edac1388-f81d-4894-a9d5-4576b914bce5\") "
Sep 17 14:33:14.755745 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.755711    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edac1388-f81d-4894-a9d5-4576b914bce5" (UID: "edac1388-f81d-4894-a9d5-4576b914bce5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:14.757306 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.757277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp" (OuterVolumeSpecName: "kube-api-access-g6wvp") pod "edac1388-f81d-4894-a9d5-4576b914bce5" (UID: "edac1388-f81d-4894-a9d5-4576b914bce5"). InnerVolumeSpecName "kube-api-access-g6wvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:14.856410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.856383    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6wvp\" (UniqueName: \"kubernetes.io/projected/edac1388-f81d-4894-a9d5-4576b914bce5-kube-api-access-g6wvp\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:14.856410 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.856411    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edac1388-f81d-4894-a9d5-4576b914bce5-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:14.979297 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.979267    2579 generic.go:356] "Generic (PLEG): container finished" podID="edac1388-f81d-4894-a9d5-4576b914bce5" containerID="9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7" exitCode=0
Sep 17 14:33:14.979443 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.979308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" event={"ID":"edac1388-f81d-4894-a9d5-4576b914bce5","Type":"ContainerDied","Data":"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"}
Sep 17 14:33:14.979443 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.979326    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"
Sep 17 14:33:14.979443 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.979354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl" event={"ID":"edac1388-f81d-4894-a9d5-4576b914bce5","Type":"ContainerDied","Data":"c44b5248a14513a047c10fa2cb6d8dc95e36c5d79076e6e18b7b4035289c2a0a"}
Sep 17 14:33:14.979443 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.979377    2579 scope.go:117] "RemoveContainer" containerID="9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"
Sep 17 14:33:14.990097 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.990026    2579 scope.go:117] "RemoveContainer" containerID="9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"
Sep 17 14:33:14.990357 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:33:14.990335    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7\": container with ID starting with 9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7 not found: ID does not exist" containerID="9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"
Sep 17 14:33:14.990424 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:14.990364    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7"} err="failed to get container status \"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7\": rpc error: code = NotFound desc = could not find container \"9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7\": container with ID starting with 9be24a7071ae91b0dc22c82fac49c255fb1e34b09e4219aafae296bd000c51c7 not found: ID does not exist"
Sep 17 14:33:15.023208 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:15.023183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:33:15.028460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:15.028440    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl"]
Sep 17 14:33:16.700923 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:16.700891    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edac1388-f81d-4894-a9d5-4576b914bce5" path="/var/lib/kubelet/pods/edac1388-f81d-4894-a9d5-4576b914bce5/volumes"
Sep 17 14:33:32.469931 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.469898    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:33:32.470365 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.470127    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" podUID="569a4380-217f-4357-8803-f9da951afa2b" containerName="maas-api" containerID="cri-o://502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9" gracePeriod=30
Sep 17 14:33:32.555135 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.555101    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:33:32.555323 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.555300    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" podUID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" containerName="payload-pre-processing" containerID="cri-o://ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445" gracePeriod=30
Sep 17 14:33:32.799437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.799408    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:33:32.831938 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.831914    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:33:32.908232 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca\") pod \"569a4380-217f-4357-8803-f9da951afa2b\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") "
Sep 17 14:33:32.908232 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls\") pod \"569a4380-217f-4357-8803-f9da951afa2b\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") "
Sep 17 14:33:32.908463 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908410    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume\") pod \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") "
Sep 17 14:33:32.908528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j5ws\" (UniqueName: \"kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws\") pod \"569a4380-217f-4357-8803-f9da951afa2b\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") "
Sep 17 14:33:32.908528 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908514    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs\") pod \"569a4380-217f-4357-8803-f9da951afa2b\" (UID: \"569a4380-217f-4357-8803-f9da951afa2b\") "
Sep 17 14:33:32.908638 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdxjr\" (UniqueName: \"kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr\") pod \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\" (UID: \"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc\") "
Sep 17 14:33:32.908861 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "569a4380-217f-4357-8803-f9da951afa2b" (UID: "569a4380-217f-4357-8803-f9da951afa2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:32.908861 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.908785    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" (UID: "b19514a5-ea6b-4dbf-9629-abdb7a45f0cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:32.910457 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.910430    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "569a4380-217f-4357-8803-f9da951afa2b" (UID: "569a4380-217f-4357-8803-f9da951afa2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:33:32.910875 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.910842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws" (OuterVolumeSpecName: "kube-api-access-2j5ws") pod "569a4380-217f-4357-8803-f9da951afa2b" (UID: "569a4380-217f-4357-8803-f9da951afa2b"). InnerVolumeSpecName "kube-api-access-2j5ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:32.910983 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.910926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "569a4380-217f-4357-8803-f9da951afa2b" (UID: "569a4380-217f-4357-8803-f9da951afa2b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:33:32.910983 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:32.910944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr" (OuterVolumeSpecName: "kube-api-access-zdxjr") pod "b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" (UID: "b19514a5-ea6b-4dbf-9629-abdb7a45f0cc"). InnerVolumeSpecName "kube-api-access-zdxjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.009963    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j5ws\" (UniqueName: \"kubernetes.io/projected/569a4380-217f-4357-8803-f9da951afa2b-kube-api-access-2j5ws\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.009988    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.009997    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdxjr\" (UniqueName: \"kubernetes.io/projected/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-kube-api-access-zdxjr\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.010007    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a4380-217f-4357-8803-f9da951afa2b-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.010015    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/569a4380-217f-4357-8803-f9da951afa2b-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.010058 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.010023    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:33.062747 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.062711    2579 generic.go:356] "Generic (PLEG): container finished" podID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" containerID="ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445" exitCode=0
Sep 17 14:33:33.062936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.062777    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"
Sep 17 14:33:33.062936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.062809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" event={"ID":"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc","Type":"ContainerDied","Data":"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"}
Sep 17 14:33:33.062936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.062867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm" event={"ID":"b19514a5-ea6b-4dbf-9629-abdb7a45f0cc","Type":"ContainerDied","Data":"83d5a55e6eda5e22d165ea03e0454b6becd548f797583dfdd7a2b35ec87f09ae"}
Sep 17 14:33:33.062936 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.062891    2579 scope.go:117] "RemoveContainer" containerID="ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"
Sep 17 14:33:33.064388 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.064352    2579 generic.go:356] "Generic (PLEG): container finished" podID="569a4380-217f-4357-8803-f9da951afa2b" containerID="502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9" exitCode=0
Sep 17 14:33:33.064516 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.064396    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"
Sep 17 14:33:33.064516 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.064420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" event={"ID":"569a4380-217f-4357-8803-f9da951afa2b","Type":"ContainerDied","Data":"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"}
Sep 17 14:33:33.064516 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.064462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj" event={"ID":"569a4380-217f-4357-8803-f9da951afa2b","Type":"ContainerDied","Data":"6b48c13bc2caf97339a7ce1aeb6578deb76bd2ba8d152757a52143461f6d0f2f"}
Sep 17 14:33:33.072474 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.072457    2579 scope.go:117] "RemoveContainer" containerID="ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"
Sep 17 14:33:33.072798 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:33:33.072780    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445\": container with ID starting with ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445 not found: ID does not exist" containerID="ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"
Sep 17 14:33:33.072873 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.072808    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445"} err="failed to get container status \"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445\": rpc error: code = NotFound desc = could not find container \"ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445\": container with ID starting with ce8c96e5a081dcad3caaa6237b3269e6a34f243800f4d05434fb2339dcd32445 not found: ID does not exist"
Sep 17 14:33:33.072873 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.072831    2579 scope.go:117] "RemoveContainer" containerID="502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"
Sep 17 14:33:33.081961 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.081945    2579 scope.go:117] "RemoveContainer" containerID="502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"
Sep 17 14:33:33.082249 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:33:33.082231    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9\": container with ID starting with 502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9 not found: ID does not exist" containerID="502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"
Sep 17 14:33:33.082303 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.082258    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9"} err="failed to get container status \"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9\": rpc error: code = NotFound desc = could not find container \"502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9\": container with ID starting with 502dd39cd835361c49fb3b81e3f8e5a7be52067b47599229970acf422a1c00d9 not found: ID does not exist"
Sep 17 14:33:33.091465 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.091443    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:33:33.093026 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.093006    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b88b90-669cf8554c-5p4cj"]
Sep 17 14:33:33.115935 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.115913    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:33:33.121564 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:33.121540    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm"]
Sep 17 14:33:34.699694 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:34.699663    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569a4380-217f-4357-8803-f9da951afa2b" path="/var/lib/kubelet/pods/569a4380-217f-4357-8803-f9da951afa2b/volumes"
Sep 17 14:33:34.700067 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:34.700001    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" path="/var/lib/kubelet/pods/b19514a5-ea6b-4dbf-9629-abdb7a45f0cc/volumes"
Sep 17 14:33:51.407423 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.407386    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:33:51.408307 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.408029    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" podUID="002cb747-882a-4cd6-a7c7-997d811f6434" containerName="payload-processing" containerID="cri-o://1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096" gracePeriod=30
Sep 17 14:33:51.665921 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.665860    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:33:51.770771 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.770746    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk8c7\" (UniqueName: \"kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7\") pod \"002cb747-882a-4cd6-a7c7-997d811f6434\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") "
Sep 17 14:33:51.770929 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.770790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume\") pod \"002cb747-882a-4cd6-a7c7-997d811f6434\" (UID: \"002cb747-882a-4cd6-a7c7-997d811f6434\") "
Sep 17 14:33:51.771263 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.771231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "002cb747-882a-4cd6-a7c7-997d811f6434" (UID: "002cb747-882a-4cd6-a7c7-997d811f6434"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:51.771441 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.771411    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002cb747-882a-4cd6-a7c7-997d811f6434-plugins-config-volume\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:51.772976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.772948    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7" (OuterVolumeSpecName: "kube-api-access-dk8c7") pod "002cb747-882a-4cd6-a7c7-997d811f6434" (UID: "002cb747-882a-4cd6-a7c7-997d811f6434"). InnerVolumeSpecName "kube-api-access-dk8c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:51.872722 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:51.872692    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk8c7\" (UniqueName: \"kubernetes.io/projected/002cb747-882a-4cd6-a7c7-997d811f6434-kube-api-access-dk8c7\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:33:52.159122 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.159093    2579 generic.go:356] "Generic (PLEG): container finished" podID="002cb747-882a-4cd6-a7c7-997d811f6434" containerID="1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096" exitCode=0
Sep 17 14:33:52.159285 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.159138    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"
Sep 17 14:33:52.159285 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.159168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" event={"ID":"002cb747-882a-4cd6-a7c7-997d811f6434","Type":"ContainerDied","Data":"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"}
Sep 17 14:33:52.159285 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.159209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw" event={"ID":"002cb747-882a-4cd6-a7c7-997d811f6434","Type":"ContainerDied","Data":"44a3530fe1b39da05b3e45da9f089d6593b204845849112dec05a4c0e73f1eb9"}
Sep 17 14:33:52.159285 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.159230    2579 scope.go:117] "RemoveContainer" containerID="1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"
Sep 17 14:33:52.167726 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.167710    2579 scope.go:117] "RemoveContainer" containerID="1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"
Sep 17 14:33:52.168000 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:33:52.167978    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096\": container with ID starting with 1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096 not found: ID does not exist" containerID="1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"
Sep 17 14:33:52.168128 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.168009    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096"} err="failed to get container status \"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096\": rpc error: code = NotFound desc = could not find container \"1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096\": container with ID starting with 1934a5aa03364f502f84ed56d4779ea8037e222ede6d4e8a4e3c86fd38b87096 not found: ID does not exist"
Sep 17 14:33:52.184216 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.184192    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:33:52.190851 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.190819    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw"]
Sep 17 14:33:52.699463 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:33:52.699435    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002cb747-882a-4cd6-a7c7-997d811f6434" path="/var/lib/kubelet/pods/002cb747-882a-4cd6-a7c7-997d811f6434/volumes"
Sep 17 14:34:03.455549 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.455516    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:34:03.456012 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.455723    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68fd759d84-rwqz9" podUID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" containerName="manager" containerID="cri-o://aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab" gracePeriod=30
Sep 17 14:34:03.709733 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.709668    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:34:03.777921 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.777893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert\") pod \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") "
Sep 17 14:34:03.778117 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.777974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs\") pod \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") "
Sep 17 14:34:03.778185 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.778145    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bh4s\" (UniqueName: \"kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s\") pod \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\" (UID: \"a3a4aa6a-c7f9-4668-b722-410f64b90d4a\") "
Sep 17 14:34:03.779967 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.779944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a3a4aa6a-c7f9-4668-b722-410f64b90d4a" (UID: "a3a4aa6a-c7f9-4668-b722-410f64b90d4a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:03.780485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.780465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s" (OuterVolumeSpecName: "kube-api-access-6bh4s") pod "a3a4aa6a-c7f9-4668-b722-410f64b90d4a" (UID: "a3a4aa6a-c7f9-4668-b722-410f64b90d4a"). InnerVolumeSpecName "kube-api-access-6bh4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:34:03.780485 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.780474    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a3a4aa6a-c7f9-4668-b722-410f64b90d4a" (UID: "a3a4aa6a-c7f9-4668-b722-410f64b90d4a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:03.879217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.879187    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:34:03.879217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.879214    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bh4s\" (UniqueName: \"kubernetes.io/projected/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-kube-api-access-6bh4s\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:34:03.879217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:03.879223    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3a4aa6a-c7f9-4668-b722-410f64b90d4a-webhook-cert\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:34:04.215353 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.215319    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" containerID="aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab" exitCode=0
Sep 17 14:34:04.215532 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.215369    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-rwqz9"
Sep 17 14:34:04.215532 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.215408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-rwqz9" event={"ID":"a3a4aa6a-c7f9-4668-b722-410f64b90d4a","Type":"ContainerDied","Data":"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"}
Sep 17 14:34:04.215532 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.215461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-rwqz9" event={"ID":"a3a4aa6a-c7f9-4668-b722-410f64b90d4a","Type":"ContainerDied","Data":"37418d4130c0c1d930d03b1652cec2dd6772a5ddb3a2e1d6ac0eaa7d5b2ac0f8"}
Sep 17 14:34:04.215532 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.215492    2579 scope.go:117] "RemoveContainer" containerID="aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"
Sep 17 14:34:04.225142 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.225126    2579 scope.go:117] "RemoveContainer" containerID="aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"
Sep 17 14:34:04.225411 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:34:04.225392    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab\": container with ID starting with aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab not found: ID does not exist" containerID="aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"
Sep 17 14:34:04.225459 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.225419    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab"} err="failed to get container status \"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab\": rpc error: code = NotFound desc = could not find container \"aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab\": container with ID starting with aae21a61eede74f59ae346bead4dbc6f236645d02f751a4a293e46327b4f67ab not found: ID does not exist"
Sep 17 14:34:04.235425 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.235401    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:34:04.239460 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.239443    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fd759d84-rwqz9"]
Sep 17 14:34:04.700475 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:34:04.700444    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" path="/var/lib/kubelet/pods/a3a4aa6a-c7f9-4668-b722-410f64b90d4a/volumes"
Sep 17 14:35:05.097743 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.097710    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098030    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002cb747-882a-4cd6-a7c7-997d811f6434" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098054    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="002cb747-882a-4cd6-a7c7-997d811f6434" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098069    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1808fafa-4061-4562-959e-212aeddfa605" containerName="payload-pre-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098074    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1808fafa-4061-4562-959e-212aeddfa605" containerName="payload-pre-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098085    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" containerName="maas-api"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098091    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" containerName="maas-api"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098105    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" containerName="manager"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098110    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" containerName="manager"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098118    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45bd073-4131-46fa-a146-8b332db4a0d2" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098123    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45bd073-4131-46fa-a146-8b332db4a0d2" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098129    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edac1388-f81d-4894-a9d5-4576b914bce5" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098134    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="edac1388-f81d-4894-a9d5-4576b914bce5" containerName="payload-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098142    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569a4380-217f-4357-8803-f9da951afa2b" containerName="maas-api"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098147    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="569a4380-217f-4357-8803-f9da951afa2b" containerName="maas-api"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" containerName="payload-pre-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098158    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" containerName="payload-pre-processing"
Sep 17 14:35:05.098209 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098211    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45bd073-4131-46fa-a146-8b332db4a0d2" containerName="payload-processing"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098220    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="569a4380-217f-4357-8803-f9da951afa2b" containerName="maas-api"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098227    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="002cb747-882a-4cd6-a7c7-997d811f6434" containerName="payload-processing"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098233    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a4aa6a-c7f9-4668-b722-410f64b90d4a" containerName="manager"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098238    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1808fafa-4061-4562-959e-212aeddfa605" containerName="payload-pre-processing"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098244    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b19514a5-ea6b-4dbf-9629-abdb7a45f0cc" containerName="payload-pre-processing"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098248    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce341bfe-e414-4cb8-9ab3-53a66a5a106e" containerName="maas-api"
Sep 17 14:35:05.098729 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.098253    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="edac1388-f81d-4894-a9d5-4576b914bce5" containerName="payload-processing"
Sep 17 14:35:05.101088 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.101064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.105273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.105219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 14:35:05.105273 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.105263    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 14:35:05.105472 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.105264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 14:35:05.105472 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.105355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r2wnh\""
Sep 17 14:35:05.115743 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.115722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:05.180947 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.180926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74shp\" (UniqueName: \"kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.181076 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.180976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.181076 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.181004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.281499 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.281476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74shp\" (UniqueName: \"kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.281616 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.281525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.281616 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.281553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.283903 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.283873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.284021 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.283908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.292901 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.292879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74shp\" (UniqueName: \"kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp\") pod \"maas-controller-68fd759d84-n4kg6\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") " pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.410756 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.410700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:05.692627 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.692564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:05.694915 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:35:05.694890    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98558f42_aff9_4c92_8983_5416bb14a826.slice/crio-4b6ae0c3d077c41387b016292650bf335400da1ae646b198b8fe3756a38d3b22 WatchSource:0}: Error finding container 4b6ae0c3d077c41387b016292650bf335400da1ae646b198b8fe3756a38d3b22: Status 404 returned error can't find the container with id 4b6ae0c3d077c41387b016292650bf335400da1ae646b198b8fe3756a38d3b22
Sep 17 14:35:05.696162 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:05.696144    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:35:06.487168 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:06.487129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-n4kg6" event={"ID":"98558f42-aff9-4c92-8983-5416bb14a826","Type":"ContainerStarted","Data":"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"}
Sep 17 14:35:06.487526 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:06.487193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-n4kg6" event={"ID":"98558f42-aff9-4c92-8983-5416bb14a826","Type":"ContainerStarted","Data":"4b6ae0c3d077c41387b016292650bf335400da1ae646b198b8fe3756a38d3b22"}
Sep 17 14:35:06.487526 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:06.487259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:06.511329 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:06.511232    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68fd759d84-n4kg6" podStartSLOduration=0.911196041 podStartE2EDuration="1.511214677s" totalImagesPullingTime="600.018636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:35:06.509725476 +0000 UTC m=+2352.283493151" watchObservedRunningTime="2026-09-17 14:35:06.511214677 +0000 UTC m=+2352.284982348"
Sep 17 14:35:17.493800 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:17.493770    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:27.007644 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.007611    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:27.008084 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.007808    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68fd759d84-n4kg6" podUID="98558f42-aff9-4c92-8983-5416bb14a826" containerName="manager" containerID="cri-o://65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff" gracePeriod=30
Sep 17 14:35:27.247200 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.247177    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:27.358680 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.358654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74shp\" (UniqueName: \"kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp\") pod \"98558f42-aff9-4c92-8983-5416bb14a826\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") "
Sep 17 14:35:27.358837 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.358725    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert\") pod \"98558f42-aff9-4c92-8983-5416bb14a826\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") "
Sep 17 14:35:27.358837 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.358797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs\") pod \"98558f42-aff9-4c92-8983-5416bb14a826\" (UID: \"98558f42-aff9-4c92-8983-5416bb14a826\") "
Sep 17 14:35:27.360679 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.360654    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "98558f42-aff9-4c92-8983-5416bb14a826" (UID: "98558f42-aff9-4c92-8983-5416bb14a826"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:27.360793 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.360683    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "98558f42-aff9-4c92-8983-5416bb14a826" (UID: "98558f42-aff9-4c92-8983-5416bb14a826"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:27.360793 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.360726    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp" (OuterVolumeSpecName: "kube-api-access-74shp") pod "98558f42-aff9-4c92-8983-5416bb14a826" (UID: "98558f42-aff9-4c92-8983-5416bb14a826"). InnerVolumeSpecName "kube-api-access-74shp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:35:27.459438 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.459411    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:35:27.459438 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.459434    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74shp\" (UniqueName: \"kubernetes.io/projected/98558f42-aff9-4c92-8983-5416bb14a826-kube-api-access-74shp\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:35:27.459584 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.459443    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98558f42-aff9-4c92-8983-5416bb14a826-webhook-cert\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:35:27.583305 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.583277    2579 generic.go:356] "Generic (PLEG): container finished" podID="98558f42-aff9-4c92-8983-5416bb14a826" containerID="65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff" exitCode=0
Sep 17 14:35:27.583428 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.583320    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-n4kg6"
Sep 17 14:35:27.583428 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.583359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-n4kg6" event={"ID":"98558f42-aff9-4c92-8983-5416bb14a826","Type":"ContainerDied","Data":"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"}
Sep 17 14:35:27.583428 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.583419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-n4kg6" event={"ID":"98558f42-aff9-4c92-8983-5416bb14a826","Type":"ContainerDied","Data":"4b6ae0c3d077c41387b016292650bf335400da1ae646b198b8fe3756a38d3b22"}
Sep 17 14:35:27.583538 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.583442    2579 scope.go:117] "RemoveContainer" containerID="65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"
Sep 17 14:35:27.592166 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.592149    2579 scope.go:117] "RemoveContainer" containerID="65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"
Sep 17 14:35:27.592428 ip-10-0-132-81 kubenswrapper[2579]: E0917 14:35:27.592409    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff\": container with ID starting with 65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff not found: ID does not exist" containerID="65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"
Sep 17 14:35:27.592475 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.592436    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff"} err="failed to get container status \"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff\": rpc error: code = NotFound desc = could not find container \"65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff\": container with ID starting with 65827e76eeacb5964bff220eee431d1f5c9ecb128d070e8415ad405b69ea5dff not found: ID does not exist"
Sep 17 14:35:27.604498 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.604468    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:27.610063 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:27.610001    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fd759d84-n4kg6"]
Sep 17 14:35:28.455496 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.455461    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fd759d84-zl5pb"]
Sep 17 14:35:28.455880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.455800    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98558f42-aff9-4c92-8983-5416bb14a826" containerName="manager"
Sep 17 14:35:28.455880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.455811    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98558f42-aff9-4c92-8983-5416bb14a826" containerName="manager"
Sep 17 14:35:28.455880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.455874    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98558f42-aff9-4c92-8983-5416bb14a826" containerName="manager"
Sep 17 14:35:28.459976 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.459959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.462464 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.462442    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 14:35:28.462570 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.462499    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r2wnh\""
Sep 17 14:35:28.463168 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.463152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 14:35:28.463217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.463167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 14:35:28.481774 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.481750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-zl5pb"]
Sep 17 14:35:28.567020 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.566989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-metrics-certs\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.567169 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.567033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg54z\" (UniqueName: \"kubernetes.io/projected/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-kube-api-access-qg54z\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.567169 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.567113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-webhook-cert\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.668499 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.668472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-webhook-cert\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.668631 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.668534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-metrics-certs\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.668631 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.668619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg54z\" (UniqueName: \"kubernetes.io/projected/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-kube-api-access-qg54z\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.670880 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.670858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-metrics-certs\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.670972 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.670911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-webhook-cert\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.689197 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.689171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg54z\" (UniqueName: \"kubernetes.io/projected/8fc99fc6-0f62-46ee-8d73-7f957f229a4d-kube-api-access-qg54z\") pod \"maas-controller-68fd759d84-zl5pb\" (UID: \"8fc99fc6-0f62-46ee-8d73-7f957f229a4d\") " pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:28.699970 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.699948    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98558f42-aff9-4c92-8983-5416bb14a826" path="/var/lib/kubelet/pods/98558f42-aff9-4c92-8983-5416bb14a826/volumes"
Sep 17 14:35:28.769885 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:28.769830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:29.042760 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:29.042682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fd759d84-zl5pb"]
Sep 17 14:35:29.045446 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:35:29.045413    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc99fc6_0f62_46ee_8d73_7f957f229a4d.slice/crio-1bca9e531f0b444880e7597b13164b6b4b9a40aa7b3cac79fdb98079d20b347c WatchSource:0}: Error finding container 1bca9e531f0b444880e7597b13164b6b4b9a40aa7b3cac79fdb98079d20b347c: Status 404 returned error can't find the container with id 1bca9e531f0b444880e7597b13164b6b4b9a40aa7b3cac79fdb98079d20b347c
Sep 17 14:35:29.596105 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:29.596067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-zl5pb" event={"ID":"8fc99fc6-0f62-46ee-8d73-7f957f229a4d","Type":"ContainerStarted","Data":"e3370eadbf5f160457a84643fe70de076e5d23b9729295c9dc79acf5c729fba9"}
Sep 17 14:35:29.596498 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:29.596116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fd759d84-zl5pb" event={"ID":"8fc99fc6-0f62-46ee-8d73-7f957f229a4d","Type":"ContainerStarted","Data":"1bca9e531f0b444880e7597b13164b6b4b9a40aa7b3cac79fdb98079d20b347c"}
Sep 17 14:35:29.596498 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:29.596244    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:29.620235 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:29.620186    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68fd759d84-zl5pb" podStartSLOduration=1.222587821 podStartE2EDuration="1.620171384s" totalImagesPullingTime="397.583563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:35:29.617413594 +0000 UTC m=+2375.391181264" watchObservedRunningTime="2026-09-17 14:35:29.620171384 +0000 UTC m=+2375.393939054"
Sep 17 14:35:40.603422 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:40.603388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68fd759d84-zl5pb"
Sep 17 14:35:54.813917 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:54.813884    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:35:54.823170 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:35:54.823148    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:38:58.358366 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.358331    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"]
Sep 17 14:38:58.361996 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.361963    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.371999 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.371957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"]
Sep 17 14:38:58.463195 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.463167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4872b922-cba6-43d5-9b37-6f381aacc6b7-openshift-service-ca\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.463195 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.463199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-metrics-certs\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.463439 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.463238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-maas-api-tls\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.463439 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.463382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nn5j\" (UniqueName: \"kubernetes.io/projected/4872b922-cba6-43d5-9b37-6f381aacc6b7-kube-api-access-9nn5j\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.564208 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.564178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4872b922-cba6-43d5-9b37-6f381aacc6b7-openshift-service-ca\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.564208 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.564211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-metrics-certs\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.564440 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.564247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-maas-api-tls\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.564440 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.564296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nn5j\" (UniqueName: \"kubernetes.io/projected/4872b922-cba6-43d5-9b37-6f381aacc6b7-kube-api-access-9nn5j\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.564806 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.564775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4872b922-cba6-43d5-9b37-6f381aacc6b7-openshift-service-ca\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.566718 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.566695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-maas-api-tls\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.566718 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.566715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4872b922-cba6-43d5-9b37-6f381aacc6b7-metrics-certs\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.573784 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.573754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nn5j\" (UniqueName: \"kubernetes.io/projected/4872b922-cba6-43d5-9b37-6f381aacc6b7-kube-api-access-9nn5j\") pod \"maas-api-74ddfb899-cz5pj\" (UID: \"4872b922-cba6-43d5-9b37-6f381aacc6b7\") " pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.675577 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.675509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:58.949520 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:58.949422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"]
Sep 17 14:38:58.952181 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:38:58.952146    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4872b922_cba6_43d5_9b37_6f381aacc6b7.slice/crio-dbfc59fea36331da46a6e9c2c8df0b8d6e2bda8f806f12c08937c62c75db593c WatchSource:0}: Error finding container dbfc59fea36331da46a6e9c2c8df0b8d6e2bda8f806f12c08937c62c75db593c: Status 404 returned error can't find the container with id dbfc59fea36331da46a6e9c2c8df0b8d6e2bda8f806f12c08937c62c75db593c
Sep 17 14:38:59.524402 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:59.524366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj" event={"ID":"4872b922-cba6-43d5-9b37-6f381aacc6b7","Type":"ContainerStarted","Data":"23c25b1b6b427fc17d4a1c8586c1baa90967354e16d166371ea3d8d88838caf6"}
Sep 17 14:38:59.524784 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:59.524463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:38:59.524784 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:59.524490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj" event={"ID":"4872b922-cba6-43d5-9b37-6f381aacc6b7","Type":"ContainerStarted","Data":"dbfc59fea36331da46a6e9c2c8df0b8d6e2bda8f806f12c08937c62c75db593c"}
Sep 17 14:38:59.546786 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:38:59.546738    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj" podStartSLOduration=1.038389572 podStartE2EDuration="1.546722641s" totalImagesPullingTime="508.333069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:38:59.545021357 +0000 UTC m=+2585.318789029" watchObservedRunningTime="2026-09-17 14:38:59.546722641 +0000 UTC m=+2585.320490334"
Sep 17 14:39:05.534560 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:05.534528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74ddfb899-cz5pj"
Sep 17 14:39:13.084700 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:13.084665    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:39:13.085107 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:13.084894    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerName="maas-api" containerID="cri-o://81aa163963c3e7a88ee05e5ecd6aa77316595510e9e9ee362c8904c394536649" gracePeriod=30
Sep 17 14:39:13.707571 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:13.707518    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.28:8443/health\": dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 17 14:39:14.589404 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.589315    2579 generic.go:356] "Generic (PLEG): container finished" podID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerID="81aa163963c3e7a88ee05e5ecd6aa77316595510e9e9ee362c8904c394536649" exitCode=0
Sep 17 14:39:14.589751 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.589397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" event={"ID":"4cf34504-9f29-46ab-973a-a1e5c62461c7","Type":"ContainerDied","Data":"81aa163963c3e7a88ee05e5ecd6aa77316595510e9e9ee362c8904c394536649"}
Sep 17 14:39:14.829027 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.829007    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:39:14.894960 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.894935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5v4n\" (UniqueName: \"kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n\") pod \"4cf34504-9f29-46ab-973a-a1e5c62461c7\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") "
Sep 17 14:39:14.895105 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.894987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca\") pod \"4cf34504-9f29-46ab-973a-a1e5c62461c7\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") "
Sep 17 14:39:14.895105 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.895090    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls\") pod \"4cf34504-9f29-46ab-973a-a1e5c62461c7\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") "
Sep 17 14:39:14.895189 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.895121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs\") pod \"4cf34504-9f29-46ab-973a-a1e5c62461c7\" (UID: \"4cf34504-9f29-46ab-973a-a1e5c62461c7\") "
Sep 17 14:39:14.895434 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.895403    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4cf34504-9f29-46ab-973a-a1e5c62461c7" (UID: "4cf34504-9f29-46ab-973a-a1e5c62461c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:39:14.897248 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.897226    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4cf34504-9f29-46ab-973a-a1e5c62461c7" (UID: "4cf34504-9f29-46ab-973a-a1e5c62461c7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:39:14.897344 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.897319    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4cf34504-9f29-46ab-973a-a1e5c62461c7" (UID: "4cf34504-9f29-46ab-973a-a1e5c62461c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:39:14.897406 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.897387    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n" (OuterVolumeSpecName: "kube-api-access-c5v4n") pod "4cf34504-9f29-46ab-973a-a1e5c62461c7" (UID: "4cf34504-9f29-46ab-973a-a1e5c62461c7"). InnerVolumeSpecName "kube-api-access-c5v4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:39:14.995907 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.995876    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5v4n\" (UniqueName: \"kubernetes.io/projected/4cf34504-9f29-46ab-973a-a1e5c62461c7-kube-api-access-c5v4n\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:39:14.995907 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.995903    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf34504-9f29-46ab-973a-a1e5c62461c7-openshift-service-ca\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:39:14.996080 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.995917    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-maas-api-tls\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:39:14.996080 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:14.995929    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf34504-9f29-46ab-973a-a1e5c62461c7-metrics-certs\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\""
Sep 17 14:39:15.595792 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:15.595762    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"
Sep 17 14:39:15.596259 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:15.595756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q" event={"ID":"4cf34504-9f29-46ab-973a-a1e5c62461c7","Type":"ContainerDied","Data":"2d819ba3127f6e0753d3c7af3828f171353cb8962d37a8f4404b300fd0d4f743"}
Sep 17 14:39:15.596259 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:15.595923    2579 scope.go:117] "RemoveContainer" containerID="81aa163963c3e7a88ee05e5ecd6aa77316595510e9e9ee362c8904c394536649"
Sep 17 14:39:15.618921 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:15.618898    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:39:15.624418 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:15.624391    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f544fdfdc-txf2q"]
Sep 17 14:39:16.699561 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:16.699528    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" path="/var/lib/kubelet/pods/4cf34504-9f29-46ab-973a-a1e5c62461c7/volumes"
Sep 17 14:39:36.581235 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:36.581205    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68fd759d84-zl5pb_8fc99fc6-0f62-46ee-8d73-7f957f229a4d/manager/0.log"
Sep 17 14:39:36.965786 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:36.965756    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fcc687555-9nl87_04f5ed79-bf6e-4410-a000-d3840faefd1e/copy-manifests/0.log"
Sep 17 14:39:36.973984 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:36.973958    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fcc687555-9nl87_04f5ed79-bf6e-4410-a000-d3840faefd1e/manager/0.log"
Sep 17 14:39:37.600013 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:37.599984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74ddfb899-cz5pj_4872b922-cba6-43d5-9b37-6f381aacc6b7/maas-api/0.log"
Sep 17 14:39:38.053272 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:38.053199    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ppcgx_8b661136-b4b2-42a0-8347-f3e2f176ba26/postgres/0.log"
Sep 17 14:39:40.061217 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:40.061182    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gq57h_e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f/discovery/0.log"
Sep 17 14:39:40.526094 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:40.526062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dtxcn_78d59da8-cc07-424b-8dba-d2670c520f04/payload-pre-processing/0.log"
Sep 17 14:39:40.647782 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:40.647737    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:39:41.472362 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:41.472332    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jhl9r_2c80e2b0-98e0-4182-ae28-5a7caf7b65fc/main/0.log"
Sep 17 14:39:41.596067 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:41.596021    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxnvzv_a7212164-71f3-4a92-b9a2-573f33d9f6d2/main/0.log"
Sep 17 14:39:50.460755 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:50.460720    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jf4rd_7be94a50-fb9b-44c3-9738-e310c9e469b9/global-pull-secret-syncer/0.log"
Sep 17 14:39:50.619766 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:50.619726    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tf84j_ff9a013f-30ec-4d8a-8200-47d3547cb419/konnectivity-agent/0.log"
Sep 17 14:39:50.758612 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:50.758528    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-81.ec2.internal_1154ca9b081a22b9ada33774b1f2200d/haproxy/0.log"
Sep 17 14:39:57.891595 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:57.891565    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-fd9vw_1b22f679-85e1-4a60-bf7e-54bfc8d2d5f7/cluster-monitoring-operator/0.log"
Sep 17 14:39:58.106503 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.106473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86f66fd88b-92txb_73382f35-4ba9-43e0-8e4e-10b8e9064cf3/metrics-server/0.log"
Sep 17 14:39:58.231153 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.231081    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqxl_2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c/node-exporter/0.log"
Sep 17 14:39:58.256309 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.256286    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqxl_2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c/kube-rbac-proxy/0.log"
Sep 17 14:39:58.284179 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.284162    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqxl_2fb7ee68-cad5-4d21-b5cc-27e9482ebd8c/init-textfile/0.log"
Sep 17 14:39:58.596440 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.596415    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/prometheus/0.log"
Sep 17 14:39:58.620176 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.620147    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/config-reloader/0.log"
Sep 17 14:39:58.647858 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.647835    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/thanos-sidecar/0.log"
Sep 17 14:39:58.675143 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.675120    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/kube-rbac-proxy-web/0.log"
Sep 17 14:39:58.701454 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.701433    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/kube-rbac-proxy/0.log"
Sep 17 14:39:58.726960 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.726934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/kube-rbac-proxy-thanos/0.log"
Sep 17 14:39:58.757320 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:58.757300    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4432f2cf-8880-44cf-aefd-8d154bf57716/init-config-reloader/0.log"
Sep 17 14:39:59.590741 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.590705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"]
Sep 17 14:39:59.591134 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.591068    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerName="maas-api"
Sep 17 14:39:59.591134 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.591079    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerName="maas-api"
Sep 17 14:39:59.591134 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.591135    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf34504-9f29-46ab-973a-a1e5c62461c7" containerName="maas-api"
Sep 17 14:39:59.595243 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.595227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.599711 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.599692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g9q75\"/\"default-dockercfg-9jrgw\""
Sep 17 14:39:59.600084 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.600064    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g9q75\"/\"openshift-service-ca.crt\""
Sep 17 14:39:59.600560 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.600545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g9q75\"/\"kube-root-ca.crt\""
Sep 17 14:39:59.608549 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.608526    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"]
Sep 17 14:39:59.768437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.768408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-podres\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.768437 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.768440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs75h\" (UniqueName: \"kubernetes.io/projected/38863b66-864d-491f-957d-19f27ecb67d0-kube-api-access-rs75h\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.768622 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.768459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-lib-modules\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.768622 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.768582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-sys\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.768688 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.768630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-proc\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869760 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-podres\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869760 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs75h\" (UniqueName: \"kubernetes.io/projected/38863b66-864d-491f-957d-19f27ecb67d0-kube-api-access-rs75h\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-lib-modules\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-podres\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-sys\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.869966 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-lib-modules\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.870138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.869989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-proc\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.870138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.870005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-sys\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.870138 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.870093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38863b66-864d-491f-957d-19f27ecb67d0-proc\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.878344 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.878325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs75h\" (UniqueName: \"kubernetes.io/projected/38863b66-864d-491f-957d-19f27ecb67d0-kube-api-access-rs75h\") pod \"perf-node-gather-daemonset-vq7hs\" (UID: \"38863b66-864d-491f-957d-19f27ecb67d0\") " pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:39:59.905223 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:39:59.905201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:40:00.184998 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:00.184919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"]
Sep 17 14:40:00.187878 ip-10-0-132-81 kubenswrapper[2579]: W0917 14:40:00.187848    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38863b66_864d_491f_957d_19f27ecb67d0.slice/crio-9d12b265fc9eeb9b71cb910e7ed92e887f6a06fde29892899cc7b0bd71d1bb49 WatchSource:0}: Error finding container 9d12b265fc9eeb9b71cb910e7ed92e887f6a06fde29892899cc7b0bd71d1bb49: Status 404 returned error can't find the container with id 9d12b265fc9eeb9b71cb910e7ed92e887f6a06fde29892899cc7b0bd71d1bb49
Sep 17 14:40:00.790939 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:00.790897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs" event={"ID":"38863b66-864d-491f-957d-19f27ecb67d0","Type":"ContainerStarted","Data":"69405a9b740ec08a4533d1948dbe8f7f5bdfe50ef03e4499c239fad7e2e8a69c"}
Sep 17 14:40:00.791372 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:00.790959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs" event={"ID":"38863b66-864d-491f-957d-19f27ecb67d0","Type":"ContainerStarted","Data":"9d12b265fc9eeb9b71cb910e7ed92e887f6a06fde29892899cc7b0bd71d1bb49"}
Sep 17 14:40:00.791372 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:00.790995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:40:00.829143 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:00.829092    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs" podStartSLOduration=1.829077617 podStartE2EDuration="1.829077617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:40:00.82719045 +0000 UTC m=+2646.600958119" watchObservedRunningTime="2026-09-17 14:40:00.829077617 +0000 UTC m=+2646.602845287"
Sep 17 14:40:01.021902 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:01.021874    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/1.log"
Sep 17 14:40:01.029908 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:01.029875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ctlc8_4f2104af-88ed-429e-9334-5768a8418ab7/console-operator/2.log"
Sep 17 14:40:03.789891 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:03.789859    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rc6vk_9e96b0a5-cab9-41ab-89b4-8c2f49406c52/dns/0.log"
Sep 17 14:40:03.821924 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:03.821896    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rc6vk_9e96b0a5-cab9-41ab-89b4-8c2f49406c52/kube-rbac-proxy/0.log"
Sep 17 14:40:03.884112 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:03.884084    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lr9q_be719d5c-af1b-41b7-a098-470920b14b9f/dns-node-resolver/0.log"
Sep 17 14:40:04.680640 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:04.680611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml2lf_4a57b777-ef9d-4fbb-a5ee-b77cdb84ecd5/node-ca/0.log"
Sep 17 14:40:06.630354 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:06.630323    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gq57h_e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f/discovery/0.log"
Sep 17 14:40:06.762457 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:06.762421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dtxcn_78d59da8-cc07-424b-8dba-d2670c520f04/payload-pre-processing/0.log"
Sep 17 14:40:06.805531 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:06.805506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g9q75/perf-node-gather-daemonset-vq7hs"
Sep 17 14:40:06.805953 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:06.805926    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:40:07.751497 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:07.751451    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8m4sd_bde1eaca-c657-4461-b8ac-61bff2a41ac2/serve-healthcheck-canary/0.log"
Sep 17 14:40:08.792501 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:08.792418    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5thsn_f18133cd-99fa-4780-b31a-3f2e0e4d5593/kube-rbac-proxy/0.log"
Sep 17 14:40:08.862233 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:08.862206    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5thsn_f18133cd-99fa-4780-b31a-3f2e0e4d5593/exporter/0.log"
Sep 17 14:40:08.964419 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:08.964393    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5thsn_f18133cd-99fa-4780-b31a-3f2e0e4d5593/extractor/0.log"
Sep 17 14:40:11.254838 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:11.254702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gq57h_e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f/discovery/0.log"
Sep 17 14:40:11.442875 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:11.442802    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dtxcn_78d59da8-cc07-424b-8dba-d2670c520f04/payload-pre-processing/0.log"
Sep 17 14:40:11.483777 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:11.483746    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:40:12.093079 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:12.093028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68fd759d84-zl5pb_8fc99fc6-0f62-46ee-8d73-7f957f229a4d/manager/0.log"
Sep 17 14:40:12.309708 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:12.309680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fcc687555-9nl87_04f5ed79-bf6e-4410-a000-d3840faefd1e/manager/0.log"
Sep 17 14:40:12.359290 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:12.359270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fcc687555-9nl87_04f5ed79-bf6e-4410-a000-d3840faefd1e/copy-manifests/0.log"
Sep 17 14:40:13.624597 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:13.624569    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gq57h_e9b7ee79-a1a6-4b43-b1dc-793db1eacf4f/discovery/0.log"
Sep 17 14:40:13.925861 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:13.925784    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dtxcn_78d59da8-cc07-424b-8dba-d2670c520f04/payload-pre-processing/0.log"
Sep 17 14:40:13.975364 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:13.975326    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nc6v5_3273d9cd-e05a-41e8-a0a7-fbc69858b950/payload-processing/0.log"
Sep 17 14:40:14.423505 ip-10-0-132-81 kubenswrapper[2579]: I0917 14:40:14.423477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69b649694d-znxzk_198fe2e8-25a3-4ff4-a264-c6b2acbe17b0/manager/0.log"