Sep 10 23:31:31.325577 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 23:31:31.325586 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 23:31:31.325594 ip-10-0-143-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 23:31:31.325804 ip-10-0-143-95 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 23:31:41.483100 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 23:31:41.483116 ip-10-0-143-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 357e1378e9d44c02a39ea327d2655857 --
Sep 10 23:33:33.803598 ip-10-0-143-95 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 23:33:34.205403 ip-10-0-143-95 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:34.205403 ip-10-0-143-95 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 23:33:34.205403 ip-10-0-143-95 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:34.205403 ip-10-0-143-95 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 23:33:34.205403 ip-10-0-143-95 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:33:34.206506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.206424    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 23:33:34.211551 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211535    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.211551 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211551    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211555    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211558    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211561    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211564    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211567    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211570    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211573    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211576    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211579    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211581    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211584    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211587    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211589    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211592    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211594    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211597    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211600    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211602    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211605    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.211615 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211608    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211611    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211614    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211616    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211619    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211622    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211625    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211628    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211631    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211634    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211636    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211639    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211642    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211644    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211647    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211649    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211652    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211656    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211659    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.212097 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211662    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211665    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211667    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211670    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211672    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211675    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211677    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211680    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211683    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211685    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211694    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211697    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211699    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211702    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211704    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211709    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211714    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211717    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211720    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.212676 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211723    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211725    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211730    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211733    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211736    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211739    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211742    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211744    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211747    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211749    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211752    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211754    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211757    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211760    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211762    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211765    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211768    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211770    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211773    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211775    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.213155 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211778    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211780    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211783    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211787    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211789    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211792    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211794    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211797    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211800    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211803    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211806    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211809    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211811    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211814    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211817    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211820    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211822    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211825    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211827    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.211830    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.213665 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212506    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212513    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212516    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212519    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212522    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212526    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212529    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212531    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212534    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212537    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212539    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212542    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212547    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212551    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212554    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212556    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212559    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212562    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212565    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.214148 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212568    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212572    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212575    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212578    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212581    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212583    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212587    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212589    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212592    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212595    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212598    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212600    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212603    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212606    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212608    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212611    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212613    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212616    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212618    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.214654 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212624    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212627    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212631    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212633    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212636    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212639    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212641    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212644    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212647    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212649    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212652    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212655    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212657    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212661    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212664    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212666    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212669    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212672    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212674    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212677    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212680    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.215132 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212682    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212685    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212688    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212691    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212693    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212696    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212699    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212701    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212703    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212706    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212709    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212711    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212714    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212718    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212720    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212723    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212727    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212729    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212732    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212734    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.215667 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212737    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212741    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212744    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212747    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212750    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212752    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212755    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212758    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212760    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212763    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212766    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212768    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212771    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212774    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212776    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212779    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212782    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212784    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212787    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.212789    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.216190 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213150    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213155    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213157    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213160    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213164    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213169    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213173    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213177    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213181    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213184    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213188    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213192    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213196    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213200    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213204    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213207    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213211    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213217    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213222    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.216701 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213227    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213233    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213237    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213241    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213246    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213250    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213253    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213258    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213262    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213266    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213270    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213274    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213277    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213282    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213287    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213291    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213310    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213314    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213321    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.217201 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213325    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213334    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213341    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213346    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213349    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213354    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213356    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213359    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213362    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213364    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213367    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213370    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213373    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213375    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213378    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213380    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213383    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213386    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213389    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213391    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.217688 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213394    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213396    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213399    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213402    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213404    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213407    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213409    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213412    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213414    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213417    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213419    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213422    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213425    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213430    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213433    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213436    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213438    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213441    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213444    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213446    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.218184 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213450    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213453    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213456    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213460    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213464    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213467    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213470    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213473    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213476    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213479    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213481    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213484    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213487    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213490    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213492    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213495    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213497    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213500    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213503    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.218720 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213505    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.213508    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213585    2566 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213620    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213627    2566 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213631    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213638    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213642    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213646    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213651    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213654    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213657    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213661    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213664    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213667    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213671    2566 flags.go:64] FLAG: --cgroup-root=""
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213674    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213677    2566 flags.go:64] FLAG: --client-ca-file=""
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213680    2566 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213683    2566 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213688    2566 flags.go:64] FLAG: --cluster-domain=""
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213691    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213694    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213697    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 23:33:34.219179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213701    2566 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213704    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213707    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213710    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213714    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213717    2566 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213720    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213723    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213726    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213729    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213733    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213736    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213739    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213742    2566 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213747    2566 flags.go:64] FLAG: --enable-server="true"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213751    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213756    2566 flags.go:64] FLAG: --event-burst="100"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213759    2566 flags.go:64] FLAG: --event-qps="50"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213762    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213765    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213768    2566 flags.go:64] FLAG: --eviction-hard=""
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213772    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213775    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213779    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213782    2566 flags.go:64] FLAG: --eviction-soft=""
Sep 10 23:33:34.219765 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213785    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213787    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213791    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213794    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213797    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213800    2566 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213802    2566 flags.go:64] FLAG: --feature-gates=""
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213806    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213809    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213812    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213815    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213818    2566 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213822    2566 flags.go:64] FLAG: --help="false"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213824    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213828    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213831    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213834    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213837    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213841    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213844    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213847    2566 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213852    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213856    2566 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 23:33:34.220392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213863    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213866    2566 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213869    2566 flags.go:64] FLAG: --kube-reserved=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213872    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213875    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213878    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213881    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213884    2566 flags.go:64] FLAG: --lock-file=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213887    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213890    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213893    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213898    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213901    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213904    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213907    2566 flags.go:64] FLAG: --logging-format="text"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213910    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213913    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213916    2566 flags.go:64] FLAG: --manifest-url=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213919    2566 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213924    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213927    2566 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213931    2566 flags.go:64] FLAG: --max-pods="110"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213934    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213938    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213940    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 23:33:34.221026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213943    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213947    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213950    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213953    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213960    2566 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213964    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213969    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213972    2566 flags.go:64] FLAG: --pod-cidr=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213975    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213981    2566 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213984    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213987    2566 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213990    2566 flags.go:64] FLAG: --port="10250"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213993    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213996    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fdcaffa9c371969d"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.213999    2566 flags.go:64] FLAG: --qos-reserved=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214002    2566 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214005    2566 flags.go:64] FLAG: --register-node="true"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214008    2566 flags.go:64] FLAG: --register-with-taints=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214012    2566 flags.go:64] FLAG: --registry-burst="10"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214015    2566 flags.go:64] FLAG: --registry-qps="5"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214018    2566 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214021    2566 flags.go:64] FLAG: --reserved-memory=""
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214024    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214027    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 23:33:34.221675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214030    2566 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214033    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214036    2566 flags.go:64] FLAG: --runonce="false"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214039    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214042    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214045    2566 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214048    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214051    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214054    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214057    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214060    2566 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214063    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214067    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214070    2566 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214074    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214077    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214081    2566 flags.go:64] FLAG: --system-cgroups=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214084    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214089    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214092    2566 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214095    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214099    2566 flags.go:64] FLAG: --tls-min-version=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214102    2566 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214105    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214108    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 23:33:34.222347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214111    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214114    2566 flags.go:64] FLAG: --v="2"
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214118    2566 flags.go:64] FLAG: --version="false"
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214121    2566 flags.go:64] FLAG: --vmodule=""
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214125    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214128    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214237    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214241    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214245    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214248    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214251    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214254    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214257    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214259    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214262    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214265    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214267    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214270    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214273    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214277    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214279    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.222971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214283    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214285    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214288    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214291    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214309    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214312    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214315    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214318    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214321    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214323    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214326    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214329    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214331    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214334    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214336    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214339    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214341    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214344    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214346    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.223504 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214349    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214352    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214354    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214357    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214360    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214362    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214365    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214367    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214370    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214372    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214376    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214380    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214384    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214387    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214390    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214393    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214395    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214399    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214402    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214405    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.223981 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214407    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214410    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214412    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214415    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214418    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214420    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214423    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214425    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214428    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214431    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214433    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214436    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214440    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214443    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214446    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214449    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214451    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214454    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214457    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.224519 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214459    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214462    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214464    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214467    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214470    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214472    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214475    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214477    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214480    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214482    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214485    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214488    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214490    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214493    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214495    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214497    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214500    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214503    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214505    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214508    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.225138 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214510    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214513    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214515    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214518    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214522    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.214525    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.214530    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.222229    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.222247    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.223110    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.223121    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223185    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223190    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223194    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.225896 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223197    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223202    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223206    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223209    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223212    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223215    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223218    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223221    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223224    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223227    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223230    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223232    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223235    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223238    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223240    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223243    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223246    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223249    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223251    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.226285 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223254    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223257    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223259    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223262    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223264    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223267    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223270    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223280    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223283    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223285    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223288    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223290    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223305    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223310    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223312    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223315    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223318    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223320    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223323    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223325    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.226781 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223328    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223331    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223333    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223336    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223339    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223342    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223344    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223347    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223349    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223352    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223355    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223359    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223362    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223365    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223369    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223372    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223375    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223378    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223380    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.227496 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223383    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223392    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223395    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223399    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223401    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223404    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223406    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223409    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223411    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223414    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223416    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223419    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223421    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223424    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223427    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223431    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223434    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223437    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223440    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.228063 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223443    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223445    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223448    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223450    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223453    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223456    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223459    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223461    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223464    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223466    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223469    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223472    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223474    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223477    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223479    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223487    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223490    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223492    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.228570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223495    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.223500    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223652    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223657    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223660    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223663    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223665    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223668    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223671    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223680    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223682    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223685    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223688    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223690    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223693    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:33:34.229008 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223696    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223698    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223701    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223703    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223706    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223709    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223712    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223714    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223717    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223720    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223722    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223725    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223727    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223730    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223732    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223740    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223743    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223746    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223748    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223751    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:33:34.229474 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223754    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223756    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223759    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223761    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223764    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223768    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223771    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223774    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223778    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223782    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223785    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223788    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223790    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223793    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223795    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223798    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223800    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223803    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223807    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:33:34.229962 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223810    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223813    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223816    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223819    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223822    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223824    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223827    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223830    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223832    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223842    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223844    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223847    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223849    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223852    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223855    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223857    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223860    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223862    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223864    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223867    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:33:34.230481 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223870    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223872    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223875    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223877    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223880    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223882    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223885    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223887    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223890    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223895    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223898    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223900    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223903    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223906    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223909    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223911    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223914    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223916    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223919    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223921    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:33:34.230983 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223924    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223927    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223935    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223938    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223941    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223943    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:34.223945    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.223951    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.224051    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.229019    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.230108    2566 server.go:1019] "Starting client certificate rotation"
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.230206    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:33:34.231588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.230237    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:33:34.233433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.233418    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:33:34.234640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.234622    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:33:34.246077 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.246057    2566 log.go:25] "Validated CRI v1 runtime API"
Sep 10 23:33:34.249382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.249366    2566 log.go:25] "Validated CRI v1 image API"
Sep 10 23:33:34.250215 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.250198    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 23:33:34.253684 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.253662    2566 fs.go:135] Filesystem UUIDs: map[5016c053-c122-4997-b1a5-f9d5f1d740ae:/dev/nvme0n1p4 6d9e1a21-c398-4313-95fb-5c253ea8308b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 10 23:33:34.253749 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.253683    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 23:33:34.258691 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.258675    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:33:34.259142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.259039    2566 manager.go:216] Machine: {Timestamp:2026-09-10 23:33:34.258496268 +0000 UTC m=+0.362783053 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100399 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a73462307762082f58ae6690c9249 SystemUUID:ec2a7346-2307-7620-82f5-8ae6690c9249 BootID:357e1378-e9d4-4c02-a39e-a327d2655857 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:18:3a:3c:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:18:3a:3c:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:86:2a:ab:70:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 23:33:34.259142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.259139    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 23:33:34.259269 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.259211    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 23:33:34.261775 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.261745    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 23:33:34.261905 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.261778    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 23:33:34.262602 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.262592    2566 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 23:33:34.262638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.262604    2566 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 23:33:34.262638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.262612    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:33:34.263623 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.263613    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:33:34.264830 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.264820    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 23:33:34.269441 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269429    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:33:34.269547 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269538    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 23:33:34.269581 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269567    2566 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 23:33:34.269581 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269577    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 23:33:34.269634 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269591    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 23:33:34.269634 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269601    2566 kubelet.go:398] "Adding apiserver pod source"
Sep 10 23:33:34.269634 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.269610    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 23:33:34.270091 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.270074    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:33:34.270133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.270108    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:33:34.274493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.274471    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 23:33:34.277453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.277435    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 23:33:34.277534 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.277474    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 23:33:34.281288 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281274    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281306    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281317    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281325    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281348    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281357    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281377    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281386    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 23:33:34.281392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281396    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 23:33:34.281642 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281406    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 23:33:34.281642 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281419    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 23:33:34.281642 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.281429    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 23:33:34.282342 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.282330    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 23:33:34.282412 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.282345    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 23:33:34.284709 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.284686    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 23:33:34.285723 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.285693    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 23:33:34.285723 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.285693    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 23:33:34.286547 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.286531    2566 server.go:1268] "Started kubelet"
Sep 10 23:33:34.286655 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.286613    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 23:33:34.286769 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.286673    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 23:33:34.286769 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.286745    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 23:33:34.287463 ip-10-0-143-95 systemd[1]: Started Kubernetes Kubelet.
Sep 10 23:33:34.288478 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.288460    2566 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 23:33:34.288758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.288733    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 23:33:34.291329 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.291308    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbf84"
Sep 10 23:33:34.291602 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.291501    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 23:33:34.296882 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.296863    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 23:33:34.297548 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.297533    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 23:33:34.297679 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.297654    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.298352 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298330    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 23:33:34.298429 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298355    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 23:33:34.298429 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298371    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbf84"
Sep 10 23:33:34.298429 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298336    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 23:33:34.298575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298453    2566 factory.go:55] Registering systemd factory
Sep 10 23:33:34.298575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298468    2566 factory.go:223] Registration of the systemd container factory successfully
Sep 10 23:33:34.298575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298482    2566 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 23:33:34.298575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298493    2566 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 23:33:34.298762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298648    2566 factory.go:153] Registering CRI-O factory
Sep 10 23:33:34.298762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298659    2566 factory.go:223] Registration of the crio container factory successfully
Sep 10 23:33:34.298762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298707    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 23:33:34.298762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298727    2566 factory.go:103] Registering Raw factory
Sep 10 23:33:34.298762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.298741    2566 manager.go:1196] Started watching for new ooms in manager
Sep 10 23:33:34.299860 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.299820    2566 manager.go:349] Starting recovery of all containers
Sep 10 23:33:34.303541 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.303009    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 23:33:34.303541 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.303183    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 23:33:34.304446 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.303250    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-95.ec2.internal.18d419b455293d08  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-95.ec2.internal,UID:ip-10-0-143-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-95.ec2.internal,},FirstTimestamp:2026-09-10 23:33:34.286503176 +0000 UTC m=+0.390789960,LastTimestamp:2026-09-10 23:33:34.286503176 +0000 UTC m=+0.390789960,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-95.ec2.internal,}"
Sep 10 23:33:34.314008 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.313870    2566 manager.go:354] Recovery completed
Sep 10 23:33:34.318802 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.318788    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.320520 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.320507    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.320565 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.320534    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.320565 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.320544    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.321101 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321089    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.321178 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321090    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 23:33:34.321178 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321162    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 23:33:34.321247 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321181    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:33:34.321887 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321873    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.321962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321903    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.321962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.321917    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.323259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.323243    2566 policy_none.go:49] "None policy: Start"
Sep 10 23:33:34.323326 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.323264    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 23:33:34.323326 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.323277    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 23:33:34.325384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.325371    2566 policy_none.go:47] "Start"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.357832    2566 manager.go:337] "Starting Device Plugin manager"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.357860    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.357869    2566 server.go:87] "Starting device plugin registration server"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.358150    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.358159    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.358244    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.358340    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.358349    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.358862    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 23:33:34.374836 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.358916    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.421641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.421605    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 23:33:34.422771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.422751    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 23:33:34.422859 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.422797    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 23:33:34.422859 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.422820    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 23:33:34.422956 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.422899    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 23:33:34.424988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.424968    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:34.458998 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.458909    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.459742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.459723    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.459817 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.459757    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.459817 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.459768    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.459817 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.459790    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.468048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.468029    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.468173 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.468051    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-95.ec2.internal\": node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.511649 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.511634    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.524007 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.523989    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"]
Sep 10 23:33:34.524069 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.524051    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.525517 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.525504    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.525597 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.525528    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.525597 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.525539    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.527937 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.527923    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.528048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528033    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.528096 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528061    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.528630 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528614    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.528706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528631    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.528706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528642    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.528706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528652    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.528706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528656    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.528706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.528661    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.531637 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.531621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.531724 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.531646    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:33:34.532439 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.532419    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:33:34.532534 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.532448    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:33:34.532534 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.532462    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:33:34.554917 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.554894    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-95.ec2.internal\" not found" node="ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.558797 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.558784    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-95.ec2.internal\" not found" node="ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.612731 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.612712    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.700175 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.700159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.700266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.700182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.700266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.700208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.713322 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.713269    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.801259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.801259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.801424 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801277    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.801424 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801345    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.801424 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801356    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.801424 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.801370    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.814342 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.814322    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:34.857506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.857478    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.862239 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:34.862203    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:34.915269 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:34.915247    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:35.015760 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:35.015703    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:35.116180 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:35.116147    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:35.216568 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:35.216546    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 10 23:33:35.230690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.230664    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 23:33:35.230810 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.230786    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:33:35.285868 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.285813    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:35.297934 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.297915    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:35.298041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.297918    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 23:33:35.305054 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.305029    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 23:28:34 +0000 UTC" deadline="2028-02-06 13:21:56.359895566 +0000 UTC"
Sep 10 23:33:35.305054 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.305051    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12325h48m21.054847041s"
Sep 10 23:33:35.308280 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.308270    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:33:35.309594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.309583    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 10 23:33:35.310360 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.310345    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:33:35.319267 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.319251    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:33:35.332667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.332649    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzptw"
Sep 10 23:33:35.340180 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.340166    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzptw"
Sep 10 23:33:35.588971 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:35.588937    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca4e8b3696e5d2a45a5c2e759a3cb06.slice/crio-c240f657d055b030ee05facdddbe6d0379f1fd3dc1d7698b069684cfde2e3642 WatchSource:0}: Error finding container c240f657d055b030ee05facdddbe6d0379f1fd3dc1d7698b069684cfde2e3642: Status 404 returned error can't find the container with id c240f657d055b030ee05facdddbe6d0379f1fd3dc1d7698b069684cfde2e3642
Sep 10 23:33:35.589255 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:35.589236    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182c03c78ab71663e42db8a5ead7b76b.slice/crio-237a2fe7e6db9adac96111e43c3f0df1ff0a1c257ba23fe7e5eaee4ffbdbe29e WatchSource:0}: Error finding container 237a2fe7e6db9adac96111e43c3f0df1ff0a1c257ba23fe7e5eaee4ffbdbe29e: Status 404 returned error can't find the container with id 237a2fe7e6db9adac96111e43c3f0df1ff0a1c257ba23fe7e5eaee4ffbdbe29e
Sep 10 23:33:35.594233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.594219    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:33:35.702561 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.702537    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:35.813705 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:35.813673    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:36.270206 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.270168    2566 apiserver.go:52] "Watching apiserver"
Sep 10 23:33:36.280276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.280245    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 23:33:36.281452 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.281419    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-46qtp","kube-system/global-pull-secret-syncer-fxhws","kube-system/konnectivity-agent-qx7q4","kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qxb7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal","openshift-multus/multus-bkwkz","openshift-network-diagnostics/network-check-target-cljsz","openshift-network-operator/iptables-alerter-jvxhv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q","openshift-dns/node-resolver-bgsfj","openshift-image-registry/node-ca-58rvz","openshift-multus/multus-additional-cni-plugins-9qnst","openshift-multus/network-metrics-daemon-j296r"]
Sep 10 23:33:36.283969 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.283947    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.286224 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.286194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.286454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.286431    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.286550 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.286473    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.286737 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.286718    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vrz9f\""
Sep 10 23:33:36.286807 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.286785    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 23:33:36.288241 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.288220    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 23:33:36.288706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.288503    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.289845 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.289591    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 23:33:36.289845 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.289701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n6ngn\""
Sep 10 23:33:36.289994 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.289898    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 23:33:36.290050 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.290037    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.290166 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.290144    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.290535 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.290519    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 23:33:36.290829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.290806    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 23:33:36.290919 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.290903    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r64n4\""
Sep 10 23:33:36.291565 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.291536    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.291664 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.291622    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:36.293922 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.293826    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.296070 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.296049    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.296177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.296124    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cz6s9\""
Sep 10 23:33:36.296344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.296325    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:36.296408 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.296377    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:36.296408 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.296329    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.298385 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.298367    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.300456 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.300437    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.300753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.300737    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.300971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.300956    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m8xmb\""
Sep 10 23:33:36.301121 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.301104    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.302358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.301239    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 23:33:36.302923 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.302904    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.303008 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.302953    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:36.303217 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.303199    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 23:33:36.303494 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.303476    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jrgl2\""
Sep 10 23:33:36.305511 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.305493    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.308038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.308019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.308757 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.308737    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 23:33:36.309564 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.309543    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 23:33:36.309758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.309742    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.310282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310260    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.310408 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310378    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.310823 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-kubelet\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.310913 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-conf-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.310913 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310878    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 23:33:36.311021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-socket-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.310960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-registration-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311223 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cww7\" (UniqueName: \"kubernetes.io/projected/3383ff14-99a3-45b8-90d4-e239867e472b-kube-api-access-8cww7\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311294 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311221    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4lw6\""
Sep 10 23:33:36.311294 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311240    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-system-cni-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.311294 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-host-slash\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.311465 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-etc-kubernetes\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.311465 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-device-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311465 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-sys-fs\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311627 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.311627 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311570    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.311627 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14721e57-7de2-43da-9bb2-f55002226968-konnectivity-ca\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.311771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.311771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.311771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9mqw\" (UniqueName: \"kubernetes.io/projected/13977e3f-e7d6-408a-a440-fde856dba0f6-kube-api-access-l9mqw\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.311771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311714    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-modprobe-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.311962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-var-lib-kubelet\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.311962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311792    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.311962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311877    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-tuned\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.311962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311942    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-tmp\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.311998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnmmd\" (UniqueName: \"kubernetes.io/projected/929a56ed-7efd-4276-8cf4-e71ef4b11188-kube-api-access-mnmmd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312016    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312078    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-cnibin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312101    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8g5v7\""
Sep 10 23:33:36.312141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-cni-binary-copy\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-multus-certs\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312181    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-kubernetes\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312207    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-run\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-sys\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-host\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vql\" (UniqueName: \"kubernetes.io/projected/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-kube-api-access-h6vql\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-system-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312357    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-socket-dir-parent\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-multus-daemon-config\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312442    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.312512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312495    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-bin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312526    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-hostroot\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-cnibin\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysconfig\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-systemd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312638    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-lib-modules\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-k8s-cni-cncf-io\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312714    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-netns\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-multus\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312781    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.313114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.312789    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-94hwz\""
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14721e57-7de2-43da-9bb2-f55002226968-agent-certs\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jd8\" (UniqueName: \"kubernetes.io/projected/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-kube-api-access-q7jd8\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-conf\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x4c\" (UniqueName: \"kubernetes.io/projected/7d59a859-f908-4316-9b22-6992f0f09c15-kube-api-access-76x4c\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-iptables-alerter-script\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.313707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.313520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.314492 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.314472    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 23:33:36.314921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.314904    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 23:33:36.343642 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.343595    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:28:35 +0000 UTC" deadline="2028-04-26 21:58:44.465031369 +0000 UTC"
Sep 10 23:33:36.343642 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.343644    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14254h25m8.121391673s"
Sep 10 23:33:36.399252 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.399231    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 23:33:36.414568 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96907f5-8a0e-430d-9109-0967c52d0143-tmp-dir\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414585    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-system-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-socket-dir-parent\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.414722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414702    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-kubelet\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-node-log\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414775    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-hostroot\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414789    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-system-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414804    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysconfig\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414797    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-socket-dir-parent\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-hostroot\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysconfig\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414920    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r2rd\" (UniqueName: \"kubernetes.io/projected/b96907f5-8a0e-430d-9109-0967c52d0143-kube-api-access-7r2rd\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26098ab1-eedb-4f96-b854-19f27d7c41b9-serviceca\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.414994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-netns\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-multus\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jd8\" (UniqueName: \"kubernetes.io/projected/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-kube-api-access-q7jd8\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-var-lib-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-bin\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415119    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-multus\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b96907f5-8a0e-430d-9109-0967c52d0143-hosts-file\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-iptables-alerter-script\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415169    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-netns\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-kubelet\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-conf-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-socket-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cww7\" (UniqueName: \"kubernetes.io/projected/3383ff14-99a3-45b8-90d4-e239867e472b-kube-api-access-8cww7\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415281    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415308    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-tuned\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-run\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415401    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-host-slash\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-etc-kubernetes\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.415960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-device-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-sys-fs\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415526    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-host\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415539    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-run\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-systemd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415610    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-host-slash\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415398    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-conf-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415659    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-socket-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415677    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-etc-kubernetes\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8mz\" (UniqueName: \"kubernetes.io/projected/ec1a9277-b46c-4afd-82d8-6211cea76a75-kube-api-access-vq8mz\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415743    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9mqw\" (UniqueName: \"kubernetes.io/projected/13977e3f-e7d6-408a-a440-fde856dba0f6-kube-api-access-l9mqw\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-modprobe-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415791    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-var-lib-kubelet\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415791    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-device-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415834    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-sys-fs\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.416706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnmmd\" (UniqueName: \"kubernetes.io/projected/929a56ed-7efd-4276-8cf4-e71ef4b11188-kube-api-access-mnmmd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-log-socket\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-script-lib\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415965    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26098ab1-eedb-4f96-b854-19f27d7c41b9-host\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-kubelet\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415966    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-host\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-sys\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.416044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vql\" (UniqueName: \"kubernetes.io/projected/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-kube-api-access-h6vql\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.416068    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.416139    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:33:36.91611805 +0000 UTC m=+3.020404843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.416071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-multus-daemon-config\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.416272    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.415912    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-iptables-alerter-script\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.416425    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.416751    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-netns\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.417595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417202    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckxtx\" (UniqueName: \"kubernetes.io/projected/26098ab1-eedb-4f96-b854-19f27d7c41b9-kube-api-access-ckxtx\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417230    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-bin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-cnibin\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-systemd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417317    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-lib-modules\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417340    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-systemd-units\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-slash\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-k8s-cni-cncf-io\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14721e57-7de2-43da-9bb2-f55002226968-agent-certs\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-conf\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417493    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-etc-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76x4c\" (UniqueName: \"kubernetes.io/projected/7d59a859-f908-4316-9b22-6992f0f09c15-kube-api-access-76x4c\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417533    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-systemd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417548    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417584    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-env-overrides\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417600    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.418498 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417610    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-registration-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-cnibin\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.417742    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-k8s-cni-cncf-io\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418198    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13977e3f-e7d6-408a-a440-fde856dba0f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418273    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-multus-daemon-config\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418577    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-sys\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-modprobe-d\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418907    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-var-lib-kubelet\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-var-lib-cni-bin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.418985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-system-cni-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-tmp\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-dbus\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419100    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14721e57-7de2-43da-9bb2-f55002226968-konnectivity-ca\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419212    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-ovn\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.419276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-netd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovn-node-metrics-cert\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-kubelet-config\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-cnibin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419460    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-cni-binary-copy\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-multus-certs\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-kubernetes\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419547    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-config\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-cnibin\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419796    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419846    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3383ff14-99a3-45b8-90d4-e239867e472b-registration-dir\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419928    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-lib-modules\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.420122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.419967    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13977e3f-e7d6-408a-a440-fde856dba0f6-system-cni-dir\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.421839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.421817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-sysctl-conf\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.421988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.421885    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-tuned\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.422464 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.422418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14721e57-7de2-43da-9bb2-f55002226968-konnectivity-ca\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.422552 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.422477    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d59a859-f908-4316-9b22-6992f0f09c15-cni-binary-copy\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.423212 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.422890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-host-run-multus-certs\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.423212 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.423163    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14721e57-7de2-43da-9bb2-f55002226968-agent-certs\") pod \"konnectivity-agent-qx7q4\" (UID: \"14721e57-7de2-43da-9bb2-f55002226968\") " pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.423212 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.423154    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929a56ed-7efd-4276-8cf4-e71ef4b11188-etc-kubernetes\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.423440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.423258    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d59a859-f908-4316-9b22-6992f0f09c15-multus-cni-dir\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.426946 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.426901    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cww7\" (UniqueName: \"kubernetes.io/projected/3383ff14-99a3-45b8-90d4-e239867e472b-kube-api-access-8cww7\") pod \"aws-ebs-csi-driver-node-jff8q\" (UID: \"3383ff14-99a3-45b8-90d4-e239867e472b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.427207 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.427180    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jd8\" (UniqueName: \"kubernetes.io/projected/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-kube-api-access-q7jd8\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.428415 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.428117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnmmd\" (UniqueName: \"kubernetes.io/projected/929a56ed-7efd-4276-8cf4-e71ef4b11188-kube-api-access-mnmmd\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.428415 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.428294    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:36.428415 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.428332    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:36.428415 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.428344    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:36.428415 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.428415    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:36.928395719 +0000 UTC m=+3.032682511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:36.429427 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.429379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" event={"ID":"182c03c78ab71663e42db8a5ead7b76b","Type":"ContainerStarted","Data":"237a2fe7e6db9adac96111e43c3f0df1ff0a1c257ba23fe7e5eaee4ffbdbe29e"}
Sep 10 23:33:36.430979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.430800    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929a56ed-7efd-4276-8cf4-e71ef4b11188-tmp\") pod \"tuned-qxb7s\" (UID: \"929a56ed-7efd-4276-8cf4-e71ef4b11188\") " pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.430979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.430926    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerStarted","Data":"c240f657d055b030ee05facdddbe6d0379f1fd3dc1d7698b069684cfde2e3642"}
Sep 10 23:33:36.431128 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.431049    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vql\" (UniqueName: \"kubernetes.io/projected/ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7-kube-api-access-h6vql\") pod \"iptables-alerter-jvxhv\" (UID: \"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7\") " pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.431128 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.431056    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9mqw\" (UniqueName: \"kubernetes.io/projected/13977e3f-e7d6-408a-a440-fde856dba0f6-kube-api-access-l9mqw\") pod \"multus-additional-cni-plugins-9qnst\" (UID: \"13977e3f-e7d6-408a-a440-fde856dba0f6\") " pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.432519 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.432496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x4c\" (UniqueName: \"kubernetes.io/projected/7d59a859-f908-4316-9b22-6992f0f09c15-kube-api-access-76x4c\") pod \"multus-bkwkz\" (UID: \"7d59a859-f908-4316-9b22-6992f0f09c15\") " pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.454552 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.454521    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:33:36.520687 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-dbus\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.520687 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-ovn\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520694    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-netd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovn-node-metrics-cert\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-kubelet-config\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520758    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-ovn\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-netd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520765    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-dbus\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520770    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-config\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520815    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ba092d9-9f97-4e55-96bf-2b84fd488f12-kubelet-config\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96907f5-8a0e-430d-9109-0967c52d0143-tmp-dir\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-kubelet\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.520888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-node-log\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520916    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520943    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r2rd\" (UniqueName: \"kubernetes.io/projected/b96907f5-8a0e-430d-9109-0967c52d0143-kube-api-access-7r2rd\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-kubelet\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.520969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26098ab1-eedb-4f96-b854-19f27d7c41b9-serviceca\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-var-lib-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-bin\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b96907f5-8a0e-430d-9109-0967c52d0143-hosts-file\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-systemd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521140    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8mz\" (UniqueName: \"kubernetes.io/projected/ec1a9277-b46c-4afd-82d8-6211cea76a75-kube-api-access-vq8mz\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521155    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96907f5-8a0e-430d-9109-0967c52d0143-tmp-dir\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521169    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-log-socket\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521194    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-script-lib\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521197    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-node-log\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521217    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26098ab1-eedb-4f96-b854-19f27d7c41b9-host\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521257    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-var-lib-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521365 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521262    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-systemd\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-cni-bin\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521349    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26098ab1-eedb-4f96-b854-19f27d7c41b9-host\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521368    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-config\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521421    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26098ab1-eedb-4f96-b854-19f27d7c41b9-serviceca\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b96907f5-8a0e-430d-9109-0967c52d0143-hosts-file\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521437    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-netns\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.521473    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-netns\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.521547    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:37.021527515 +0000 UTC m=+3.125814287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521566    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-run-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckxtx\" (UniqueName: \"kubernetes.io/projected/26098ab1-eedb-4f96-b854-19f27d7c41b9-kube-api-access-ckxtx\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521615    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-log-socket\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-systemd-units\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-systemd-units\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.521898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-slash\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521727    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-etc-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521743    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-env-overrides\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521797    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-etc-openvswitch\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-run-ovn-kubernetes\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1a9277-b46c-4afd-82d8-6211cea76a75-host-slash\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.521810    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovnkube-script-lib\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.522527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.522137    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec1a9277-b46c-4afd-82d8-6211cea76a75-env-overrides\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.523333 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.523283    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec1a9277-b46c-4afd-82d8-6211cea76a75-ovn-node-metrics-cert\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.530836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.530809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r2rd\" (UniqueName: \"kubernetes.io/projected/b96907f5-8a0e-430d-9109-0967c52d0143-kube-api-access-7r2rd\") pod \"node-resolver-bgsfj\" (UID: \"b96907f5-8a0e-430d-9109-0967c52d0143\") " pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.531865 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.531839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8mz\" (UniqueName: \"kubernetes.io/projected/ec1a9277-b46c-4afd-82d8-6211cea76a75-kube-api-access-vq8mz\") pod \"ovnkube-node-46qtp\" (UID: \"ec1a9277-b46c-4afd-82d8-6211cea76a75\") " pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.532051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.532036    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckxtx\" (UniqueName: \"kubernetes.io/projected/26098ab1-eedb-4f96-b854-19f27d7c41b9-kube-api-access-ckxtx\") pod \"node-ca-58rvz\" (UID: \"26098ab1-eedb-4f96-b854-19f27d7c41b9\") " pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.598128 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.598091    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q"
Sep 10 23:33:36.607348 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.607323    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qnst"
Sep 10 23:33:36.615056 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.615036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:36.625891 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.625871    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxb7s"
Sep 10 23:33:36.633458 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.633434    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jvxhv"
Sep 10 23:33:36.641965 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.641945    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkwkz"
Sep 10 23:33:36.649745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.649724    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:33:36.658387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.658357    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgsfj"
Sep 10 23:33:36.664933 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.664913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58rvz"
Sep 10 23:33:36.924992 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:36.924910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:36.925162 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.925039    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:36.925162 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:36.925133    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:33:37.925115845 +0000 UTC m=+4.029402632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:37.025777 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.025739    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:37.025964 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.025805    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:37.025964 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.025898    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:37.025964 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.025943    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:37.026125 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.025967    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:37.026125 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.025983    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:37.026125 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.025967    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:38.025946836 +0000 UTC m=+4.130233631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:37.026125 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.026051    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:38.02603438 +0000 UTC m=+4.130321160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:37.344517 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.344427    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:28:35 +0000 UTC" deadline="2028-04-07 03:17:07.713636775 +0000 UTC"
Sep 10 23:33:37.344517 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.344474    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13779h43m30.369165935s"
Sep 10 23:33:37.424029 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.424001    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:37.424173 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.424123    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:37.455748 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.455549    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2e8dc0_5f18_445d_b9de_299bd1a2e8b7.slice/crio-48816a3fd833b064cf95492caaff9b6ce9323a3267d769883b475f7ddf7bd654 WatchSource:0}: Error finding container 48816a3fd833b064cf95492caaff9b6ce9323a3267d769883b475f7ddf7bd654: Status 404 returned error can't find the container with id 48816a3fd833b064cf95492caaff9b6ce9323a3267d769883b475f7ddf7bd654
Sep 10 23:33:37.459124 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.459096    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929a56ed_7efd_4276_8cf4_e71ef4b11188.slice/crio-9a55e49277f57b79236a945546011f67316ef8ffef4deb5977223680a37a34a1 WatchSource:0}: Error finding container 9a55e49277f57b79236a945546011f67316ef8ffef4deb5977223680a37a34a1: Status 404 returned error can't find the container with id 9a55e49277f57b79236a945546011f67316ef8ffef4deb5977223680a37a34a1
Sep 10 23:33:37.460310 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.460274    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3383ff14_99a3_45b8_90d4_e239867e472b.slice/crio-d9c6f9b51c32bb26ae41a62a5b7d897b58a41ef319314926dacc8542e0fda473 WatchSource:0}: Error finding container d9c6f9b51c32bb26ae41a62a5b7d897b58a41ef319314926dacc8542e0fda473: Status 404 returned error can't find the container with id d9c6f9b51c32bb26ae41a62a5b7d897b58a41ef319314926dacc8542e0fda473
Sep 10 23:33:37.461977 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.461865    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26098ab1_eedb_4f96_b854_19f27d7c41b9.slice/crio-4684b8d2bfd2f4d50a9270dd33081e9ee285b8f40b91b418c36851a94389590a WatchSource:0}: Error finding container 4684b8d2bfd2f4d50a9270dd33081e9ee285b8f40b91b418c36851a94389590a: Status 404 returned error can't find the container with id 4684b8d2bfd2f4d50a9270dd33081e9ee285b8f40b91b418c36851a94389590a
Sep 10 23:33:37.462845 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.462826    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1a9277_b46c_4afd_82d8_6211cea76a75.slice/crio-b5506e613443c1d7e4398ce37f61f6c77fa38f1aa3d00c299e056bf0222ced10 WatchSource:0}: Error finding container b5506e613443c1d7e4398ce37f61f6c77fa38f1aa3d00c299e056bf0222ced10: Status 404 returned error can't find the container with id b5506e613443c1d7e4398ce37f61f6c77fa38f1aa3d00c299e056bf0222ced10
Sep 10 23:33:37.464147 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.464120    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d59a859_f908_4316_9b22_6992f0f09c15.slice/crio-071418632cad4a36db8e52ba915f414f5499a4e91a0b9aad08217e816e8f8b3b WatchSource:0}: Error finding container 071418632cad4a36db8e52ba915f414f5499a4e91a0b9aad08217e816e8f8b3b: Status 404 returned error can't find the container with id 071418632cad4a36db8e52ba915f414f5499a4e91a0b9aad08217e816e8f8b3b
Sep 10 23:33:37.465843 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.465654    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14721e57_7de2_43da_9bb2_f55002226968.slice/crio-d799e93bb6c957eeded4743f5d7019a991e16868d2c32d65d8cb52fe8f8e43d5 WatchSource:0}: Error finding container d799e93bb6c957eeded4743f5d7019a991e16868d2c32d65d8cb52fe8f8e43d5: Status 404 returned error can't find the container with id d799e93bb6c957eeded4743f5d7019a991e16868d2c32d65d8cb52fe8f8e43d5
Sep 10 23:33:37.467104 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:33:37.466533    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96907f5_8a0e_430d_9109_0967c52d0143.slice/crio-853e2270c18290fad5e37c59107b393970f3feda6c45b0bca82e5fe5f5200874 WatchSource:0}: Error finding container 853e2270c18290fad5e37c59107b393970f3feda6c45b0bca82e5fe5f5200874: Status 404 returned error can't find the container with id 853e2270c18290fad5e37c59107b393970f3feda6c45b0bca82e5fe5f5200874
Sep 10 23:33:37.932648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:37.932576    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:37.932824 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.932680    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:37.932824 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:37.932733    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:33:39.932716301 +0000 UTC m=+6.037003074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:38.033760 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.033723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:38.033937 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.033785    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:38.033937 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.033933    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:38.034056 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.033950    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:38.034056 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.033962    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:38.034056 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.034022    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:40.034004678 +0000 UTC m=+6.138291467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:38.034439 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.034419    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:38.034528 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.034473    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:40.034458994 +0000 UTC m=+6.138745771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:38.424224 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.423638    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:38.424224 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.423796    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:38.424224 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.423873    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:38.424224 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:38.423985    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:38.449376 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.449340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" event={"ID":"182c03c78ab71663e42db8a5ead7b76b","Type":"ContainerStarted","Data":"256c6a042172bfe108084c9d20d4ebd6cf903f69c14d4c0bb8f96ea96ca821a0"}
Sep 10 23:33:38.457902 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.457870    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgsfj" event={"ID":"b96907f5-8a0e-430d-9109-0967c52d0143","Type":"ContainerStarted","Data":"853e2270c18290fad5e37c59107b393970f3feda6c45b0bca82e5fe5f5200874"}
Sep 10 23:33:38.468068 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.467952    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qx7q4" event={"ID":"14721e57-7de2-43da-9bb2-f55002226968","Type":"ContainerStarted","Data":"d799e93bb6c957eeded4743f5d7019a991e16868d2c32d65d8cb52fe8f8e43d5"}
Sep 10 23:33:38.470025 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.469893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkwkz" event={"ID":"7d59a859-f908-4316-9b22-6992f0f09c15","Type":"ContainerStarted","Data":"071418632cad4a36db8e52ba915f414f5499a4e91a0b9aad08217e816e8f8b3b"}
Sep 10 23:33:38.478348 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.478262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58rvz" event={"ID":"26098ab1-eedb-4f96-b854-19f27d7c41b9","Type":"ContainerStarted","Data":"4684b8d2bfd2f4d50a9270dd33081e9ee285b8f40b91b418c36851a94389590a"}
Sep 10 23:33:38.483527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.483448    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q" event={"ID":"3383ff14-99a3-45b8-90d4-e239867e472b","Type":"ContainerStarted","Data":"d9c6f9b51c32bb26ae41a62a5b7d897b58a41ef319314926dacc8542e0fda473"}
Sep 10 23:33:38.491375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.491306    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jvxhv" event={"ID":"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7","Type":"ContainerStarted","Data":"48816a3fd833b064cf95492caaff9b6ce9323a3267d769883b475f7ddf7bd654"}
Sep 10 23:33:38.498448 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.498174    2566 generic.go:356] "Generic (PLEG): container finished" podID="bca4e8b3696e5d2a45a5c2e759a3cb06" containerID="67c9d190f4c413a000cf70e37a2774749d53a14939f5dfe3415269fcb00bd981" exitCode=0
Sep 10 23:33:38.498448 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.498253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerDied","Data":"67c9d190f4c413a000cf70e37a2774749d53a14939f5dfe3415269fcb00bd981"}
Sep 10 23:33:38.516711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.516627    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" podStartSLOduration=3.516610828 podStartE2EDuration="3.516610828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:38.464307948 +0000 UTC m=+4.568594737" watchObservedRunningTime="2026-09-10 23:33:38.516610828 +0000 UTC m=+4.620897624"
Sep 10 23:33:38.517552 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.517511    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"b5506e613443c1d7e4398ce37f61f6c77fa38f1aa3d00c299e056bf0222ced10"}
Sep 10 23:33:38.537807 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.537780    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxb7s" event={"ID":"929a56ed-7efd-4276-8cf4-e71ef4b11188","Type":"ContainerStarted","Data":"9a55e49277f57b79236a945546011f67316ef8ffef4deb5977223680a37a34a1"}
Sep 10 23:33:38.549832 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:38.549807    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerStarted","Data":"7e8d3fcdb2dfdb366abf47648ca338bb72f21308859eeb3194f2af6f7909a94d"}
Sep 10 23:33:39.423541 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:39.423383    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:39.423541 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:39.423526    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:39.562075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:39.562037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerStarted","Data":"89be46f60ec6510c468e827d534f856a8d10689fde40c35231f6fd4340722d80"}
Sep 10 23:33:39.579577 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:39.577486    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" podStartSLOduration=4.577465941 podStartE2EDuration="4.577465941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:39.576456686 +0000 UTC m=+5.680743503" watchObservedRunningTime="2026-09-10 23:33:39.577465941 +0000 UTC m=+5.681752736"
Sep 10 23:33:39.948289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:39.948253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:39.948488 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:39.948455    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:39.948555 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:39.948520    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:33:43.948502524 +0000 UTC m=+10.052789319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:40.049514 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:40.049465    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:40.049675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:40.049530    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:40.049675 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.049670    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:40.049798 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.049689    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:40.049798 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.049703    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:40.049798 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.049758    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:44.049739331 +0000 UTC m=+10.154026117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:40.050216 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.050091    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:40.050216 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.050163    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:44.050147147 +0000 UTC m=+10.154433925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:40.425539 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:40.425463    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:40.425698 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.425608    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:40.426225 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:40.426167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:40.426335 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:40.426288    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:41.423706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:41.423675    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:41.424252 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:41.423818    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:42.423384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:42.423345    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:42.423384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:42.423370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:42.423612 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:42.423531    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:42.423722 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:42.423694    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:43.423506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:43.423413    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:43.423951 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:43.423564    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:43.980674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:43.980643    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:43.980869 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:43.980830    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:43.980938 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:43.980897    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:33:51.980877975 +0000 UTC m=+18.085164755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:44.081717 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:44.081682    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:44.081897 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:44.081774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:44.081957 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.081902    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:44.082006 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.081956    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:52.081943867 +0000 UTC m=+18.186230639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:44.082280 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.082248    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:44.082280 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.082278    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:44.082481 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.082291    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:44.082481 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.082360    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:33:52.082343815 +0000 UTC m=+18.186630595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:44.425874 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:44.425802    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:44.426282 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.425903    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:44.426282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:44.426192    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:44.426282 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:44.426252    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:45.423537 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:45.423508    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:45.423689 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:45.423644    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:46.423582 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:46.423548    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:46.424046 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:46.423674    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:46.424046 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:46.423726    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:46.424046 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:46.423849    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:47.423887 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:47.423857    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:47.424313 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:47.423980    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:48.423507 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:48.423449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:48.423507 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:48.423497    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:48.423757 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:48.423600    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:48.423757 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:48.423730    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:49.423326 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:49.423279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:49.423743 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:49.423420    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:50.423406 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:50.423189    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:50.423869 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:50.423197    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:50.423869 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:50.423513    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:50.423869 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:50.423554    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:51.423127 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:51.423096    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:51.423370 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:51.423232    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:52.045876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:52.045837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:52.046283 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.045967    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:52.046283 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.046040    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:34:08.046019254 +0000 UTC m=+34.150306026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:33:52.147002 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:52.146963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:52.147175 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:52.147027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:52.147175 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147131    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:52.147175 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147167    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:33:52.147320 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147188    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:33:52.147320 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147201    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:52.147320 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147210    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:08.147191759 +0000 UTC m=+34.251478534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:33:52.147320 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.147250    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:08.147234445 +0000 UTC m=+34.251521237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:33:52.423967 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:52.423938    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:52.424139 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.424069    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:52.424139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:52.424130    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:52.424276 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:52.424237    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:53.423951 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:53.423912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:53.424400 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:53.424017    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:54.424562 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:54.424472    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:54.424562 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:54.424517    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:54.425047 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:54.424603    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:54.425047 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:54.424738    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:55.423028 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:55.423002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:55.423142 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:55.423087    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:56.424253 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.424058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:56.424925 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.424059    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:56.424925 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:56.424372    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:56.424925 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:56.424418    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:56.607228 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.607199    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgsfj" event={"ID":"b96907f5-8a0e-430d-9109-0967c52d0143","Type":"ContainerStarted","Data":"54ff7e836312b6b83d51e4eb84b2a25c86e34ff0369467a4f90f4378310f5422"}
Sep 10 23:33:56.609031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.609004    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qx7q4" event={"ID":"14721e57-7de2-43da-9bb2-f55002226968","Type":"ContainerStarted","Data":"83af577e106f17c04bdf39ab25b13b9e62c6ce5ccb560d70f7b862ce359546ef"}
Sep 10 23:33:56.610705 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.610676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkwkz" event={"ID":"7d59a859-f908-4316-9b22-6992f0f09c15","Type":"ContainerStarted","Data":"7bfa7e8826c3a68f94cd5ccef2db647f61920ea48cc2a94afaf8089520f6da48"}
Sep 10 23:33:56.612247 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.612227    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58rvz" event={"ID":"26098ab1-eedb-4f96-b854-19f27d7c41b9","Type":"ContainerStarted","Data":"2a7b2d27f07df30efb9b24c7c6dc78f11f624764ea078952dbda76916a6ffff4"}
Sep 10 23:33:56.613989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.613967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q" event={"ID":"3383ff14-99a3-45b8-90d4-e239867e472b","Type":"ContainerStarted","Data":"9814311efb36a7542708fc6542ca545319d6f416695ed14bdf2bc8b9c83e64e2"}
Sep 10 23:33:56.617357 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"a38946a4eb43bbff8fcbceddeaa0a27a7acc448834254ce1942e9f2f8036bf29"}
Sep 10 23:33:56.617457 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617400    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"aa8cf9c616de79ee7bde970111413e23a881342eb07b7708e45b6427e159bb44"}
Sep 10 23:33:56.617457 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"78aee262410f78afd2c7c0456a6bc2089f60881a98ef16c82c5a6325e810ad4c"}
Sep 10 23:33:56.617549 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617495    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"1dd9a6f22c4472526748bbedb18efb6103804b9954ddc83556d272c526f22349"}
Sep 10 23:33:56.617549 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617525    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"aee8c6af9761856b3798f40e0685c80a86c565228148e2212ae7538ff8ca8f1f"}
Sep 10 23:33:56.617645 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.617591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"08b7a6f0b5d02604b975c699f738378d9fc83e3751e22cd33fa31563348902b4"}
Sep 10 23:33:56.619281 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.619226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxb7s" event={"ID":"929a56ed-7efd-4276-8cf4-e71ef4b11188","Type":"ContainerStarted","Data":"44597fadde73b560f130b00d760b66efd99adbbceadd4d864b5a1e35a7d8400a"}
Sep 10 23:33:56.621768 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.621744    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="bfe7c4f22fbb1649fb7490ca8ddec3f2915d85d7f1e0bf57072496451bdd2a83" exitCode=0
Sep 10 23:33:56.621861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.621792    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"bfe7c4f22fbb1649fb7490ca8ddec3f2915d85d7f1e0bf57072496451bdd2a83"}
Sep 10 23:33:56.623471 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.623424    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bgsfj" podStartSLOduration=4.6089029230000005 podStartE2EDuration="22.623407577s" totalImagesPullingTime="18.014504654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:56.622715953 +0000 UTC m=+22.727002749" watchObservedRunningTime="2026-09-10 23:33:56.623407577 +0000 UTC m=+22.727694382"
Sep 10 23:33:56.664350 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.664315    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qxb7s" podStartSLOduration=4.640276687 podStartE2EDuration="22.664287974s" totalImagesPullingTime="18.024011287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:56.663870379 +0000 UTC m=+22.768157190" watchObservedRunningTime="2026-09-10 23:33:56.664287974 +0000 UTC m=+22.768574768"
Sep 10 23:33:56.683027 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.682990    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bkwkz" podStartSLOduration=4.524521065 podStartE2EDuration="22.682975232s" totalImagesPullingTime="18.158454167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:56.68246195 +0000 UTC m=+22.786748772" watchObservedRunningTime="2026-09-10 23:33:56.682975232 +0000 UTC m=+22.787262026"
Sep 10 23:33:56.686376 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.686358    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 23:33:56.700746 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:56.700713    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qx7q4" podStartSLOduration=8.590868661 podStartE2EDuration="22.700700737s" totalImagesPullingTime="14.109832076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:56.700247137 +0000 UTC m=+22.804533930" watchObservedRunningTime="2026-09-10 23:33:56.700700737 +0000 UTC m=+22.804987527"
Sep 10 23:33:57.372990 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.372888    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T23:33:56.686371511Z","UUID":"577ccab3-95af-415b-9f25-3c307e20735a","Handler":null,"Name":"","Endpoint":""}
Sep 10 23:33:57.374757 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.374734    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 23:33:57.374885 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.374833    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 23:33:57.423564 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.423538    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:57.423723 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:57.423662    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:33:57.626236 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.626204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q" event={"ID":"3383ff14-99a3-45b8-90d4-e239867e472b","Type":"ContainerStarted","Data":"6f3719b46e471027cf3e82ef672b410c5c8e5ed9379f414ef684cec2f61b13f7"}
Sep 10 23:33:57.627764 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.627728    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jvxhv" event={"ID":"ed2e8dc0-5f18-445d-b9de-299bd1a2e8b7","Type":"ContainerStarted","Data":"8bb0f35562e1604aa448a20df7a995f53ea0e85ec0629c85fd8abe8ceed722f0"}
Sep 10 23:33:57.643921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:57.643871    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-58rvz" podStartSLOduration=5.624747289 podStartE2EDuration="23.643850938s" totalImagesPullingTime="18.019103649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:56.714983814 +0000 UTC m=+22.819270630" watchObservedRunningTime="2026-09-10 23:33:57.643850938 +0000 UTC m=+23.748137728"
Sep 10 23:33:58.424084 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.423907    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:33:58.424230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.423912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:33:58.424230 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:58.424169    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:33:58.424330 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:58.424264    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:33:58.634640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.634607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"7f86d481df4bfc4993e5abf9452240c800d918238939f9975f4814e1a1f898af"}
Sep 10 23:33:58.636961 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.636913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q" event={"ID":"3383ff14-99a3-45b8-90d4-e239867e472b","Type":"ContainerStarted","Data":"c6518c5ba158b2261cd9c8422e91b503ce946c3da58462bd51462d3d07b91c63"}
Sep 10 23:33:58.655257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.655210    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jvxhv" podStartSLOduration=6.629854908 podStartE2EDuration="24.655197445s" totalImagesPullingTime="18.025342537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:57.644463459 +0000 UTC m=+23.748750251" watchObservedRunningTime="2026-09-10 23:33:58.655197445 +0000 UTC m=+24.759484238"
Sep 10 23:33:58.655387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:58.655327    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jff8q" podStartSLOduration=4.845476619 podStartE2EDuration="24.655319611s" totalImagesPullingTime="19.809842992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:58.654932446 +0000 UTC m=+24.759219244" watchObservedRunningTime="2026-09-10 23:33:58.655319611 +0000 UTC m=+24.759606403"
Sep 10 23:33:59.367656 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:59.367625    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:59.368258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:59.368234    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:33:59.423433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:33:59.423402    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:33:59.423585 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:33:59.423515    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:00.423367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:00.423332    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:00.423794 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:00.423383    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:00.423794 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:00.423474    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:00.423794 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:00.423594    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:01.423555 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.423386    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:01.423844 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:01.423637    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:01.647938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.647908    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" event={"ID":"ec1a9277-b46c-4afd-82d8-6211cea76a75","Type":"ContainerStarted","Data":"b117883ecf7b535dba00c178de9f4d8c6fb6d79bbde2beb5c13e4cef583b28b8"}
Sep 10 23:34:01.648149 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.648124    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:01.649916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.649886    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="f5c865bf63f4db8df87bfb347bd79a9454bf7f16de2951ff0ad44a997a1c8a0d" exitCode=0
Sep 10 23:34:01.650010 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.649930    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"f5c865bf63f4db8df87bfb347bd79a9454bf7f16de2951ff0ad44a997a1c8a0d"}
Sep 10 23:34:01.663675 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.663657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:01.676063 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:01.676025    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" podStartSLOduration=9.643328995 podStartE2EDuration="27.676012628s" totalImagesPullingTime="18.032683633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:01.675418403 +0000 UTC m=+27.779705217" watchObservedRunningTime="2026-09-10 23:34:01.676012628 +0000 UTC m=+27.780299421"
Sep 10 23:34:02.296199 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.296168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:34:02.296383 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.296340    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 23:34:02.296835 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.296809    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qx7q4"
Sep 10 23:34:02.423436 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.423409    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:02.423436 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.423442    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:02.423933 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:02.423515    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:02.423933 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:02.423589    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:02.653030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.653000    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 23:34:02.653698 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.653614    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:02.668220 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:02.668202    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:03.423488 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:03.423460    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:03.423644 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:03.423564    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:03.656968 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:03.656933    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="ad49802b86e51673a8be7f92c3ff5f51e124fcddc30086b3840621cca0c6472b" exitCode=0
Sep 10 23:34:03.657153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:03.657016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"ad49802b86e51673a8be7f92c3ff5f51e124fcddc30086b3840621cca0c6472b"}
Sep 10 23:34:03.657153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:03.657086    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 23:34:04.424621 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:04.424594    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:04.425027 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:04.424691    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:04.425027 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:04.424740    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:04.425027 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:04.424829    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:04.661150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:04.661120    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="8191ca1ea7e0e4d88c35831eb6501ec016e652a2e4619d0c1a86a0f2791a6163" exitCode=0
Sep 10 23:34:04.661283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:04.661202    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"8191ca1ea7e0e4d88c35831eb6501ec016e652a2e4619d0c1a86a0f2791a6163"}
Sep 10 23:34:04.661283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:04.661268    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 23:34:05.423440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:05.423412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:05.423595 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:05.423502    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:06.423661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.423628    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:06.424114 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:06.423773    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:06.424114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.423828    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:06.424114 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:06.423935    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:06.485305 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.485263    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:06.485529 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.485511    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 23:34:06.496169 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.496129    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" podUID="ec1a9277-b46c-4afd-82d8-6211cea76a75" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 10 23:34:06.505666 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:06.505632    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp" podUID="ec1a9277-b46c-4afd-82d8-6211cea76a75" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 10 23:34:07.423499 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:07.423469    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:07.423684 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:07.423595    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:08.070399 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:08.070368    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:08.070560 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.070471    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:34:08.070560 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.070518    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs podName:2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d nodeName:}" failed. No retries permitted until 2026-09-10 23:34:40.070504355 +0000 UTC m=+66.174791126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs") pod "network-metrics-daemon-j296r" (UID: "2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:34:08.171607 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:08.171574    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:08.171800 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:08.171725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:08.171800 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171765    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:34:08.171800 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171790    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:34:08.171936 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171803    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nfdwl for pod openshift-network-diagnostics/network-check-target-cljsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:34:08.171936 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171847    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:34:08.171936 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171863    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl podName:20bb5719-8608-47b6-8945-8b642999d522 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:40.171843461 +0000 UTC m=+66.276130247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfdwl" (UniqueName: "kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl") pod "network-check-target-cljsz" (UID: "20bb5719-8608-47b6-8945-8b642999d522") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:34:08.171936 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.171886    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret podName:6ba092d9-9f97-4e55-96bf-2b84fd488f12 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:40.171875822 +0000 UTC m=+66.276162599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret") pod "global-pull-secret-syncer-fxhws" (UID: "6ba092d9-9f97-4e55-96bf-2b84fd488f12") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:34:08.423530 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:08.423504    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:08.423700 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.423656    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:08.424048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:08.423712    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:08.424048 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:08.423841    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:09.423980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:09.423948    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:09.424611 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:09.424062    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:10.423142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:10.423113    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:10.423246 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:10.423142    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:10.423246 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:10.423228    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:10.423384 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:10.423364    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:10.677869 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:10.677838    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="87ffc238b29097487b2c8753ef5e97e88484481874d59a733cde29fd140bdb34" exitCode=0
Sep 10 23:34:10.678247 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:10.677889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"87ffc238b29097487b2c8753ef5e97e88484481874d59a733cde29fd140bdb34"}
Sep 10 23:34:11.423328 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:11.423285    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:11.423491 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:11.423399    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:11.683157 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:11.683079    2566 generic.go:356] "Generic (PLEG): container finished" podID="13977e3f-e7d6-408a-a440-fde856dba0f6" containerID="e46b6fb88e4245c12b9439e559039b21cb557815aefbe90b0a608f6384a8be02" exitCode=0
Sep 10 23:34:11.683157 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:11.683113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerDied","Data":"e46b6fb88e4245c12b9439e559039b21cb557815aefbe90b0a608f6384a8be02"}
Sep 10 23:34:12.423993 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:12.423961    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:12.424147 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:12.424057    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:12.424147 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:12.424117    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:12.424222 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:12.424196    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:12.689100 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:12.688884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qnst" event={"ID":"13977e3f-e7d6-408a-a440-fde856dba0f6","Type":"ContainerStarted","Data":"cc11a1996b0c43454c5bd86206cc93b9bcfabd450882c5ac6402e7ed5d9dbc9b"}
Sep 10 23:34:12.723239 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:12.723197    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9qnst" podStartSLOduration=8.876128872 podStartE2EDuration="38.723182088s" totalImagesPullingTime="29.847053216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:12.721765089 +0000 UTC m=+38.826051894" watchObservedRunningTime="2026-09-10 23:34:12.723182088 +0000 UTC m=+38.827468881"
Sep 10 23:34:13.423218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.423189    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:13.423384 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:13.423336    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:13.956844 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.956812    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxhws"]
Sep 10 23:34:13.957414 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.956922    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:13.957414 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:13.957022    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:13.960620 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.960595    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cljsz"]
Sep 10 23:34:13.960786 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.960748    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:13.960869 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:13.960849    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:13.961384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.961359    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j296r"]
Sep 10 23:34:13.961487 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:13.961447    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:13.961570 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:13.961541    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:15.423027 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:15.422997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:15.423435 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:15.422996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:15.423435 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:15.423110    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:15.423435 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:15.422996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:15.423435 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:15.423174    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:15.423435 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:15.423231    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:17.423516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:17.423487    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:17.423875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:17.423574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:17.423875 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:17.423578    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cljsz" podUID="20bb5719-8608-47b6-8945-8b642999d522"
Sep 10 23:34:17.423875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:17.423583    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:17.423875 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:17.423721    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxhws" podUID="6ba092d9-9f97-4e55-96bf-2b84fd488f12"
Sep 10 23:34:17.423875 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:17.423822    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j296r" podUID="2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d"
Sep 10 23:34:18.183659 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.183636    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeReady"
Sep 10 23:34:18.183794 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.183731    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 23:34:18.225731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.225707    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mh26h"]
Sep 10 23:34:18.249946 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.249924    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2c67f"]
Sep 10 23:34:18.250076 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.250047    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.252388 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.252371    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 23:34:18.252508 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.252491    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 23:34:18.252581 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.252494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n77qs\""
Sep 10 23:34:18.265981 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.265961    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mh26h"]
Sep 10 23:34:18.266081 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.266002    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2c67f"]
Sep 10 23:34:18.266081 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.266028    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9hdtx"]
Sep 10 23:34:18.266191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.266078    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.269114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.269090    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 23:34:18.269736 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.269546    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 23:34:18.269868 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.269822    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 23:34:18.270137 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.270114    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wqzsr\""
Sep 10 23:34:18.282324 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.282280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.282519 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.282286    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9hdtx"]
Sep 10 23:34:18.285796 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.285782    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 23:34:18.286019 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.286004    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 23:34:18.286079 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.286045    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 23:34:18.286965 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.286944    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6vndn\""
Sep 10 23:34:18.287052 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.287020    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 23:34:18.345548 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.345522    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a112a57d-1f21-4858-8d96-24ed8f500307-tmp-dir\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.345650 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.345555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a112a57d-1f21-4858-8d96-24ed8f500307-config-volume\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.345650 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.345575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqw8\" (UniqueName: \"kubernetes.io/projected/a112a57d-1f21-4858-8d96-24ed8f500307-kube-api-access-gcqw8\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.345650 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.345633    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a112a57d-1f21-4858-8d96-24ed8f500307-metrics-tls\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.446879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.446824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a112a57d-1f21-4858-8d96-24ed8f500307-tmp-dir\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.446879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.446853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b076b972-5a0a-4d99-bba4-6e0c4f765e51-crio-socket\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.446879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.446871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b076b972-5a0a-4d99-bba4-6e0c4f765e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.446915    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a112a57d-1f21-4858-8d96-24ed8f500307-config-volume\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqw8\" (UniqueName: \"kubernetes.io/projected/a112a57d-1f21-4858-8d96-24ed8f500307-kube-api-access-gcqw8\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a112a57d-1f21-4858-8d96-24ed8f500307-metrics-tls\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447092    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64a20dd9-e072-4450-9ea7-8de06f761ee3-cert\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447109    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8mg\" (UniqueName: \"kubernetes.io/projected/64a20dd9-e072-4450-9ea7-8de06f761ee3-kube-api-access-tx8mg\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447115    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a112a57d-1f21-4858-8d96-24ed8f500307-tmp-dir\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b076b972-5a0a-4d99-bba4-6e0c4f765e51-data-volume\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447271    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjcfb\" (UniqueName: \"kubernetes.io/projected/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-api-access-sjcfb\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.447377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.447734 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.447560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a112a57d-1f21-4858-8d96-24ed8f500307-config-volume\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.451221 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.451110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a112a57d-1f21-4858-8d96-24ed8f500307-metrics-tls\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.454970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.454951    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqw8\" (UniqueName: \"kubernetes.io/projected/a112a57d-1f21-4858-8d96-24ed8f500307-kube-api-access-gcqw8\") pod \"dns-default-mh26h\" (UID: \"a112a57d-1f21-4858-8d96-24ed8f500307\") " pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.548494 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64a20dd9-e072-4450-9ea7-8de06f761ee3-cert\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.548592 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8mg\" (UniqueName: \"kubernetes.io/projected/64a20dd9-e072-4450-9ea7-8de06f761ee3-kube-api-access-tx8mg\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.548592 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548526    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b076b972-5a0a-4d99-bba4-6e0c4f765e51-data-volume\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.548818 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548798    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjcfb\" (UniqueName: \"kubernetes.io/projected/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-api-access-sjcfb\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.548881 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548840    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.548881 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b076b972-5a0a-4d99-bba4-6e0c4f765e51-crio-socket\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.548966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b076b972-5a0a-4d99-bba4-6e0c4f765e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.548966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.548939    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b076b972-5a0a-4d99-bba4-6e0c4f765e51-data-volume\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.549110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.549093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b076b972-5a0a-4d99-bba4-6e0c4f765e51-crio-socket\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.549461 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.549436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.550783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.550765    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64a20dd9-e072-4450-9ea7-8de06f761ee3-cert\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.551005 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.550985    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b076b972-5a0a-4d99-bba4-6e0c4f765e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.557650 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.557625    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8mg\" (UniqueName: \"kubernetes.io/projected/64a20dd9-e072-4450-9ea7-8de06f761ee3-kube-api-access-tx8mg\") pod \"ingress-canary-2c67f\" (UID: \"64a20dd9-e072-4450-9ea7-8de06f761ee3\") " pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.559727 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.559705    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjcfb\" (UniqueName: \"kubernetes.io/projected/b076b972-5a0a-4d99-bba4-6e0c4f765e51-kube-api-access-sjcfb\") pod \"insights-runtime-extractor-9hdtx\" (UID: \"b076b972-5a0a-4d99-bba4-6e0c4f765e51\") " pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.573900 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.573876    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:18.575387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.575370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2c67f"
Sep 10 23:34:18.590539 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.590522    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9hdtx"
Sep 10 23:34:18.908704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.908674    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mh26h"]
Sep 10 23:34:18.912407 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:18.912377    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda112a57d_1f21_4858_8d96_24ed8f500307.slice/crio-30b944804c6c17cbe4914ba3e914ea08b00c39fd2e534181ab19cdb7caa08eaa WatchSource:0}: Error finding container 30b944804c6c17cbe4914ba3e914ea08b00c39fd2e534181ab19cdb7caa08eaa: Status 404 returned error can't find the container with id 30b944804c6c17cbe4914ba3e914ea08b00c39fd2e534181ab19cdb7caa08eaa
Sep 10 23:34:18.920485 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.920461    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2c67f"]
Sep 10 23:34:18.923204 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:18.923181    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a20dd9_e072_4450_9ea7_8de06f761ee3.slice/crio-e0dd02862a233796b435b59d3e82252cd96cfa6b18d84ee405733b240a716e71 WatchSource:0}: Error finding container e0dd02862a233796b435b59d3e82252cd96cfa6b18d84ee405733b240a716e71: Status 404 returned error can't find the container with id e0dd02862a233796b435b59d3e82252cd96cfa6b18d84ee405733b240a716e71
Sep 10 23:34:18.944639 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:18.944607    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9hdtx"]
Sep 10 23:34:18.948323 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:18.948282    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb076b972_5a0a_4d99_bba4_6e0c4f765e51.slice/crio-155e56ce75270fc8a9efb0f037046ca99c89610e837661ad5d28fb55e8ffd717 WatchSource:0}: Error finding container 155e56ce75270fc8a9efb0f037046ca99c89610e837661ad5d28fb55e8ffd717: Status 404 returned error can't find the container with id 155e56ce75270fc8a9efb0f037046ca99c89610e837661ad5d28fb55e8ffd717
Sep 10 23:34:19.227745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.227705    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:34:19.260353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.260276    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:34:19.260466 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.260387    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.263028 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263003    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:34:19.263028 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263006    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:34:19.263662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263637    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tclpx\""
Sep 10 23:34:19.263727 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263663    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 23:34:19.263776 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263729    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 23:34:19.263776 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263755    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:34:19.263920 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.263905    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:34:19.264145 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.264123    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:34:19.267599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.267375    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:34:19.423893 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.423854    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:19.424075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.423857    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:19.424075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.424008    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:19.426557 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.426531    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:34:19.426761 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.426741    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:34:19.426869 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.426784    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:34:19.426954 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.426936    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvw46\""
Sep 10 23:34:19.427088 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.427016    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ms7z\""
Sep 10 23:34:19.427210 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.427153    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:34:19.454982 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.454962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.454996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.455037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvb4\" (UniqueName: \"kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.455087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.455107    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.455145    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.455711 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.455168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.555961 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.555888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.555961 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.555926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.555981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.556001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.556038    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvb4\" (UniqueName: \"kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.556089    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.556112    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.556847 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.556816    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.557645 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.557616    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.557738 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.557691    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.558084 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.558064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.560053 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.559998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.560285 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.560264    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.565494 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.565469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvb4\" (UniqueName: \"kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4\") pod \"console-6f5d668678-nfqdt\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") " pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.570094 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.570073    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:19.708614 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.708270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9hdtx" event={"ID":"b076b972-5a0a-4d99-bba4-6e0c4f765e51","Type":"ContainerStarted","Data":"61b723a734b285d4b56b4426442c1a9a68be4058274469b9b2d62f30783c36e0"}
Sep 10 23:34:19.708614 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.708569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9hdtx" event={"ID":"b076b972-5a0a-4d99-bba4-6e0c4f765e51","Type":"ContainerStarted","Data":"155e56ce75270fc8a9efb0f037046ca99c89610e837661ad5d28fb55e8ffd717"}
Sep 10 23:34:19.710102 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.709913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2c67f" event={"ID":"64a20dd9-e072-4450-9ea7-8de06f761ee3","Type":"ContainerStarted","Data":"e0dd02862a233796b435b59d3e82252cd96cfa6b18d84ee405733b240a716e71"}
Sep 10 23:34:19.711452 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.711422    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh26h" event={"ID":"a112a57d-1f21-4858-8d96-24ed8f500307","Type":"ContainerStarted","Data":"30b944804c6c17cbe4914ba3e914ea08b00c39fd2e534181ab19cdb7caa08eaa"}
Sep 10 23:34:19.884726 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:19.884613    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:34:19.889174 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:19.889144    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1902bd2_f349_46c5_bcf6_5d3de9e8dd74.slice/crio-3bd8ddf2df13cf53a91d0045f203711cc83f1ed49fb660d11bdacd356f8e5790 WatchSource:0}: Error finding container 3bd8ddf2df13cf53a91d0045f203711cc83f1ed49fb660d11bdacd356f8e5790: Status 404 returned error can't find the container with id 3bd8ddf2df13cf53a91d0045f203711cc83f1ed49fb660d11bdacd356f8e5790
Sep 10 23:34:20.715313 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.715269    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5d668678-nfqdt" event={"ID":"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74","Type":"ContainerStarted","Data":"3bd8ddf2df13cf53a91d0045f203711cc83f1ed49fb660d11bdacd356f8e5790"}
Sep 10 23:34:20.856217 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.856183    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"]
Sep 10 23:34:20.879408 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.879381    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"]
Sep 10 23:34:20.879561 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.879520    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:20.881991 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.881967    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 23:34:20.882133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.882008    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-24hqw\""
Sep 10 23:34:20.882133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.882045    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 23:34:20.882818 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.882793    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 23:34:20.882818 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.882803    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 23:34:20.882995 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.882872    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 23:34:20.970114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.970001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhw9\" (UniqueName: \"kubernetes.io/projected/8160215e-c1b2-4554-acf9-a3d758540242-kube-api-access-5jhw9\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:20.970114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.970065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8160215e-c1b2-4554-acf9-a3d758540242-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:20.970383 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.970213    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:20.970383 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:20.970260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.071367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.071328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhw9\" (UniqueName: \"kubernetes.io/projected/8160215e-c1b2-4554-acf9-a3d758540242-kube-api-access-5jhw9\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.071545 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.071385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8160215e-c1b2-4554-acf9-a3d758540242-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.071545 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.071447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.071545 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.071479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.071708 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:21.071592    2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 10 23:34:21.071708 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:21.071661    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls podName:8160215e-c1b2-4554-acf9-a3d758540242 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:21.571641936 +0000 UTC m=+47.675928728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-pnpnp" (UID: "8160215e-c1b2-4554-acf9-a3d758540242") : secret "prometheus-operator-tls" not found
Sep 10 23:34:21.072274 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.072224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8160215e-c1b2-4554-acf9-a3d758540242-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.076009 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.075985    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.080204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.080158    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhw9\" (UniqueName: \"kubernetes.io/projected/8160215e-c1b2-4554-acf9-a3d758540242-kube-api-access-5jhw9\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.575191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.575149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.577899 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.577867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8160215e-c1b2-4554-acf9-a3d758540242-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pnpnp\" (UID: \"8160215e-c1b2-4554-acf9-a3d758540242\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:21.790719 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:21.790686    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"
Sep 10 23:34:22.160914 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.160733    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp"]
Sep 10 23:34:22.165116 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:22.165087    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8160215e_c1b2_4554_acf9_a3d758540242.slice/crio-91042a9ffe27259d8ee2c8bf85fdeffa1af42efc14f53f79fb06fb0e2501b3ee WatchSource:0}: Error finding container 91042a9ffe27259d8ee2c8bf85fdeffa1af42efc14f53f79fb06fb0e2501b3ee: Status 404 returned error can't find the container with id 91042a9ffe27259d8ee2c8bf85fdeffa1af42efc14f53f79fb06fb0e2501b3ee
Sep 10 23:34:22.723834 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.723797    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh26h" event={"ID":"a112a57d-1f21-4858-8d96-24ed8f500307","Type":"ContainerStarted","Data":"2548f3359db468b16eee7583e016066cbe483d6a75b61da055914f7aece20100"}
Sep 10 23:34:22.724031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.723862    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh26h" event={"ID":"a112a57d-1f21-4858-8d96-24ed8f500307","Type":"ContainerStarted","Data":"af2d01588f8ad9d911785311ae8db4dae5cc9fe407336ef644b036a8edaebab2"}
Sep 10 23:34:22.724031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.723894    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:22.725670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.725642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2c67f" event={"ID":"64a20dd9-e072-4450-9ea7-8de06f761ee3","Type":"ContainerStarted","Data":"a86d2c40fb7cc350c95fd57eb8d5fbcfd6cb7bb6449fdb50e2e35bdb57fbfd4c"}
Sep 10 23:34:22.727883 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.727852    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9hdtx" event={"ID":"b076b972-5a0a-4d99-bba4-6e0c4f765e51","Type":"ContainerStarted","Data":"ab6665b3230799d6db784fd77e4ae5ef0bce6ab1a61fb320c2c2dba9854216b4"}
Sep 10 23:34:22.729240 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.729212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp" event={"ID":"8160215e-c1b2-4554-acf9-a3d758540242","Type":"ContainerStarted","Data":"91042a9ffe27259d8ee2c8bf85fdeffa1af42efc14f53f79fb06fb0e2501b3ee"}
Sep 10 23:34:22.742395 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.742216    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mh26h" podStartSLOduration=1.7739822840000001 podStartE2EDuration="4.742198501s" totalImagesPullingTime="2.968216217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:22.741384181 +0000 UTC m=+48.845670996" watchObservedRunningTime="2026-09-10 23:34:22.742198501 +0000 UTC m=+48.846485304"
Sep 10 23:34:22.758938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:22.758893    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2c67f" podStartSLOduration=1.79429029 podStartE2EDuration="4.758878294s" totalImagesPullingTime="2.964588004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:22.758490264 +0000 UTC m=+48.862777090" watchObservedRunningTime="2026-09-10 23:34:22.758878294 +0000 UTC m=+48.863165092"
Sep 10 23:34:24.737948 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:24.737899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5d668678-nfqdt" event={"ID":"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74","Type":"ContainerStarted","Data":"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"}
Sep 10 23:34:24.755721 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:24.755662    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5d668678-nfqdt" podStartSLOduration=1.920403922 podStartE2EDuration="5.755642783s" totalImagesPullingTime="3.835238861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:24.754672301 +0000 UTC m=+50.858959111" watchObservedRunningTime="2026-09-10 23:34:24.755642783 +0000 UTC m=+50.859929579"
Sep 10 23:34:25.745336 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:25.745002    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9hdtx" event={"ID":"b076b972-5a0a-4d99-bba4-6e0c4f765e51","Type":"ContainerStarted","Data":"0ca5fa484f0d0a7ab05645f8c0a18191b1bfaad9bb2948c7258e19d8f8511cc7"}
Sep 10 23:34:25.746829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:25.746803    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp" event={"ID":"8160215e-c1b2-4554-acf9-a3d758540242","Type":"ContainerStarted","Data":"f38b522a0c4339e54da003e396bcde4dd817624a42d72811c8df61901147ec0c"}
Sep 10 23:34:25.746931 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:25.746853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp" event={"ID":"8160215e-c1b2-4554-acf9-a3d758540242","Type":"ContainerStarted","Data":"4e1c53ff446f9b158abf4a892e77be73b0830d5718d6faab4023ce9a52c4e829"}
Sep 10 23:34:25.815550 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:25.815270    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pnpnp" podStartSLOduration=2.72723978 podStartE2EDuration="5.815251312s" totalImagesPullingTime="3.088011532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:25.811702199 +0000 UTC m=+51.915989014" watchObservedRunningTime="2026-09-10 23:34:25.815251312 +0000 UTC m=+51.919538107"
Sep 10 23:34:25.816087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:25.815771    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9hdtx" podStartSLOduration=1.8194688239999999 podStartE2EDuration="7.815755009s" totalImagesPullingTime="5.996286185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:34:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:25.785600908 +0000 UTC m=+51.889887720" watchObservedRunningTime="2026-09-10 23:34:25.815755009 +0000 UTC m=+51.920041800"
Sep 10 23:34:28.257391 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.257357    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"]
Sep 10 23:34:28.260071 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.260048    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.260420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.260384    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-59z7j"]
Sep 10 23:34:28.262897 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.262873    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 23:34:28.262995 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.262880    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-km8xv\""
Sep 10 23:34:28.263078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.263057    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 23:34:28.263753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.263730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.263930 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.263908    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 23:34:28.265778 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.265757    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 23:34:28.266125 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.266109    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s2m6r\""
Sep 10 23:34:28.266204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.266146    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 23:34:28.266204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.266170    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 23:34:28.274976 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.274957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"]
Sep 10 23:34:28.329879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.329852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-sys\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.329879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.329881    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d1d9423f-2229-48b6-a7fd-b1d8fa512476-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.329901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.329933    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.329986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330028    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm79d\" (UniqueName: \"kubernetes.io/projected/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-api-access-pm79d\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330057    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-textfile\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-root\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-metrics-client-ca\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330188    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330456 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.330456 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330245    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jtx\" (UniqueName: \"kubernetes.io/projected/e445e088-de11-41e7-bb3e-d004f4e9e6a2-kube-api-access-24jtx\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.330456 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.330264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-wtmp\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431121 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-textfile\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431124    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.431230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431146    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-root\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-metrics-client-ca\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431231    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-root\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.431278    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.431352    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls podName:e445e088-de11-41e7-bb3e-d004f4e9e6a2 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.931333533 +0000 UTC m=+55.035620325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls") pod "node-exporter-59z7j" (UID: "e445e088-de11-41e7-bb3e-d004f4e9e6a2") : secret "node-exporter-tls" not found
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.431405    2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jtx\" (UniqueName: \"kubernetes.io/projected/e445e088-de11-41e7-bb3e-d004f4e9e6a2-kube-api-access-24jtx\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431467 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.431451    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls podName:d1d9423f-2229-48b6-a7fd-b1d8fa512476 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:28.931436355 +0000 UTC m=+55.035723135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-8sn4j" (UID: "d1d9423f-2229-48b6-a7fd-b1d8fa512476") : secret "kube-state-metrics-tls" not found
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-wtmp\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-textfile\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-sys\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d1d9423f-2229-48b6-a7fd-b1d8fa512476-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431641    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431662    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-wtmp\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.431852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431744    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm79d\" (UniqueName: \"kubernetes.io/projected/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-api-access-pm79d\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.432200 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-metrics-client-ca\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.432200 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431918    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.432200 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.431948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e445e088-de11-41e7-bb3e-d004f4e9e6a2-sys\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.432200 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.432042    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d1d9423f-2229-48b6-a7fd-b1d8fa512476-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.432344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.432284    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.432415 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.432396    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.435772 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.435729    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.435896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.435874    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.442522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.442497    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm79d\" (UniqueName: \"kubernetes.io/projected/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-api-access-pm79d\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.442602 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.442547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jtx\" (UniqueName: \"kubernetes.io/projected/e445e088-de11-41e7-bb3e-d004f4e9e6a2-kube-api-access-24jtx\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.939351 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.939311    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:28.939518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.939362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:28.939599 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.939578    2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 23:34:28.939678 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:28.939667    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls podName:d1d9423f-2229-48b6-a7fd-b1d8fa512476 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:29.939650463 +0000 UTC m=+56.043937235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-8sn4j" (UID: "d1d9423f-2229-48b6-a7fd-b1d8fa512476") : secret "kube-state-metrics-tls" not found
Sep 10 23:34:28.941588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:28.941566    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e445e088-de11-41e7-bb3e-d004f4e9e6a2-node-exporter-tls\") pod \"node-exporter-59z7j\" (UID: \"e445e088-de11-41e7-bb3e-d004f4e9e6a2\") " pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:29.175431 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.175404    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59z7j"
Sep 10 23:34:29.186746 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:29.186717    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode445e088_de11_41e7_bb3e_d004f4e9e6a2.slice/crio-9cfa0804624a0b7352e5a5961bb85832398ce73679c7338d3e16838ba27542c0 WatchSource:0}: Error finding container 9cfa0804624a0b7352e5a5961bb85832398ce73679c7338d3e16838ba27542c0: Status 404 returned error can't find the container with id 9cfa0804624a0b7352e5a5961bb85832398ce73679c7338d3e16838ba27542c0
Sep 10 23:34:29.306142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.306111    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:34:29.310347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.310327    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.312719 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.312692    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 23:34:29.312808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.312734    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 23:34:29.312863 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.312734    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 23:34:29.312863 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.312735    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 23:34:29.312979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.312735    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 23:34:29.313067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.313052    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g78sh\""
Sep 10 23:34:29.313118 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.313069    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 23:34:29.313239 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.313219    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 23:34:29.313376 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.313314    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 23:34:29.313496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.313480    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 23:34:29.325936 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.325918    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:34:29.342087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342205 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342205 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342205 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342180    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342268    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342358    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342538 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342398    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342538 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342538 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342466    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342538 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342495    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342655 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342551    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbqw\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.342655 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.342573    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443689 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443624    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443689 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443657    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443740    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443867 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:29.443826    2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 10 23:34:29.443966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443866    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.443966 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:29.443896    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls podName:0f816a72-24c2-4336-b3ab-d9c6d039c663 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:29.943878014 +0000 UTC m=+56.048164817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663") : secret "alertmanager-main-tls" not found
Sep 10 23:34:29.443966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443942    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.443970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444103    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbqw\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444196    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.444338 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:34:29.444240    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle podName:0f816a72-24c2-4336-b3ab-d9c6d039c663 nodeName:}" failed. No retries permitted until 2026-09-10 23:34:29.9442203 +0000 UTC m=+56.048507073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663") : configmap references non-existent config key: ca-bundle.crt
Sep 10 23:34:29.444580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.444130    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.445964 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.445934    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447003 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.446949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447003 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.446973    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447003 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.446973    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447193 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.447060    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447193 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.447141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.447500 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.447481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.448151 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.448136    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.448566 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.448546    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.452676 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.452655    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbqw\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.570851 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.570821    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:29.570982 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.570869    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:29.575832 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.575813    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:29.759638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.759550    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59z7j" event={"ID":"e445e088-de11-41e7-bb3e-d004f4e9e6a2","Type":"ContainerStarted","Data":"9cfa0804624a0b7352e5a5961bb85832398ce73679c7338d3e16838ba27542c0"}
Sep 10 23:34:29.763576 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.763552    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:34:29.949930 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.949890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:29.950084 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.949952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.950084 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.949995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.950911 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.950853    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:29.952745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.952721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d9423f-2229-48b6-a7fd-b1d8fa512476-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8sn4j\" (UID: \"d1d9423f-2229-48b6-a7fd-b1d8fa512476\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:29.952868 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:29.952766    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:30.070489 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.070408    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"
Sep 10 23:34:30.220336 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.220288    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:34:30.519515 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.519493    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j"]
Sep 10 23:34:30.521694 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:30.521668    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d9423f_2229_48b6_a7fd_b1d8fa512476.slice/crio-14800e3a38f7f86b4f5087faf8fedc7b2cc66fac54cb961764b680ad4d20372a WatchSource:0}: Error finding container 14800e3a38f7f86b4f5087faf8fedc7b2cc66fac54cb961764b680ad4d20372a: Status 404 returned error can't find the container with id 14800e3a38f7f86b4f5087faf8fedc7b2cc66fac54cb961764b680ad4d20372a
Sep 10 23:34:30.527721 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.527701    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:34:30.530485 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:30.530462    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f816a72_24c2_4336_b3ab_d9c6d039c663.slice/crio-1eedf3e7e2808986a3707c16a5084554e54784eb619e778f9a3a52abe5671ab3 WatchSource:0}: Error finding container 1eedf3e7e2808986a3707c16a5084554e54784eb619e778f9a3a52abe5671ab3: Status 404 returned error can't find the container with id 1eedf3e7e2808986a3707c16a5084554e54784eb619e778f9a3a52abe5671ab3
Sep 10 23:34:30.764803 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.764764    2566 generic.go:356] "Generic (PLEG): container finished" podID="e445e088-de11-41e7-bb3e-d004f4e9e6a2" containerID="df0c73a6c52e3774a1e8940ac868468d3e2457b848f7dd5acce696589b3e8fdb" exitCode=0
Sep 10 23:34:30.764993 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.764854    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59z7j" event={"ID":"e445e088-de11-41e7-bb3e-d004f4e9e6a2","Type":"ContainerDied","Data":"df0c73a6c52e3774a1e8940ac868468d3e2457b848f7dd5acce696589b3e8fdb"}
Sep 10 23:34:30.766168 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.766147    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"1eedf3e7e2808986a3707c16a5084554e54784eb619e778f9a3a52abe5671ab3"}
Sep 10 23:34:30.767443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:30.767421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j" event={"ID":"d1d9423f-2229-48b6-a7fd-b1d8fa512476","Type":"ContainerStarted","Data":"14800e3a38f7f86b4f5087faf8fedc7b2cc66fac54cb961764b680ad4d20372a"}
Sep 10 23:34:31.774093 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:31.774057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59z7j" event={"ID":"e445e088-de11-41e7-bb3e-d004f4e9e6a2","Type":"ContainerStarted","Data":"1107de7bb26423ad8ae8d9631f21de0431061047aa6b99e760327204d78a12be"}
Sep 10 23:34:31.774615 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:31.774117    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59z7j" event={"ID":"e445e088-de11-41e7-bb3e-d004f4e9e6a2","Type":"ContainerStarted","Data":"3b1230bd573767c3828745da2910b07a74ffd394b4189c4e64c5023612a0e8d4"}
Sep 10 23:34:31.794596 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:31.794553    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-59z7j" podStartSLOduration=2.630815145 podStartE2EDuration="3.794537677s" totalImagesPullingTime="1.102820472s" totalInitContainerRuntime="60.90206ms" isStatefulPod=true podCreationTimestamp="2026-09-10 23:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:31.79347553 +0000 UTC m=+57.897762328" watchObservedRunningTime="2026-09-10 23:34:31.794537677 +0000 UTC m=+57.898824471"
Sep 10 23:34:32.638448 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.638376    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b76596d97-x8ndv"]
Sep 10 23:34:32.658821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.658791    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b76596d97-x8ndv"]
Sep 10 23:34:32.658962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.658884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.663695 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.663671    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5t5qc\""
Sep 10 23:34:32.664047 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.664021    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 23:34:32.664755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.664734    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 23:34:32.664958 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.664924    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 23:34:32.665079 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.664979    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3cl1fbj9a2bv\""
Sep 10 23:34:32.665079 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.665008    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 23:34:32.757349 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.757326    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mh26h"
Sep 10 23:34:32.772453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ebed4d-92a6-465c-9d3f-fa0773328339-audit-log\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772557 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772467    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-client-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772557 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-tls\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-metrics-server-audit-profiles\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrfgt\" (UniqueName: \"kubernetes.io/projected/96ebed4d-92a6-465c-9d3f-fa0773328339-kube-api-access-vrfgt\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-client-certs\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.772732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.772661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.779057 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.779032    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="6fa94359af9fb3fe63286cf474f64cd1b35a12132bd9c190e2d037cc45533314" exitCode=0
Sep 10 23:34:32.779433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.779122    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"6fa94359af9fb3fe63286cf474f64cd1b35a12132bd9c190e2d037cc45533314"}
Sep 10 23:34:32.781532 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.781508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j" event={"ID":"d1d9423f-2229-48b6-a7fd-b1d8fa512476","Type":"ContainerStarted","Data":"119d25c5d98d93855332301cbd9cb130e587ede7b7c1c3e3d2058e200e832702"}
Sep 10 23:34:32.781603 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.781565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j" event={"ID":"d1d9423f-2229-48b6-a7fd-b1d8fa512476","Type":"ContainerStarted","Data":"94c38b566a2afdc58e4abc31ead939300876071601dfd5f2dc078c08a03ec4c5"}
Sep 10 23:34:32.781603 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.781597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j" event={"ID":"d1d9423f-2229-48b6-a7fd-b1d8fa512476","Type":"ContainerStarted","Data":"2190748807b337078678dc144ca06ee98686f35ea7a210ce5bb451e017bcff49"}
Sep 10 23:34:32.834902 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.834853    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8sn4j" podStartSLOduration=3.384239817 podStartE2EDuration="4.834836283s" totalImagesPullingTime="1.450596466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:32.83376784 +0000 UTC m=+58.938054653" watchObservedRunningTime="2026-09-10 23:34:32.834836283 +0000 UTC m=+58.939123077"
Sep 10 23:34:32.873227 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.873197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-tls\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.873784 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.873754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-metrics-server-audit-profiles\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874041    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrfgt\" (UniqueName: \"kubernetes.io/projected/96ebed4d-92a6-465c-9d3f-fa0773328339-kube-api-access-vrfgt\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874142    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-client-certs\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874246 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ebed4d-92a6-465c-9d3f-fa0773328339-audit-log\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874464 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874446    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-client-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874798 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874775    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-metrics-server-audit-profiles\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ebed4d-92a6-465c-9d3f-fa0773328339-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.874991 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.874968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ebed4d-92a6-465c-9d3f-fa0773328339-audit-log\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.875983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.875958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-tls\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.876980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.876958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-secret-metrics-server-client-certs\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.877134 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.877115    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ebed4d-92a6-465c-9d3f-fa0773328339-client-ca-bundle\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.881801 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.881783    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrfgt\" (UniqueName: \"kubernetes.io/projected/96ebed4d-92a6-465c-9d3f-fa0773328339-kube-api-access-vrfgt\") pod \"metrics-server-7b76596d97-x8ndv\" (UID: \"96ebed4d-92a6-465c-9d3f-fa0773328339\") " pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:32.972558 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:32.972514    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:33.000950 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.000920    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"]
Sep 10 23:34:33.018690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.018667    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.020888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.020866    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 23:34:33.020988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.020947    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rpddt\""
Sep 10 23:34:33.026070 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.026042    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"]
Sep 10 23:34:33.076821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.076795    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmm4\" (UniqueName: \"kubernetes.io/projected/9334f8b6-435a-44eb-a66c-4c4b1a78780b-kube-api-access-tsmm4\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.076916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.076836    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9334f8b6-435a-44eb-a66c-4c4b1a78780b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.177804 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.177772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmm4\" (UniqueName: \"kubernetes.io/projected/9334f8b6-435a-44eb-a66c-4c4b1a78780b-kube-api-access-tsmm4\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.177969 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.177817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9334f8b6-435a-44eb-a66c-4c4b1a78780b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.180245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.180216    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9334f8b6-435a-44eb-a66c-4c4b1a78780b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.189926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.189901    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmm4\" (UniqueName: \"kubernetes.io/projected/9334f8b6-435a-44eb-a66c-4c4b1a78780b-kube-api-access-tsmm4\") pod \"monitoring-plugin-5d85778b9d-kpnzs\" (UID: \"9334f8b6-435a-44eb-a66c-4c4b1a78780b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.284707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.284642    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b76596d97-x8ndv"]
Sep 10 23:34:33.288247 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:33.288224    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ebed4d_92a6_465c_9d3f_fa0773328339.slice/crio-5b1543554ce6c280f5f4aa318f43952a5ee1fab5cf9b3a1d196f06428afbbbfb WatchSource:0}: Error finding container 5b1543554ce6c280f5f4aa318f43952a5ee1fab5cf9b3a1d196f06428afbbbfb: Status 404 returned error can't find the container with id 5b1543554ce6c280f5f4aa318f43952a5ee1fab5cf9b3a1d196f06428afbbbfb
Sep 10 23:34:33.339846 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.339794    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:33.630062 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.630030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"]
Sep 10 23:34:33.632893 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:33.632866    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9334f8b6_435a_44eb_a66c_4c4b1a78780b.slice/crio-7f05864d9b6f3e1229ee1a8af0fe3163c54f56bc935b12f2b877500f45a3ebc1 WatchSource:0}: Error finding container 7f05864d9b6f3e1229ee1a8af0fe3163c54f56bc935b12f2b877500f45a3ebc1: Status 404 returned error can't find the container with id 7f05864d9b6f3e1229ee1a8af0fe3163c54f56bc935b12f2b877500f45a3ebc1
Sep 10 23:34:33.787762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.787714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv" event={"ID":"96ebed4d-92a6-465c-9d3f-fa0773328339","Type":"ContainerStarted","Data":"5b1543554ce6c280f5f4aa318f43952a5ee1fab5cf9b3a1d196f06428afbbbfb"}
Sep 10 23:34:33.789216 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:33.789156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs" event={"ID":"9334f8b6-435a-44eb-a66c-4c4b1a78780b","Type":"ContainerStarted","Data":"7f05864d9b6f3e1229ee1a8af0fe3163c54f56bc935b12f2b877500f45a3ebc1"}
Sep 10 23:34:34.460475 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.460411    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:34:34.465912 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.465889    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.470821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.470248    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 23:34:34.470821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.470496    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.471434    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.471665    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.471857    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.472030    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.472192    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.472472    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.472663    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.472848    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgm52\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.473050    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.473237    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.473439    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7solcc62l9qc8\""
Sep 10 23:34:34.474129 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.473628    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 23:34:34.475055 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.474824    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 23:34:34.477598 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.477268    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 23:34:34.495583 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.495560    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592436    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592460    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.592588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2lw8\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592587    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592851    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.592942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593476 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.593446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593528 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.593491    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593528 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.593517    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.593586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.593704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.593680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694495 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694641    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694741    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694805    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694848    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.694956 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.694938    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695280 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695614    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695638    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695658    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.695740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.696065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2lw8\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.696065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695770    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.696065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695792    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.696065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.695825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.696470 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.696438    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.697974 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.697418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.700225 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.700130    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.702020 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.701979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.702694 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.702661    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.703386 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.703366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.703996 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.703943    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.704067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.704003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.704700 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.704672    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.704928 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.704871    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.705044 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.705026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.705164 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.705104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.705164 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.705137    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.705731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.705310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.706233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.706210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.709189 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.709163    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2lw8\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8\") pod \"prometheus-k8s-0\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:34.783554 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:34.783258    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:35.799072 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.799045    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs" event={"ID":"9334f8b6-435a-44eb-a66c-4c4b1a78780b","Type":"ContainerStarted","Data":"e4c4ff6f6f25a2364c90b80b501526a7491dde7cf517772e3999d938d7d4c231"}
Sep 10 23:34:35.799522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.799132    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:35.801792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.801762    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv" event={"ID":"96ebed4d-92a6-465c-9d3f-fa0773328339","Type":"ContainerStarted","Data":"67e18cdf57f64f3f363f34183e615cc4c0b846fbea96b9f7b67220a62b64c1f7"}
Sep 10 23:34:35.805694 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.805670    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs"
Sep 10 23:34:35.807120 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.806965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"d584e463229778fcb72da35e7a6b09227fb12ae55615c72b57c6f6a99899ce46"}
Sep 10 23:34:35.807120 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.807063    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"d0c5de0fa645e3963bbf7f67356d07c23d26a89dc7b1152f006838bcac4b4ef1"}
Sep 10 23:34:35.819721 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.819679    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kpnzs" podStartSLOduration=1.84342365 podStartE2EDuration="3.819665414s" totalImagesPullingTime="1.976241764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:35.818617618 +0000 UTC m=+61.922904435" watchObservedRunningTime="2026-09-10 23:34:35.819665414 +0000 UTC m=+61.923952207"
Sep 10 23:34:35.839347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.839146    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv" podStartSLOduration=1.519376195 podStartE2EDuration="3.839127884s" totalImagesPullingTime="2.319751689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:35.838819977 +0000 UTC m=+61.943106773" watchObservedRunningTime="2026-09-10 23:34:35.839127884 +0000 UTC m=+61.943414678"
Sep 10 23:34:35.888028 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:35.887980    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:34:35.889867 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:35.889840    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed6b2cc_318f_4877_93e2_7b894ff8b72c.slice/crio-83551e6a985dd7663664b48e13c95a8b82e5592016fc9f741893dc181ca061f5 WatchSource:0}: Error finding container 83551e6a985dd7663664b48e13c95a8b82e5592016fc9f741893dc181ca061f5: Status 404 returned error can't find the container with id 83551e6a985dd7663664b48e13c95a8b82e5592016fc9f741893dc181ca061f5
Sep 10 23:34:36.506815 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.506781    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46qtp"
Sep 10 23:34:36.818420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.818330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"8ee6eb526125ddafae1a74b16514cbb648dbf33dbcf1fa294f14ecc56529d58e"}
Sep 10 23:34:36.818816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.818433    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"8bbfd23b92a53e29c0299861f8aa611368f9efaf9bd322b35121c9e279619a63"}
Sep 10 23:34:36.818816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.818471    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"fc960074a3662fc6759b3a1df3c24f55c69f5039694f620c784105d3fec06939"}
Sep 10 23:34:36.818816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.818503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerStarted","Data":"b6066fcd0c72c347ee7703f7bfc80b11e055163caee9601139815430301a915a"}
Sep 10 23:34:36.819909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.819885    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74" exitCode=0
Sep 10 23:34:36.819995 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.819957    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74"}
Sep 10 23:34:36.820036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.820012    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"83551e6a985dd7663664b48e13c95a8b82e5592016fc9f741893dc181ca061f5"}
Sep 10 23:34:36.848088 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:36.848043    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.906386504 podStartE2EDuration="7.848025385s" totalImagesPullingTime="4.930429719s" totalInitContainerRuntime="11.209162ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:36.847828808 +0000 UTC m=+62.952115617" watchObservedRunningTime="2026-09-10 23:34:36.848025385 +0000 UTC m=+62.952312181"
Sep 10 23:34:40.153581 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.153545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:40.156182 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.156158    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:34:40.167433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.167002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d-metrics-certs\") pod \"network-metrics-daemon-j296r\" (UID: \"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d\") " pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:40.254894 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.254863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:40.255015 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.254910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:40.257368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.257349    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:34:40.257427 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.257398    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:34:40.267114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.267096    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ba092d9-9f97-4e55-96bf-2b84fd488f12-original-pull-secret\") pod \"global-pull-secret-syncer-fxhws\" (UID: \"6ba092d9-9f97-4e55-96bf-2b84fd488f12\") " pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:40.267368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.267355    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:34:40.277423 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.277406    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdwl\" (UniqueName: \"kubernetes.io/projected/20bb5719-8608-47b6-8945-8b642999d522-kube-api-access-nfdwl\") pod \"network-check-target-cljsz\" (UID: \"20bb5719-8608-47b6-8945-8b642999d522\") " pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:40.437791 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.437730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxhws"
Sep 10 23:34:40.448341 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.448318    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvw46\""
Sep 10 23:34:40.454387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.454368    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ms7z\""
Sep 10 23:34:40.456469 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.456454    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:40.463329 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.463310    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j296r"
Sep 10 23:34:40.839755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.839720    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"}
Sep 10 23:34:40.940142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.940103    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j296r"]
Sep 10 23:34:40.947015 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.945357    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cljsz"]
Sep 10 23:34:40.947015 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:40.946501    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxhws"]
Sep 10 23:34:40.954393 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:34:40.954343    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bb5719_8608_47b6_8945_8b642999d522.slice/crio-ad7db3e9d8bebb084e62a517425cdf50b3b1987042fbdda97dce8985a55323f6 WatchSource:0}: Error finding container ad7db3e9d8bebb084e62a517425cdf50b3b1987042fbdda97dce8985a55323f6: Status 404 returned error can't find the container with id ad7db3e9d8bebb084e62a517425cdf50b3b1987042fbdda97dce8985a55323f6
Sep 10 23:34:41.853681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:41.853641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxhws" event={"ID":"6ba092d9-9f97-4e55-96bf-2b84fd488f12","Type":"ContainerStarted","Data":"76a05618ad0dd336329d959b42b7977ba3a4ba89a05d89237ebc9fd7c37f809a"}
Sep 10 23:34:41.864198 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:41.864161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"}
Sep 10 23:34:41.865890 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:41.865822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cljsz" event={"ID":"20bb5719-8608-47b6-8945-8b642999d522","Type":"ContainerStarted","Data":"ad7db3e9d8bebb084e62a517425cdf50b3b1987042fbdda97dce8985a55323f6"}
Sep 10 23:34:41.867597 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:41.867569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j296r" event={"ID":"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d","Type":"ContainerStarted","Data":"23eeef61041326f896c9f1b263040dfca9065f46bc1237507969213c91961f90"}
Sep 10 23:34:42.876740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:42.876006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j296r" event={"ID":"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d","Type":"ContainerStarted","Data":"50be4a440f43be124e41be6d89d482984a837ad82523977c4822fd8987a0f9f4"}
Sep 10 23:34:42.876740 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:42.876076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j296r" event={"ID":"2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d","Type":"ContainerStarted","Data":"77ea13f6f5fbb3c69f94d87ed380dc891d6e7d5b528d23018ee44e4af36c9c0a"}
Sep 10 23:34:42.896353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:42.894800    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j296r" podStartSLOduration=67.616579624 podStartE2EDuration="1m8.89477776s" totalImagesPullingTime="1.278198136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:42.893018592 +0000 UTC m=+68.997305387" watchObservedRunningTime="2026-09-10 23:34:42.89477776 +0000 UTC m=+68.999064555"
Sep 10 23:34:43.865418 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:43.865379    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:34:43.892665 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:43.892629    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"}
Sep 10 23:34:43.893108 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:43.892744    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"}
Sep 10 23:34:43.893108 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:43.892775    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"}
Sep 10 23:34:46.907458 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.907421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxhws" event={"ID":"6ba092d9-9f97-4e55-96bf-2b84fd488f12","Type":"ContainerStarted","Data":"5430e579e4b4c957b82c4c9895b10ab4b35d939055b436d52b76692d491909ba"}
Sep 10 23:34:46.911141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.911104    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerStarted","Data":"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"}
Sep 10 23:34:46.912546 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.912520    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cljsz" event={"ID":"20bb5719-8608-47b6-8945-8b642999d522","Type":"ContainerStarted","Data":"18c7c81f2c5a2c77159c7089343d583c04a329bd2003daabb8e55858baec320f"}
Sep 10 23:34:46.912667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.912652    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:34:46.928481 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.925557    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxhws" podStartSLOduration=67.797220505 podStartE2EDuration="1m12.925538405s" totalImagesPullingTime="5.1283179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:46.923271706 +0000 UTC m=+73.027558523" watchObservedRunningTime="2026-09-10 23:34:46.925538405 +0000 UTC m=+73.029825200"
Sep 10 23:34:46.945098 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.945057    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cljsz" podStartSLOduration=67.822297072 podStartE2EDuration="1m12.945043531s" totalImagesPullingTime="5.122746459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:46.944131104 +0000 UTC m=+73.048417896" watchObservedRunningTime="2026-09-10 23:34:46.945043531 +0000 UTC m=+73.049330325"
Sep 10 23:34:46.984698 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:46.984649    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.735818321 podStartE2EDuration="12.984630313s" totalImagesPullingTime="6.228122214s" totalInitContainerRuntime="20.689778ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:46.983514927 +0000 UTC m=+73.087801741" watchObservedRunningTime="2026-09-10 23:34:46.984630313 +0000 UTC m=+73.088917109"
Sep 10 23:34:49.784198 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:49.784167    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:34:52.973502 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:52.973467    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:34:52.973960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:34:52.973524    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:35:08.892920 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:08.892784    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f5d668678-nfqdt" podUID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" containerName="console" containerID="cri-o://1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495" gracePeriod=15
Sep 10 23:35:09.140955 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.140931    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:35:09.192136 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192106    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192145    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192183    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvb4\" (UniqueName: \"kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192213    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192241    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192286    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192572 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192357    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert\") pod \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\" (UID: \"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74\") "
Sep 10 23:35:09.192689 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192659    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:09.192758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192681    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:09.192758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192669    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config" (OuterVolumeSpecName: "console-config") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:09.192758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.192743    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:09.194513 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.194481    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:09.194611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.194569    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:09.194611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.194574    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4" (OuterVolumeSpecName: "kube-api-access-4fvb4") pod "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" (UID: "a1902bd2-f349-46c5-bcf6-5d3de9e8dd74"). InnerVolumeSpecName "kube-api-access-4fvb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:09.293876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293839    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-oauth-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.293876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293873    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.294030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293888    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvb4\" (UniqueName: \"kubernetes.io/projected/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-kube-api-access-4fvb4\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.294030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293901    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-oauth-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.294030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293915    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.294030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293927    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:09.294030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:09.293940    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74-console-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:10.000871 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.000834    2566 generic.go:356] "Generic (PLEG): container finished" podID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" containerID="1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495" exitCode=0
Sep 10 23:35:10.001321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.000878    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5d668678-nfqdt"
Sep 10 23:35:10.001321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.000917    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5d668678-nfqdt" event={"ID":"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74","Type":"ContainerDied","Data":"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"}
Sep 10 23:35:10.001321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.000963    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5d668678-nfqdt" event={"ID":"a1902bd2-f349-46c5-bcf6-5d3de9e8dd74","Type":"ContainerDied","Data":"3bd8ddf2df13cf53a91d0045f203711cc83f1ed49fb660d11bdacd356f8e5790"}
Sep 10 23:35:10.001321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.000984    2566 scope.go:117] "RemoveContainer" containerID="1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"
Sep 10 23:35:10.009744 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.009726    2566 scope.go:117] "RemoveContainer" containerID="1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"
Sep 10 23:35:10.010026 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:10.010005    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495\": container with ID starting with 1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495 not found: ID does not exist" containerID="1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"
Sep 10 23:35:10.010097 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.010036    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495"} err="failed to get container status \"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495\": rpc error: code = NotFound desc = could not find container \"1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495\": container with ID starting with 1d829c0e709e5458e9449613be760187fae9f41bcade4c4bbc39301bdd10c495 not found: ID does not exist"
Sep 10 23:35:10.020954 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.020925    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:35:10.023050 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.023029    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5d668678-nfqdt"]
Sep 10 23:35:10.428633 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:10.428600    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" path="/var/lib/kubelet/pods/a1902bd2-f349-46c5-bcf6-5d3de9e8dd74/volumes"
Sep 10 23:35:12.978633 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:12.978605    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:35:12.982388 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:12.982366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b76596d97-x8ndv"
Sep 10 23:35:17.918183 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:17.918150    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cljsz"
Sep 10 23:35:34.784235 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:34.784207    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:34.803986 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:34.803958    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:35.123094 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:35.123012    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:48.485223 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485186    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:48.485678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485462    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="alertmanager" containerID="cri-o://d0c5de0fa645e3963bbf7f67356d07c23d26a89dc7b1152f006838bcac4b4ef1" gracePeriod=120
Sep 10 23:35:48.485678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485551    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-web" containerID="cri-o://b6066fcd0c72c347ee7703f7bfc80b11e055163caee9601139815430301a915a" gracePeriod=120
Sep 10 23:35:48.485678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485587    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="prom-label-proxy" containerID="cri-o://8ee6eb526125ddafae1a74b16514cbb648dbf33dbcf1fa294f14ecc56529d58e" gracePeriod=120
Sep 10 23:35:48.485678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485623    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="config-reloader" containerID="cri-o://d584e463229778fcb72da35e7a6b09227fb12ae55615c72b57c6f6a99899ce46" gracePeriod=120
Sep 10 23:35:48.485678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485549    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-metric" containerID="cri-o://8bbfd23b92a53e29c0299861f8aa611368f9efaf9bd322b35121c9e279619a63" gracePeriod=120
Sep 10 23:35:48.485958 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:48.485821    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy" containerID="cri-o://fc960074a3662fc6759b3a1df3c24f55c69f5039694f620c784105d3fec06939" gracePeriod=120
Sep 10 23:35:49.180142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180108    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="8ee6eb526125ddafae1a74b16514cbb648dbf33dbcf1fa294f14ecc56529d58e" exitCode=0
Sep 10 23:35:49.180142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180133    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="fc960074a3662fc6759b3a1df3c24f55c69f5039694f620c784105d3fec06939" exitCode=0
Sep 10 23:35:49.180142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180139    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="d584e463229778fcb72da35e7a6b09227fb12ae55615c72b57c6f6a99899ce46" exitCode=0
Sep 10 23:35:49.180142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180145    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="d0c5de0fa645e3963bbf7f67356d07c23d26a89dc7b1152f006838bcac4b4ef1" exitCode=0
Sep 10 23:35:49.180493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"8ee6eb526125ddafae1a74b16514cbb648dbf33dbcf1fa294f14ecc56529d58e"}
Sep 10 23:35:49.180493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180237    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"fc960074a3662fc6759b3a1df3c24f55c69f5039694f620c784105d3fec06939"}
Sep 10 23:35:49.180493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"d584e463229778fcb72da35e7a6b09227fb12ae55615c72b57c6f6a99899ce46"}
Sep 10 23:35:49.180493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:49.180287    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"d0c5de0fa645e3963bbf7f67356d07c23d26a89dc7b1152f006838bcac4b4ef1"}
Sep 10 23:35:50.187392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.187361    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="8bbfd23b92a53e29c0299861f8aa611368f9efaf9bd322b35121c9e279619a63" exitCode=0
Sep 10 23:35:50.187392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.187387    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerID="b6066fcd0c72c347ee7703f7bfc80b11e055163caee9601139815430301a915a" exitCode=0
Sep 10 23:35:50.187742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.187421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"8bbfd23b92a53e29c0299861f8aa611368f9efaf9bd322b35121c9e279619a63"}
Sep 10 23:35:50.187742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.187472    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"b6066fcd0c72c347ee7703f7bfc80b11e055163caee9601139815430301a915a"}
Sep 10 23:35:50.222614 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.222594    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:50.315399 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315367    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315590 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmbqw\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315590 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315462    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315590 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315490    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315590 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315517    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315806 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315729    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315870 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315809    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315932 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315884    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315986 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315948    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.315986 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.315974    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.316095 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316028    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.316095 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316054    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.316204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316128    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets\") pod \"0f816a72-24c2-4336-b3ab-d9c6d039c663\" (UID: \"0f816a72-24c2-4336-b3ab-d9c6d039c663\") "
Sep 10 23:35:50.316373 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316339    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:50.316542 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316521    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-main-db\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.316926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.316898    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:50.317340 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.317285    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:50.322420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.322392    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.322420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.322876    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out" (OuterVolumeSpecName: "config-out") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:50.322420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.322935    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.322420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.323056    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.323449 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.323356    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume" (OuterVolumeSpecName: "config-volume") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.323824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.323656    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw" (OuterVolumeSpecName: "kube-api-access-hmbqw") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "kube-api-access-hmbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:50.323824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.323655    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.323824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.323707    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:50.325532 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.325506    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.332483 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.332453    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config" (OuterVolumeSpecName: "web-config") pod "0f816a72-24c2-4336-b3ab-d9c6d039c663" (UID: "0f816a72-24c2-4336-b3ab-d9c6d039c663"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:50.417432 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417408    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-out\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417432 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417430    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-metrics-client-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417444    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-main-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417457    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-cluster-tls-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417468    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-tls-assets\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417480    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417492    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmbqw\" (UniqueName: \"kubernetes.io/projected/0f816a72-24c2-4336-b3ab-d9c6d039c663-kube-api-access-hmbqw\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417505    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-web-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417517    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417531    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417545    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f816a72-24c2-4336-b3ab-d9c6d039c663-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:50.417640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:50.417559    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f816a72-24c2-4336-b3ab-d9c6d039c663-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:51.193788 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.193755    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f816a72-24c2-4336-b3ab-d9c6d039c663","Type":"ContainerDied","Data":"1eedf3e7e2808986a3707c16a5084554e54784eb619e778f9a3a52abe5671ab3"}
Sep 10 23:35:51.194191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.193794    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.194191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.193845    2566 scope.go:117] "RemoveContainer" containerID="8ee6eb526125ddafae1a74b16514cbb648dbf33dbcf1fa294f14ecc56529d58e"
Sep 10 23:35:51.201955 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.201936    2566 scope.go:117] "RemoveContainer" containerID="8bbfd23b92a53e29c0299861f8aa611368f9efaf9bd322b35121c9e279619a63"
Sep 10 23:35:51.208459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.208439    2566 scope.go:117] "RemoveContainer" containerID="fc960074a3662fc6759b3a1df3c24f55c69f5039694f620c784105d3fec06939"
Sep 10 23:35:51.213729 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.213673    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:51.216077 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.216007    2566 scope.go:117] "RemoveContainer" containerID="b6066fcd0c72c347ee7703f7bfc80b11e055163caee9601139815430301a915a"
Sep 10 23:35:51.218098 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.218076    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:51.222690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.222674    2566 scope.go:117] "RemoveContainer" containerID="d584e463229778fcb72da35e7a6b09227fb12ae55615c72b57c6f6a99899ce46"
Sep 10 23:35:51.229158 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.229143    2566 scope.go:117] "RemoveContainer" containerID="d0c5de0fa645e3963bbf7f67356d07c23d26a89dc7b1152f006838bcac4b4ef1"
Sep 10 23:35:51.236066 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.236048    2566 scope.go:117] "RemoveContainer" containerID="6fa94359af9fb3fe63286cf474f64cd1b35a12132bd9c190e2d037cc45533314"
Sep 10 23:35:51.243111 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243094    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:51.243470 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243453    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="prom-label-proxy"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243472    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="prom-label-proxy"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243483    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243489    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243496    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-web"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243501    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-web"
Sep 10 23:35:51.243509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243510    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="alertmanager"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243515    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="alertmanager"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243522    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="config-reloader"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243527    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="config-reloader"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243533    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-metric"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243538    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-metric"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243545    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" containerName="console"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243550    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" containerName="console"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243559    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="init-config-reloader"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243564    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="init-config-reloader"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243610    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1902bd2-f349-46c5-bcf6-5d3de9e8dd74" containerName="console"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243617    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-web"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243623    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="config-reloader"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243629    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="alertmanager"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243635    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy-metric"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243640    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="kube-rbac-proxy"
Sep 10 23:35:51.243681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.243645    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" containerName="prom-label-proxy"
Sep 10 23:35:51.248430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.248412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.250617 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250592    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 23:35:51.250770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250651    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 23:35:51.250770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250658    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 23:35:51.250770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250682    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 23:35:51.250770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250714    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 23:35:51.251031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.250853    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 23:35:51.251031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.251001    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 23:35:51.251031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.251028    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g78sh\""
Sep 10 23:35:51.251287 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.251275    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 23:35:51.256440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.256418    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 23:35:51.264793 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.264774    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:51.324202 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-web-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324374    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324486    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-out\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324501    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324534    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.324663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.324555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9p6c\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-kube-api-access-w9p6c\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425747    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425784    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-out\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.425909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.425847    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426149 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426149 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426149 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9p6c\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-kube-api-access-w9p6c\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426337 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426195    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426337 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-web-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.426337 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426277    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.427174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.426586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.427174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.427017    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.428889 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.428769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-out\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.428989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.428931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.428989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.428941    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429182 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429140    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429263 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429177    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429263 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429231    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2365e82a-2bac-40e8-8aa1-e47f91eda640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429687 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429665    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429764 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.429804 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.429761    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.430884 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.430865    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2365e82a-2bac-40e8-8aa1-e47f91eda640-web-config\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.434190 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.434171    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9p6c\" (UniqueName: \"kubernetes.io/projected/2365e82a-2bac-40e8-8aa1-e47f91eda640-kube-api-access-w9p6c\") pod \"alertmanager-main-0\" (UID: \"2365e82a-2bac-40e8-8aa1-e47f91eda640\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.557674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.557610    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:35:51.838481 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:51.838404    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:35:51.841141 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:35:51.841104    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2365e82a_2bac_40e8_8aa1_e47f91eda640.slice/crio-81862feedfb2a1adc3254d4abae2c1bc263822812ecd35a04ad5f1a2b41707f7 WatchSource:0}: Error finding container 81862feedfb2a1adc3254d4abae2c1bc263822812ecd35a04ad5f1a2b41707f7: Status 404 returned error can't find the container with id 81862feedfb2a1adc3254d4abae2c1bc263822812ecd35a04ad5f1a2b41707f7
Sep 10 23:35:52.200709 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.200673    2566 generic.go:356] "Generic (PLEG): container finished" podID="2365e82a-2bac-40e8-8aa1-e47f91eda640" containerID="a2ca3d772a65a8392f50ffb2ee723b1745344b17c9119cccee929a97df6f4b72" exitCode=0
Sep 10 23:35:52.201131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.200712    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerDied","Data":"a2ca3d772a65a8392f50ffb2ee723b1745344b17c9119cccee929a97df6f4b72"}
Sep 10 23:35:52.201131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.200785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"81862feedfb2a1adc3254d4abae2c1bc263822812ecd35a04ad5f1a2b41707f7"}
Sep 10 23:35:52.431020 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.430970    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f816a72-24c2-4336-b3ab-d9c6d039c663" path="/var/lib/kubelet/pods/0f816a72-24c2-4336-b3ab-d9c6d039c663/volumes"
Sep 10 23:35:52.813879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.813781    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:52.814204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814140    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="prometheus" containerID="cri-o://91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60" gracePeriod=600
Sep 10 23:35:52.814204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814153    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e" gracePeriod=600
Sep 10 23:35:52.814410 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814331    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy" containerID="cri-o://767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4" gracePeriod=600
Sep 10 23:35:52.814469 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814419    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-web" containerID="cri-o://6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695" gracePeriod=600
Sep 10 23:35:52.814519 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814483    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="config-reloader" containerID="cri-o://e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db" gracePeriod=600
Sep 10 23:35:52.814590 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:52.814564    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="thanos-sidecar" containerID="cri-o://27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f" gracePeriod=600
Sep 10 23:35:53.208705 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208672    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"c241850c2a9fcdfd679b935959d0dd2f2f02771f00ba9f6b7936fe05d71bfd9d"}
Sep 10 23:35:53.209135 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208753    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"f616471d2295ea744326cbe2a1ca2d81479ff5f34c32bb6e6eaead5ad4c586e0"}
Sep 10 23:35:53.209135 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208797    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"f1857bd4f84e72b88e8db8660f6dc7bc04df6eda333abf5e8be1be58c4d4f278"}
Sep 10 23:35:53.209135 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208827    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"706746aa89c655e8a323a6bb8ed48f18353cb4d5987e50860652cf43e7df3323"}
Sep 10 23:35:53.209135 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208850    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"d625bc675a70440d7b232de5027b93da57775e2814bf13386fe1e6856e3d3df1"}
Sep 10 23:35:53.209135 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.208919    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2365e82a-2bac-40e8-8aa1-e47f91eda640","Type":"ContainerStarted","Data":"4ae30e2816bf241840e637fe9ba28cf0b329bf0fa7ce056cc7fbb8cf4afe4683"}
Sep 10 23:35:53.212066 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212043    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e" exitCode=0
Sep 10 23:35:53.212066 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212063    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4" exitCode=0
Sep 10 23:35:53.212066 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212070    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f" exitCode=0
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212077    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db" exitCode=0
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212081    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60" exitCode=0
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212102    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"}
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212147    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"}
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212172    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"}
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"}
Sep 10 23:35:53.212231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.212218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"}
Sep 10 23:35:53.237396 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:53.237354    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.221720392 podStartE2EDuration="2.237338181s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.617789ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:35:53.235441782 +0000 UTC m=+139.339728593" watchObservedRunningTime="2026-09-10 23:35:53.237338181 +0000 UTC m=+139.341624975"
Sep 10 23:35:54.054571 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.054546    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.149279 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149254    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149292    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149333    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149374    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149443 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149437    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149462    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149486    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.149911 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149880    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.149988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149907    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.149988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.149971    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.150087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150004    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150036    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150079    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150237 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150108    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150237 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150134    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150237 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150159    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150237 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150192    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150237 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150225    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150255    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150288    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150332    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2lw8\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150357    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle\") pod \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\" (UID: \"6ed6b2cc-318f-4877-93e2-7b894ff8b72c\") "
Sep 10 23:35:54.150639 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150609    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-metrics-client-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.150639 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150627    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.150793 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.150642    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.151134 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.151021    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.151256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.151158    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:54.151684 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.151641    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.152181 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.152150    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.152512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.152474    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.152684 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.152652    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out" (OuterVolumeSpecName: "config-out") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:54.152867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.152838    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:35:54.153766 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.153738    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.154902 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.154868    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:54.155062 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155043    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.155388 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155363    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config" (OuterVolumeSpecName: "config") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.155476 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155403    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8" (OuterVolumeSpecName: "kube-api-access-r2lw8") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "kube-api-access-r2lw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:54.155476 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155434    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.155563 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155508    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.155605 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155571    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.155645 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.155619    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.164459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.164439    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config" (OuterVolumeSpecName: "web-config") pod "6ed6b2cc-318f-4877-93e2-7b894ff8b72c" (UID: "6ed6b2cc-318f-4877-93e2-7b894ff8b72c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:54.219324 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.219281    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerID="6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695" exitCode=0
Sep 10 23:35:54.219611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.219365    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"}
Sep 10 23:35:54.219611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.219376    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.219611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.219451    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed6b2cc-318f-4877-93e2-7b894ff8b72c","Type":"ContainerDied","Data":"83551e6a985dd7663664b48e13c95a8b82e5592016fc9f741893dc181ca061f5"}
Sep 10 23:35:54.219611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.219486    2566 scope.go:117] "RemoveContainer" containerID="92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"
Sep 10 23:35:54.227934 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.227873    2566 scope.go:117] "RemoveContainer" containerID="767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"
Sep 10 23:35:54.234448 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.234430    2566 scope.go:117] "RemoveContainer" containerID="6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"
Sep 10 23:35:54.240575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.240559    2566 scope.go:117] "RemoveContainer" containerID="27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"
Sep 10 23:35:54.245166 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.245140    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:54.247271 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.247255    2566 scope.go:117] "RemoveContainer" containerID="e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"
Sep 10 23:35:54.251223 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251203    2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-grpc-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251226    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251236    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251245    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2lw8\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-kube-api-access-r2lw8\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251258    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251275    2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-metrics-client-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251288    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config-out\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251323    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251337    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251353    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-prometheus-k8s-db\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251365    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-tls-assets\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251379    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-web-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251391    2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251404    2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-kube-rbac-proxy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251417    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251425    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.251743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.251433    2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed6b2cc-318f-4877-93e2-7b894ff8b72c-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:35:54.252412 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.252392    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:54.254231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.254217    2566 scope.go:117] "RemoveContainer" containerID="91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"
Sep 10 23:35:54.261033 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.261019    2566 scope.go:117] "RemoveContainer" containerID="10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74"
Sep 10 23:35:54.267280 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.267260    2566 scope.go:117] "RemoveContainer" containerID="92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"
Sep 10 23:35:54.267582 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.267563    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e\": container with ID starting with 92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e not found: ID does not exist" containerID="92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"
Sep 10 23:35:54.267673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.267586    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e"} err="failed to get container status \"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e\": rpc error: code = NotFound desc = could not find container \"92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e\": container with ID starting with 92630614683a034fb35ed4d9910ea6bdf14e5c09443adfc17c9e80ad9775fa0e not found: ID does not exist"
Sep 10 23:35:54.267673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.267603    2566 scope.go:117] "RemoveContainer" containerID="767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"
Sep 10 23:35:54.267812 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.267790    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4\": container with ID starting with 767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4 not found: ID does not exist" containerID="767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"
Sep 10 23:35:54.267854 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.267831    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4"} err="failed to get container status \"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4\": rpc error: code = NotFound desc = could not find container \"767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4\": container with ID starting with 767ceeb6bccb77e392cacb8eef6f799dcc3ad8ac63bbd6b20c8299fe3930c1f4 not found: ID does not exist"
Sep 10 23:35:54.267854 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.267843    2566 scope.go:117] "RemoveContainer" containerID="6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"
Sep 10 23:35:54.268081 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.268066    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695\": container with ID starting with 6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695 not found: ID does not exist" containerID="6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"
Sep 10 23:35:54.268131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268083    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695"} err="failed to get container status \"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695\": rpc error: code = NotFound desc = could not find container \"6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695\": container with ID starting with 6c1ecc693241ea83159ca6e69ffa057e129e4f6af5d663eb885e98fd5fcc4695 not found: ID does not exist"
Sep 10 23:35:54.268131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268096    2566 scope.go:117] "RemoveContainer" containerID="27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"
Sep 10 23:35:54.268349 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.268332    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f\": container with ID starting with 27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f not found: ID does not exist" containerID="27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"
Sep 10 23:35:54.268442 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268353    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f"} err="failed to get container status \"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f\": rpc error: code = NotFound desc = could not find container \"27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f\": container with ID starting with 27acb4c36ff3dc7f6376d9e145f8c1044e67d7ef784ecedfbd6eb596b67d047f not found: ID does not exist"
Sep 10 23:35:54.268442 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268371    2566 scope.go:117] "RemoveContainer" containerID="e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"
Sep 10 23:35:54.268626 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.268612    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db\": container with ID starting with e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db not found: ID does not exist" containerID="e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"
Sep 10 23:35:54.268680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268632    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db"} err="failed to get container status \"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db\": rpc error: code = NotFound desc = could not find container \"e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db\": container with ID starting with e6ba2e729ae9109a5f9afc0180f5f70d606ce287a833f798afac11f785eba3db not found: ID does not exist"
Sep 10 23:35:54.268680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268650    2566 scope.go:117] "RemoveContainer" containerID="91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"
Sep 10 23:35:54.268888 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.268870    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60\": container with ID starting with 91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60 not found: ID does not exist" containerID="91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"
Sep 10 23:35:54.268926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268894    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60"} err="failed to get container status \"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60\": rpc error: code = NotFound desc = could not find container \"91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60\": container with ID starting with 91f4afccfe3ae134e64d6b96c5281ed5716a1606af583aaed83d20da56dfef60 not found: ID does not exist"
Sep 10 23:35:54.268926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.268909    2566 scope.go:117] "RemoveContainer" containerID="10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74"
Sep 10 23:35:54.269127 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:35:54.269108    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74\": container with ID starting with 10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74 not found: ID does not exist" containerID="10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74"
Sep 10 23:35:54.269191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.269133    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74"} err="failed to get container status \"10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74\": rpc error: code = NotFound desc = could not find container \"10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74\": container with ID starting with 10e601fc2923e990de92b6e6b455ac3a8965ef37565031c355c4d50b3debdf74 not found: ID does not exist"
Sep 10 23:35:54.279240 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279221    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:54.279478 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279467    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="prometheus"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279480    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="prometheus"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279488    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-thanos"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279494    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-thanos"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279504    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="config-reloader"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279509    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="config-reloader"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279516    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="thanos-sidecar"
Sep 10 23:35:54.279522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279521    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="thanos-sidecar"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279531    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="init-config-reloader"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279537    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="init-config-reloader"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279543    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279549    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279555    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-web"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279560    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-web"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279603    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="thanos-sidecar"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279611    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="config-reloader"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279617    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279622    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-web"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279627    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="kube-rbac-proxy-thanos"
Sep 10 23:35:54.279716 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.279634    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" containerName="prometheus"
Sep 10 23:35:54.284206 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.284188    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.287289 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287263    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 23:35:54.287430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287410    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 23:35:54.287496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287473    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 23:35:54.287545 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287503    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 23:35:54.287611 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287579    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 23:35:54.287771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287747    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 23:35:54.287853 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287838    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 23:35:54.287919 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287900    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7solcc62l9qc8\""
Sep 10 23:35:54.287980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.287958    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 23:35:54.288115 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.288087    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 23:35:54.288197 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.288148    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgm52\""
Sep 10 23:35:54.288249 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.288220    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 23:35:54.288249 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.288233    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 23:35:54.288395 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.288377    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 23:35:54.290865 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.290848    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 23:35:54.292520 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.292495    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 23:35:54.302931 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.302911    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:54.427791 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.427711    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed6b2cc-318f-4877-93e2-7b894ff8b72c" path="/var/lib/kubelet/pods/6ed6b2cc-318f-4877-93e2-7b894ff8b72c/volumes"
Sep 10 23:35:54.453092 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453165 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453096    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453165 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453165 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453147    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453272 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453272 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453272 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7cvl\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-kube-api-access-w7cvl\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453404 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453395    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453455    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453531    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453606    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.453663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.453631    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554347    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554382    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554399    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554471    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7cvl\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-kube-api-access-w7cvl\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554760    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.554792 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554787    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554810    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.554989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555008    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555643 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.555809 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.555778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.556114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.556086    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.556197 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.556123    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558001    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558117 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558051    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558117 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558232 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558149    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558794 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558690    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.558898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.558823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.559148 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.559120    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.559389 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.559371    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.559516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.559493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9922bc4-fc5d-4601-9311-2f4dc12580ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.560144 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.560128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.560505 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.560479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9922bc4-fc5d-4601-9311-2f4dc12580ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.560606 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.560591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9922bc4-fc5d-4601-9311-2f4dc12580ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.560662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.560599    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.564291 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.564274    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7cvl\" (UniqueName: \"kubernetes.io/projected/c9922bc4-fc5d-4601-9311-2f4dc12580ed-kube-api-access-w7cvl\") pod \"prometheus-k8s-0\" (UID: \"c9922bc4-fc5d-4601-9311-2f4dc12580ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.595355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.595335    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:35:54.885871 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:54.885834    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 23:35:55.225175 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:55.225138    2566 generic.go:356] "Generic (PLEG): container finished" podID="c9922bc4-fc5d-4601-9311-2f4dc12580ed" containerID="238a3f9181a9e940990190aa3356421adb3016d2f0eae3f4762b7daff16def12" exitCode=0
Sep 10 23:35:55.225543 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:55.225179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerDied","Data":"238a3f9181a9e940990190aa3356421adb3016d2f0eae3f4762b7daff16def12"}
Sep 10 23:35:55.225543 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:55.225241    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"0b5cba0ab2272a1239f8c39de59db8a3e2452f2370fcd85516b6cdc4ad6b1eee"}
Sep 10 23:35:56.232953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.232918    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"81abf94d9bbe3bde3c57b23ef36d2b7873fc59b73e57e73a6d6519c4479493c4"}
Sep 10 23:35:56.233430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.232995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"f6fed06c753a2398187da1d93918298d2f51e61bda73706bb2a28049c05ad569"}
Sep 10 23:35:56.233430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.233038    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"7e7aca0a9aa64def69806b4187c13b1fd6fb86273d1a538fe4265719693bc149"}
Sep 10 23:35:56.233430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.233080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"9c00b595386076a9096537a33ae93d92798dc2c1fca566ff1f81cfe576b44414"}
Sep 10 23:35:56.233430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.233120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"3aea8562c0574ac0e3377adcc92d13afca40159bf4ac21450555ea9f8e890b12"}
Sep 10 23:35:56.233430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.233164    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9922bc4-fc5d-4601-9311-2f4dc12580ed","Type":"ContainerStarted","Data":"f33dfddceeff97ae0b58323546888e5e51244b2b0826d32bb4c5e8de6379bc3f"}
Sep 10 23:35:56.266138 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:56.266087    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.247283615 podStartE2EDuration="2.266070293s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.786678ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:35:56.26354958 +0000 UTC m=+142.367836388" watchObservedRunningTime="2026-09-10 23:35:56.266070293 +0000 UTC m=+142.370357087"
Sep 10 23:35:59.596522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:35:59.596485    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:36:54.596034 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:36:54.596000    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:36:54.611199 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:36:54.611174    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:36:55.463700 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:36:55.463674    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 23:38:25.679843 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.679804    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cncgg"]
Sep 10 23:38:25.683098 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.683080    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.685479 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.685454    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5hbmq\""
Sep 10 23:38:25.685595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.685485    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 23:38:25.686231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.686217    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 23:38:25.690350 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.690204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cncgg"]
Sep 10 23:38:25.740541 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.740516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.740654 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.740544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ll6b\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-kube-api-access-2ll6b\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.841577 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.841535    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.841577 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.841570    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ll6b\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-kube-api-access-2ll6b\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.850061 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.850035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:25.851080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:25.851055    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ll6b\" (UniqueName: \"kubernetes.io/projected/b805622f-21ee-4a48-83a5-ad58da570d8b-kube-api-access-2ll6b\") pod \"cert-manager-55b4d954d5-cncgg\" (UID: \"b805622f-21ee-4a48-83a5-ad58da570d8b\") " pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:26.004435 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.004344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cncgg"
Sep 10 23:38:26.063184 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.063150    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"]
Sep 10 23:38:26.067218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.067198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.072254 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.072233    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s2vtm\""
Sep 10 23:38:26.072355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.072240    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:38:26.072355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.072240    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 23:38:26.077950 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.077905    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"]
Sep 10 23:38:26.143870 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.143830    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p9jb\" (UniqueName: \"kubernetes.io/projected/7f727fd6-2b32-4b79-a074-87184575d6eb-kube-api-access-4p9jb\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.144037 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.143892    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f727fd6-2b32-4b79-a074-87184575d6eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.244262 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.244226    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p9jb\" (UniqueName: \"kubernetes.io/projected/7f727fd6-2b32-4b79-a074-87184575d6eb-kube-api-access-4p9jb\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.244452 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.244290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f727fd6-2b32-4b79-a074-87184575d6eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.244683 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.244661    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f727fd6-2b32-4b79-a074-87184575d6eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.252609 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.252584    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p9jb\" (UniqueName: \"kubernetes.io/projected/7f727fd6-2b32-4b79-a074-87184575d6eb-kube-api-access-4p9jb\") pod \"openshift-lws-operator-fd8ccff4c-tq976\" (UID: \"7f727fd6-2b32-4b79-a074-87184575d6eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.273872 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.273852    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cncgg"]
Sep 10 23:38:26.275755 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:38:26.275729    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb805622f_21ee_4a48_83a5_ad58da570d8b.slice/crio-312917e660728d50e6a6b8f3a53450eba0dd02c2718e6bc2d92a825fb541d2d2 WatchSource:0}: Error finding container 312917e660728d50e6a6b8f3a53450eba0dd02c2718e6bc2d92a825fb541d2d2: Status 404 returned error can't find the container with id 312917e660728d50e6a6b8f3a53450eba0dd02c2718e6bc2d92a825fb541d2d2
Sep 10 23:38:26.378474 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.378447    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"
Sep 10 23:38:26.645410 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.645386    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976"]
Sep 10 23:38:26.647577 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:38:26.647548    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f727fd6_2b32_4b79_a074_87184575d6eb.slice/crio-cf7094af175f80909f0217d3fc6115bebec7ebedacee799f77a4603ed746fc51 WatchSource:0}: Error finding container cf7094af175f80909f0217d3fc6115bebec7ebedacee799f77a4603ed746fc51: Status 404 returned error can't find the container with id cf7094af175f80909f0217d3fc6115bebec7ebedacee799f77a4603ed746fc51
Sep 10 23:38:26.773002 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.772961    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976" event={"ID":"7f727fd6-2b32-4b79-a074-87184575d6eb","Type":"ContainerStarted","Data":"cf7094af175f80909f0217d3fc6115bebec7ebedacee799f77a4603ed746fc51"}
Sep 10 23:38:26.774132 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:26.774113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cncgg" event={"ID":"b805622f-21ee-4a48-83a5-ad58da570d8b","Type":"ContainerStarted","Data":"312917e660728d50e6a6b8f3a53450eba0dd02c2718e6bc2d92a825fb541d2d2"}
Sep 10 23:38:30.794615 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:30.794573    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cncgg" event={"ID":"b805622f-21ee-4a48-83a5-ad58da570d8b","Type":"ContainerStarted","Data":"7ac3a41e1bdf4d088156063827ea7b48aa48c0dee062bce0ebf2fd4d8f371932"}
Sep 10 23:38:30.796387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:30.796354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976" event={"ID":"7f727fd6-2b32-4b79-a074-87184575d6eb","Type":"ContainerStarted","Data":"b833e023de8d38e2024d86b2565d26ce5009cc966fc70348495d7eeafec872dd"}
Sep 10 23:38:30.811019 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:30.810975    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cncgg" podStartSLOduration=1.502620996 podStartE2EDuration="5.810959305s" totalImagesPullingTime="4.308338309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:30.809780017 +0000 UTC m=+296.914066831" watchObservedRunningTime="2026-09-10 23:38:30.810959305 +0000 UTC m=+296.915246098"
Sep 10 23:38:30.825634 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:30.825588    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tq976" podStartSLOduration=0.841491756 podStartE2EDuration="4.825571353s" totalImagesPullingTime="3.984079597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:30.823940144 +0000 UTC m=+296.928226933" watchObservedRunningTime="2026-09-10 23:38:30.825571353 +0000 UTC m=+296.929858146"
Sep 10 23:38:34.319324 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:34.319280    2566 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 23:38:51.684798 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.684764    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"]
Sep 10 23:38:51.693172 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.693155    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.697447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.697428    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 23:38:51.697742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.697723    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 23:38:51.697832 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.697767    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 23:38:51.697832 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.697770    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fds9x\""
Sep 10 23:38:51.698189 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.698173    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 23:38:51.716643 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.716622    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"]
Sep 10 23:38:51.851018 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.850976    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f47sk\" (UniqueName: \"kubernetes.io/projected/0f84faa1-ab22-4346-b437-113436e6177a-kube-api-access-f47sk\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.851173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.851033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.851173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.851050    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.851173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.851070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.851173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.851108    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.951704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.951616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f47sk\" (UniqueName: \"kubernetes.io/projected/0f84faa1-ab22-4346-b437-113436e6177a-kube-api-access-f47sk\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.951704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.951669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.951914 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.951704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.951914 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.951739    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.951914 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.951768    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.952065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.952002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-manifests\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.953904 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.953879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f84faa1-ab22-4346-b437-113436e6177a-tmp\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.954218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.954199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.954287 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.954200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f84faa1-ab22-4346-b437-113436e6177a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:51.960131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:51.960108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f47sk\" (UniqueName: \"kubernetes.io/projected/0f84faa1-ab22-4346-b437-113436e6177a-kube-api-access-f47sk\") pod \"opendatahub-operator-controller-manager-bc8465fcf-5mjj6\" (UID: \"0f84faa1-ab22-4346-b437-113436e6177a\") " pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:52.003998 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:52.003973    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:52.279450 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:52.279423    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"]
Sep 10 23:38:52.280748 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:38:52.280714    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f84faa1_ab22_4346_b437_113436e6177a.slice/crio-4a19d10742a06c300459412ed7ea575a82b75e615fe4d340d74d4f0169543941 WatchSource:0}: Error finding container 4a19d10742a06c300459412ed7ea575a82b75e615fe4d340d74d4f0169543941: Status 404 returned error can't find the container with id 4a19d10742a06c300459412ed7ea575a82b75e615fe4d340d74d4f0169543941
Sep 10 23:38:52.282670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:52.282653    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:38:52.882744 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:52.882702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6" event={"ID":"0f84faa1-ab22-4346-b437-113436e6177a","Type":"ContainerStarted","Data":"4a19d10742a06c300459412ed7ea575a82b75e615fe4d340d74d4f0169543941"}
Sep 10 23:38:55.897940 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:55.897903    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6" event={"ID":"0f84faa1-ab22-4346-b437-113436e6177a","Type":"ContainerStarted","Data":"a60c7e6413775d064bb43ccdfb77bf1b63a5dd19ffc5531cae0ae4a9f7afa56a"}
Sep 10 23:38:56.903910 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:56.903874    2566 generic.go:356] "Generic (PLEG): container finished" podID="0f84faa1-ab22-4346-b437-113436e6177a" containerID="a60c7e6413775d064bb43ccdfb77bf1b63a5dd19ffc5531cae0ae4a9f7afa56a" exitCode=0
Sep 10 23:38:56.904393 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:56.903960    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6" event={"ID":"0f84faa1-ab22-4346-b437-113436e6177a","Type":"ContainerDied","Data":"a60c7e6413775d064bb43ccdfb77bf1b63a5dd19ffc5531cae0ae4a9f7afa56a"}
Sep 10 23:38:57.910357 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:57.910320    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6" event={"ID":"0f84faa1-ab22-4346-b437-113436e6177a","Type":"ContainerStarted","Data":"8126f1313dc6d340317a0814e75a91c83920fa4fae3dcfbaeae5d9b9a9efc403"}
Sep 10 23:38:57.910737 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:57.910437    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:38:57.943203 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:38:57.943151    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6" podStartSLOduration=2.6074554389999998 podStartE2EDuration="6.943132515s" totalImagesPullingTime="3.248452974s" totalInitContainerRuntime="1.087224102s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:57.939999924 +0000 UTC m=+324.044286745" watchObservedRunningTime="2026-09-10 23:38:57.943132515 +0000 UTC m=+324.047419310"
Sep 10 23:39:08.916673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:08.916639    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc8465fcf-5mjj6"
Sep 10 23:39:21.338408 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.338376    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"]
Sep 10 23:39:21.346878 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.346854    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.351256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.351234    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 23:39:21.351819 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.351803    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 23:39:21.352232 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.352213    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xg6xs\""
Sep 10 23:39:21.352350 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.352264    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 23:39:21.352422 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.352397    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 23:39:21.360730 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.360710    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"]
Sep 10 23:39:21.389364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.389343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c93a61-a65c-428c-be64-3da2c527f2a8-tmp\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.389461 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.389395    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c93a61-a65c-428c-be64-3da2c527f2a8-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.389461 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.389412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpf7q\" (UniqueName: \"kubernetes.io/projected/31c93a61-a65c-428c-be64-3da2c527f2a8-kube-api-access-hpf7q\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.490697 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.490672    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c93a61-a65c-428c-be64-3da2c527f2a8-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.490784 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.490701    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpf7q\" (UniqueName: \"kubernetes.io/projected/31c93a61-a65c-428c-be64-3da2c527f2a8-kube-api-access-hpf7q\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.490784 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.490740    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c93a61-a65c-428c-be64-3da2c527f2a8-tmp\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.492991 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.492967    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c93a61-a65c-428c-be64-3da2c527f2a8-tmp\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.493043 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.493027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c93a61-a65c-428c-be64-3da2c527f2a8-tls-certs\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.503468 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.503446    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpf7q\" (UniqueName: \"kubernetes.io/projected/31c93a61-a65c-428c-be64-3da2c527f2a8-kube-api-access-hpf7q\") pod \"kube-auth-proxy-5fb577d9c6-49kn7\" (UID: \"31c93a61-a65c-428c-be64-3da2c527f2a8\") " pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.655652 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.655626    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"
Sep 10 23:39:21.922856 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:21.922832    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7"]
Sep 10 23:39:21.925417 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:39:21.925391    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c93a61_a65c_428c_be64_3da2c527f2a8.slice/crio-5fa5a881fbcb787c4e5eaaa32b24f4cee545a8b64a1fbd660a1bef3521794a4d WatchSource:0}: Error finding container 5fa5a881fbcb787c4e5eaaa32b24f4cee545a8b64a1fbd660a1bef3521794a4d: Status 404 returned error can't find the container with id 5fa5a881fbcb787c4e5eaaa32b24f4cee545a8b64a1fbd660a1bef3521794a4d
Sep 10 23:39:22.010075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:22.010044    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7" event={"ID":"31c93a61-a65c-428c-be64-3da2c527f2a8","Type":"ContainerStarted","Data":"5fa5a881fbcb787c4e5eaaa32b24f4cee545a8b64a1fbd660a1bef3521794a4d"}
Sep 10 23:39:25.024919 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:25.024840    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7" event={"ID":"31c93a61-a65c-428c-be64-3da2c527f2a8","Type":"ContainerStarted","Data":"b45ae892c1d7227bd39bfdb97dee052dbb989cfc81a4d26b9c20a37f02b607a5"}
Sep 10 23:39:25.041805 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:25.041740    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fb577d9c6-49kn7" podStartSLOduration=1.253531476 podStartE2EDuration="4.041720871s" totalImagesPullingTime="2.788189395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:25.041183952 +0000 UTC m=+351.145470754" watchObservedRunningTime="2026-09-10 23:39:25.041720871 +0000 UTC m=+351.146007666"
Sep 10 23:39:28.905569 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.905486    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"]
Sep 10 23:39:28.985651 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.985620    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"]
Sep 10 23:39:28.985806 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.985712    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:28.989201 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.989178    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 23:39:28.989314 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.989183    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 23:39:28.989843 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.989825    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:39:28.989930 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.989896    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qfs4f\""
Sep 10 23:39:28.990356 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:28.990340    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 23:39:29.054821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.054797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.054959 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.054839    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.054959 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.054912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kwxg\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-kube-api-access-6kwxg\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.055068 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.054990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.055068 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.055020    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.055174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.055069    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.055174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.055098    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287e5d87-77ca-4752-b57b-7b91c8c79583-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156724 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156646    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kwxg\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-kube-api-access-6kwxg\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156724 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156700    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156784    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156811    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287e5d87-77ca-4752-b57b-7b91c8c79583-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.156943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.156892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.157761 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.157735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.159484 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.159453    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.159671 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.159652    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287e5d87-77ca-4752-b57b-7b91c8c79583-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.159746 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.159671    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.159746 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.159719    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287e5d87-77ca-4752-b57b-7b91c8c79583-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.165723 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.165699    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.166871 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.166843    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kwxg\" (UniqueName: \"kubernetes.io/projected/287e5d87-77ca-4752-b57b-7b91c8c79583-kube-api-access-6kwxg\") pod \"istiod-openshift-gateway-5677ccb49b-nfgtk\" (UID: \"287e5d87-77ca-4752-b57b-7b91c8c79583\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.295358 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.295324    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:29.626007 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:29.625911    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"]
Sep 10 23:39:29.628141 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:39:29.628101    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287e5d87_77ca_4752_b57b_7b91c8c79583.slice/crio-673ef484547864e4b6872a8c5b0240a4d0c7317b238f3c66810abfe4f2db4879 WatchSource:0}: Error finding container 673ef484547864e4b6872a8c5b0240a4d0c7317b238f3c66810abfe4f2db4879: Status 404 returned error can't find the container with id 673ef484547864e4b6872a8c5b0240a4d0c7317b238f3c66810abfe4f2db4879
Sep 10 23:39:30.047952 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:30.047922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk" event={"ID":"287e5d87-77ca-4752-b57b-7b91c8c79583","Type":"ContainerStarted","Data":"673ef484547864e4b6872a8c5b0240a4d0c7317b238f3c66810abfe4f2db4879"}
Sep 10 23:39:32.074158 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:32.074122    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 23:39:32.074424 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:32.074194    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 23:39:33.062668 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:33.062633    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk" event={"ID":"287e5d87-77ca-4752-b57b-7b91c8c79583","Type":"ContainerStarted","Data":"c883245df5048b1e514353502e074c811b18607b1d4170e1786a65731db35fce"}
Sep 10 23:39:33.062847 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:33.062814    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:33.064355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:33.064334    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk"
Sep 10 23:39:33.105271 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:39:33.105219    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfgtk" podStartSLOduration=2.661724603 podStartE2EDuration="5.105203348s" totalImagesPullingTime="2.443478745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:33.102544431 +0000 UTC m=+359.206831264" watchObservedRunningTime="2026-09-10 23:39:33.105203348 +0000 UTC m=+359.209490141"
Sep 10 23:40:39.265628 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.265590    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pf2ds"]
Sep 10 23:40:39.268814 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.268797    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:39.271384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.271354    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 23:40:39.271384 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.271379    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 23:40:39.271594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.271466    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-txthm\""
Sep 10 23:40:39.280667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.280644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pf2ds"]
Sep 10 23:40:39.345065 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.345027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvkpm\" (UniqueName: \"kubernetes.io/projected/7eb9ede8-1b94-4cec-b2b5-63335be78eac-kube-api-access-tvkpm\") pod \"authorino-operator-76b478bd78-pf2ds\" (UID: \"7eb9ede8-1b94-4cec-b2b5-63335be78eac\") " pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:39.445791 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.445762    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkpm\" (UniqueName: \"kubernetes.io/projected/7eb9ede8-1b94-4cec-b2b5-63335be78eac-kube-api-access-tvkpm\") pod \"authorino-operator-76b478bd78-pf2ds\" (UID: \"7eb9ede8-1b94-4cec-b2b5-63335be78eac\") " pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:39.456456 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.456433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvkpm\" (UniqueName: \"kubernetes.io/projected/7eb9ede8-1b94-4cec-b2b5-63335be78eac-kube-api-access-tvkpm\") pod \"authorino-operator-76b478bd78-pf2ds\" (UID: \"7eb9ede8-1b94-4cec-b2b5-63335be78eac\") " pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:39.578834 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.578749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:39.853641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:39.853525    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pf2ds"]
Sep 10 23:40:39.856434 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:40:39.856404    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb9ede8_1b94_4cec_b2b5_63335be78eac.slice/crio-a86a595431ce8038b96cb001b30ada99928956109d603bbe3093f36f597cec80 WatchSource:0}: Error finding container a86a595431ce8038b96cb001b30ada99928956109d603bbe3093f36f597cec80: Status 404 returned error can't find the container with id a86a595431ce8038b96cb001b30ada99928956109d603bbe3093f36f597cec80
Sep 10 23:40:40.343904 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:40.343870    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds" event={"ID":"7eb9ede8-1b94-4cec-b2b5-63335be78eac","Type":"ContainerStarted","Data":"a86a595431ce8038b96cb001b30ada99928956109d603bbe3093f36f597cec80"}
Sep 10 23:40:41.480332 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.480276    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"]
Sep 10 23:40:41.488798 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.488771    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:41.491886 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.491861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 23:40:41.492026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.491893    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8gcc8\""
Sep 10 23:40:41.492876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.492852    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"]
Sep 10 23:40:41.670969 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.670911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvctl\" (UniqueName: \"kubernetes.io/projected/404943aa-8fd9-4319-ad0c-5941d5bb2227-kube-api-access-xvctl\") pod \"dns-operator-controller-manager-7b84cd7c9c-s7pbp\" (UID: \"404943aa-8fd9-4319-ad0c-5941d5bb2227\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:41.772380 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.772276    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvctl\" (UniqueName: \"kubernetes.io/projected/404943aa-8fd9-4319-ad0c-5941d5bb2227-kube-api-access-xvctl\") pod \"dns-operator-controller-manager-7b84cd7c9c-s7pbp\" (UID: \"404943aa-8fd9-4319-ad0c-5941d5bb2227\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:41.781541 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.781513    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvctl\" (UniqueName: \"kubernetes.io/projected/404943aa-8fd9-4319-ad0c-5941d5bb2227-kube-api-access-xvctl\") pod \"dns-operator-controller-manager-7b84cd7c9c-s7pbp\" (UID: \"404943aa-8fd9-4319-ad0c-5941d5bb2227\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:41.803416 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:41.803388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:42.533654 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:42.533531    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"]
Sep 10 23:40:42.535990 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:40:42.535964    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404943aa_8fd9_4319_ad0c_5941d5bb2227.slice/crio-be0a0f673a1132c987489be46abfd70dce5057b74cdaa18330946014a717dafc WatchSource:0}: Error finding container be0a0f673a1132c987489be46abfd70dce5057b74cdaa18330946014a717dafc: Status 404 returned error can't find the container with id be0a0f673a1132c987489be46abfd70dce5057b74cdaa18330946014a717dafc
Sep 10 23:40:43.362059 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:43.362025    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds" event={"ID":"7eb9ede8-1b94-4cec-b2b5-63335be78eac","Type":"ContainerStarted","Data":"5e3d2d3d0e64e1c35319f7c0c05cc6c741efbc41cb619ee5a1f40b2fe284c97e"}
Sep 10 23:40:43.362385 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:43.362359    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:43.363983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:43.363950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp" event={"ID":"404943aa-8fd9-4319-ad0c-5941d5bb2227","Type":"ContainerStarted","Data":"be0a0f673a1132c987489be46abfd70dce5057b74cdaa18330946014a717dafc"}
Sep 10 23:40:43.400276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:43.400219    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds" podStartSLOduration=1.922891361 podStartE2EDuration="4.400201308s" totalImagesPullingTime="2.477309947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:43.396897663 +0000 UTC m=+429.501184479" watchObservedRunningTime="2026-09-10 23:40:43.400201308 +0000 UTC m=+429.504488101"
Sep 10 23:40:44.370261 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:44.370221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp" event={"ID":"404943aa-8fd9-4319-ad0c-5941d5bb2227","Type":"ContainerStarted","Data":"72d9da3c221b8c198f862fadc3cd56e93dfd5e8fff867b040b4f040cc618d6e0"}
Sep 10 23:40:44.370651 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:44.370523    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:40:44.395234 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:44.395186    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp" podStartSLOduration=1.717708312 podStartE2EDuration="3.395170321s" totalImagesPullingTime="1.677462009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:44.393490815 +0000 UTC m=+430.497777626" watchObservedRunningTime="2026-09-10 23:40:44.395170321 +0000 UTC m=+430.499457249"
Sep 10 23:40:45.687594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.687555    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"]
Sep 10 23:40:45.691273 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.691251    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.693702 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.693679    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8v52d\""
Sep 10 23:40:45.702454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.702433    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"]
Sep 10 23:40:45.805897 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.805870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvbt\" (UniqueName: \"kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.806028 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.805924    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.907106 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.907072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.907236 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.907166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djvbt\" (UniqueName: \"kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.907510 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.907491    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:45.916539 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:45.916516    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvbt\" (UniqueName: \"kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:46.001649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:46.001579    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:46.277580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:46.277556    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"]
Sep 10 23:40:46.279902 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:40:46.279871    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa740d3_eb28_480d_b869_b70dbda78e10.slice/crio-b009f806fe54c875aa2993dc7aff5aece67d4be17446f7af064880e2f5a863d3 WatchSource:0}: Error finding container b009f806fe54c875aa2993dc7aff5aece67d4be17446f7af064880e2f5a863d3: Status 404 returned error can't find the container with id b009f806fe54c875aa2993dc7aff5aece67d4be17446f7af064880e2f5a863d3
Sep 10 23:40:46.380204 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:46.380171    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz" event={"ID":"baa740d3-eb28-480d-b869-b70dbda78e10","Type":"ContainerStarted","Data":"b009f806fe54c875aa2993dc7aff5aece67d4be17446f7af064880e2f5a863d3"}
Sep 10 23:40:47.810114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:47.810076    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"]
Sep 10 23:40:47.815453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:47.814162    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:47.818179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:47.817075    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h7rxt\""
Sep 10 23:40:47.824846 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:47.824823    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"]
Sep 10 23:40:47.927622 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:47.927576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4jc\" (UniqueName: \"kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc\") pod \"limitador-operator-controller-manager-74495c69f8-566zj\" (UID: \"a257e79d-1323-4c3b-bc11-84f1cb693280\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:48.029009 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:48.028964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4jc\" (UniqueName: \"kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc\") pod \"limitador-operator-controller-manager-74495c69f8-566zj\" (UID: \"a257e79d-1323-4c3b-bc11-84f1cb693280\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:48.052563 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:48.052530    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4jc\" (UniqueName: \"kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc\") pod \"limitador-operator-controller-manager-74495c69f8-566zj\" (UID: \"a257e79d-1323-4c3b-bc11-84f1cb693280\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:48.129633 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:48.129482    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:48.413422 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:48.413396    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"]
Sep 10 23:40:48.416783 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:40:48.416751    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda257e79d_1323_4c3b_bc11_84f1cb693280.slice/crio-3aebff6f1cbbb2d95c0b0218d46ddc96298fb58e3c4d3d526e11bfcb29fe216e WatchSource:0}: Error finding container 3aebff6f1cbbb2d95c0b0218d46ddc96298fb58e3c4d3d526e11bfcb29fe216e: Status 404 returned error can't find the container with id 3aebff6f1cbbb2d95c0b0218d46ddc96298fb58e3c4d3d526e11bfcb29fe216e
Sep 10 23:40:49.404640 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:49.404591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj" event={"ID":"a257e79d-1323-4c3b-bc11-84f1cb693280","Type":"ContainerStarted","Data":"3aebff6f1cbbb2d95c0b0218d46ddc96298fb58e3c4d3d526e11bfcb29fe216e"}
Sep 10 23:40:50.411738 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:50.411697    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz" event={"ID":"baa740d3-eb28-480d-b869-b70dbda78e10","Type":"ContainerStarted","Data":"3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f"}
Sep 10 23:40:50.412105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:50.411796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:40:50.434616 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:50.434564    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz" podStartSLOduration=1.749770222 podStartE2EDuration="5.434548329s" totalImagesPullingTime="3.684778107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:50.43235528 +0000 UTC m=+436.536642096" watchObservedRunningTime="2026-09-10 23:40:50.434548329 +0000 UTC m=+436.538835122"
Sep 10 23:40:51.417766 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:51.417729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj" event={"ID":"a257e79d-1323-4c3b-bc11-84f1cb693280","Type":"ContainerStarted","Data":"85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765"}
Sep 10 23:40:51.418235 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:51.417820    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:40:51.436798 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:51.436748    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj" podStartSLOduration=1.9085981159999998 podStartE2EDuration="4.436733644s" totalImagesPullingTime="2.528135528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:51.434142595 +0000 UTC m=+437.538429388" watchObservedRunningTime="2026-09-10 23:40:51.436733644 +0000 UTC m=+437.541020439"
Sep 10 23:40:54.372955 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:54.372921    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-pf2ds"
Sep 10 23:40:55.376840 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:40:55.376814    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-s7pbp"
Sep 10 23:41:01.420495 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:01.420415    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:02.429563 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:02.429534    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.487146 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.487112    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"]
Sep 10 23:41:03.487597 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.487344    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" containerName="manager" containerID="cri-o://3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f" gracePeriod=2
Sep 10 23:41:03.498658 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.498627    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"]
Sep 10 23:41:03.505790 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.505743    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"baa740d3-eb28-480d-b869-b70dbda78e10\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\": pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.513959 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.513931    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:03.514341 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.514320    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" containerName="manager"
Sep 10 23:41:03.514341 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.514338    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" containerName="manager"
Sep 10 23:41:03.514484 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.514420    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" containerName="manager"
Sep 10 23:41:03.517661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.517636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.518588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.518566    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"]
Sep 10 23:41:03.518764 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.518743    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" containerName="manager" containerID="cri-o://85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765" gracePeriod=2
Sep 10 23:41:03.519710 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.519672    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.550169 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.550137    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:03.564151 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.564114    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.564305 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.564185    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjpn\" (UniqueName: \"kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.570016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.569985    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"]
Sep 10 23:41:03.572957 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.572915    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.573783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.573759    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"]
Sep 10 23:41:03.574254 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.574238    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" containerName="manager"
Sep 10 23:41:03.574331 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.574258    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" containerName="manager"
Sep 10 23:41:03.574381 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.574373    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" containerName="manager"
Sep 10 23:41:03.574857 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.574823    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-566zj\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.577562 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.577543    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:03.579467 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.579444    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.595113 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.595074    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"]
Sep 10 23:41:03.608890 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.608844    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-566zj\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.665580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.665541    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.665580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.665595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjpn\" (UniqueName: \"kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.665837 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.665629    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6b6\" (UniqueName: \"kubernetes.io/projected/0f0d01c7-7b88-460c-ae8d-efde59ca589d-kube-api-access-9x6b6\") pod \"limitador-operator-controller-manager-74495c69f8-szt28\" (UID: \"0f0d01c7-7b88-460c-ae8d-efde59ca589d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:03.666026 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.665987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.677282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.677248    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjpn\" (UniqueName: \"kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hqdbz\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.755880 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.755856    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.757997 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.757968    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.758731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.758715    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.759686 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.759665    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-566zj\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.761435 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.761409    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:03.762900 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:03.762882    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-566zj\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:03.766344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.766321    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6b6\" (UniqueName: \"kubernetes.io/projected/0f0d01c7-7b88-460c-ae8d-efde59ca589d-kube-api-access-9x6b6\") pod \"limitador-operator-controller-manager-74495c69f8-szt28\" (UID: \"0f0d01c7-7b88-460c-ae8d-efde59ca589d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:03.774674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.774646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6b6\" (UniqueName: \"kubernetes.io/projected/0f0d01c7-7b88-460c-ae8d-efde59ca589d-kube-api-access-9x6b6\") pod \"limitador-operator-controller-manager-74495c69f8-szt28\" (UID: \"0f0d01c7-7b88-460c-ae8d-efde59ca589d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:03.867330 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.867291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume\") pod \"baa740d3-eb28-480d-b869-b70dbda78e10\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") "
Sep 10 23:41:03.867499 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.867354    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4jc\" (UniqueName: \"kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc\") pod \"a257e79d-1323-4c3b-bc11-84f1cb693280\" (UID: \"a257e79d-1323-4c3b-bc11-84f1cb693280\") "
Sep 10 23:41:03.867499 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.867378    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djvbt\" (UniqueName: \"kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt\") pod \"baa740d3-eb28-480d-b869-b70dbda78e10\" (UID: \"baa740d3-eb28-480d-b869-b70dbda78e10\") "
Sep 10 23:41:03.867810 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.867786    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "baa740d3-eb28-480d-b869-b70dbda78e10" (UID: "baa740d3-eb28-480d-b869-b70dbda78e10"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:03.869630 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.869605    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt" (OuterVolumeSpecName: "kube-api-access-djvbt") pod "baa740d3-eb28-480d-b869-b70dbda78e10" (UID: "baa740d3-eb28-480d-b869-b70dbda78e10"). InnerVolumeSpecName "kube-api-access-djvbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:03.869630 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.869620    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc" (OuterVolumeSpecName: "kube-api-access-8g4jc") pod "a257e79d-1323-4c3b-bc11-84f1cb693280" (UID: "a257e79d-1323-4c3b-bc11-84f1cb693280"). InnerVolumeSpecName "kube-api-access-8g4jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:03.910267 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.910230    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:03.917392 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.917370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:03.970245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.970203    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baa740d3-eb28-480d-b869-b70dbda78e10-extensions-socket-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:41:03.970245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.970243    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4jc\" (UniqueName: \"kubernetes.io/projected/a257e79d-1323-4c3b-bc11-84f1cb693280-kube-api-access-8g4jc\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:41:03.970472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:03.970256    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djvbt\" (UniqueName: \"kubernetes.io/projected/baa740d3-eb28-480d-b869-b70dbda78e10-kube-api-access-djvbt\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:41:04.217368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.217327    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"]
Sep 10 23:41:04.220433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.220407    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:04.230472 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:41:04.230441    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0d01c7_7b88_460c_ae8d_efde59ca589d.slice/crio-d8ec4e88cbd3d822f87ea80377215802bcfc1608288affe3a5e7c207b15cd7d2 WatchSource:0}: Error finding container d8ec4e88cbd3d822f87ea80377215802bcfc1608288affe3a5e7c207b15cd7d2: Status 404 returned error can't find the container with id d8ec4e88cbd3d822f87ea80377215802bcfc1608288affe3a5e7c207b15cd7d2
Sep 10 23:41:04.231214 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:41:04.231188    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049d927c_3300_4b48_a802_24c3cfdab3e7.slice/crio-22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc WatchSource:0}: Error finding container 22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc: Status 404 returned error can't find the container with id 22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc
Sep 10 23:41:04.427754 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:04.427708    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cpdrz\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:04.429480 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:04.429453    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-566zj\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:04.429575 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.429531    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a257e79d-1323-4c3b-bc11-84f1cb693280" path="/var/lib/kubelet/pods/a257e79d-1323-4c3b-bc11-84f1cb693280/volumes"
Sep 10 23:41:04.429931 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.429917    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa740d3-eb28-480d-b869-b70dbda78e10" path="/var/lib/kubelet/pods/baa740d3-eb28-480d-b869-b70dbda78e10/volumes"
Sep 10 23:41:04.480375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.480334    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" event={"ID":"049d927c-3300-4b48-a802-24c3cfdab3e7","Type":"ContainerStarted","Data":"ef230a7c5b3ad7b4bffb5d9d4a60f780f8f0224ea46c1adccc584f74a9923a55"}
Sep 10 23:41:04.480835 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.480401    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" event={"ID":"049d927c-3300-4b48-a802-24c3cfdab3e7","Type":"ContainerStarted","Data":"22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc"}
Sep 10 23:41:04.480835 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.480431    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:04.481738 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.481712    2566 generic.go:356] "Generic (PLEG): container finished" podID="baa740d3-eb28-480d-b869-b70dbda78e10" containerID="3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f" exitCode=0
Sep 10 23:41:04.481868 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.481746    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cpdrz"
Sep 10 23:41:04.481868 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.481802    2566 scope.go:117] "RemoveContainer" containerID="3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f"
Sep 10 23:41:04.483134 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.483109    2566 generic.go:356] "Generic (PLEG): container finished" podID="a257e79d-1323-4c3b-bc11-84f1cb693280" containerID="85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765" exitCode=0
Sep 10 23:41:04.483233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.483153    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-566zj"
Sep 10 23:41:04.485553 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.485429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28" event={"ID":"0f0d01c7-7b88-460c-ae8d-efde59ca589d","Type":"ContainerStarted","Data":"96660b55f3abb3355da86334302c8f989527feec240b3e113dc786cb070cd106"}
Sep 10 23:41:04.485553 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.485476    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28" event={"ID":"0f0d01c7-7b88-460c-ae8d-efde59ca589d","Type":"ContainerStarted","Data":"d8ec4e88cbd3d822f87ea80377215802bcfc1608288affe3a5e7c207b15cd7d2"}
Sep 10 23:41:04.485553 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.485512    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:04.490739 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.490530    2566 scope.go:117] "RemoveContainer" containerID="3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f"
Sep 10 23:41:04.490966 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:04.490838    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f\": container with ID starting with 3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f not found: ID does not exist" containerID="3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f"
Sep 10 23:41:04.490966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.490865    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f"} err="failed to get container status \"3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f\": rpc error: code = NotFound desc = could not find container \"3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f\": container with ID starting with 3d966ab39a12a2171958dd41a7c2185ea0e1292d7b31a6c77ff90583eb2fb36f not found: ID does not exist"
Sep 10 23:41:04.490966 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.490887    2566 scope.go:117] "RemoveContainer" containerID="85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765"
Sep 10 23:41:04.498594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.498577    2566 scope.go:117] "RemoveContainer" containerID="85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765"
Sep 10 23:41:04.498860 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:41:04.498843    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765\": container with ID starting with 85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765 not found: ID does not exist" containerID="85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765"
Sep 10 23:41:04.498903 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.498868    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765"} err="failed to get container status \"85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765\": rpc error: code = NotFound desc = could not find container \"85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765\": container with ID starting with 85a0112f830466c4f29551bbe780cd2f0b81f9b5bf725fdafd3699303dcc7765 not found: ID does not exist"
Sep 10 23:41:04.503259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.503213    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" podStartSLOduration=1.503197738 podStartE2EDuration="1.503197738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:04.502337829 +0000 UTC m=+450.606624645" watchObservedRunningTime="2026-09-10 23:41:04.503197738 +0000 UTC m=+450.607484532"
Sep 10 23:41:04.521051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:04.521002    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28" podStartSLOduration=1.5209833339999999 podStartE2EDuration="1.520983334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:04.51995025 +0000 UTC m=+450.624237045" watchObservedRunningTime="2026-09-10 23:41:04.520983334 +0000 UTC m=+450.625270127"
Sep 10 23:41:15.501141 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:15.501106    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:15.501616 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:15.501214    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-szt28"
Sep 10 23:41:19.335493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.335458    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:19.335970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.335702    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" podUID="049d927c-3300-4b48-a802-24c3cfdab3e7" containerName="manager" containerID="cri-o://ef230a7c5b3ad7b4bffb5d9d4a60f780f8f0224ea46c1adccc584f74a9923a55" gracePeriod=10
Sep 10 23:41:19.572992 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.572961    2566 generic.go:356] "Generic (PLEG): container finished" podID="049d927c-3300-4b48-a802-24c3cfdab3e7" containerID="ef230a7c5b3ad7b4bffb5d9d4a60f780f8f0224ea46c1adccc584f74a9923a55" exitCode=0
Sep 10 23:41:19.573139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.573042    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" event={"ID":"049d927c-3300-4b48-a802-24c3cfdab3e7","Type":"ContainerDied","Data":"ef230a7c5b3ad7b4bffb5d9d4a60f780f8f0224ea46c1adccc584f74a9923a55"}
Sep 10 23:41:19.573139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.573093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz" event={"ID":"049d927c-3300-4b48-a802-24c3cfdab3e7","Type":"ContainerDied","Data":"22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc"}
Sep 10 23:41:19.573139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.573114    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22f1f67b070402ef4ffb361157a9008b3e813e0722598b205e7e992fd7874afc"
Sep 10 23:41:19.577943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.577922    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:19.630953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.630871    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 10 23:41:19.631282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.631265    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049d927c-3300-4b48-a802-24c3cfdab3e7" containerName="manager"
Sep 10 23:41:19.631385 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.631286    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="049d927c-3300-4b48-a802-24c3cfdab3e7" containerName="manager"
Sep 10 23:41:19.631442 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.631388    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="049d927c-3300-4b48-a802-24c3cfdab3e7" containerName="manager"
Sep 10 23:41:19.634677 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.634647    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.652722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.652700    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 10 23:41:19.706816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.706783    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rjpn\" (UniqueName: \"kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn\") pod \"049d927c-3300-4b48-a802-24c3cfdab3e7\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") "
Sep 10 23:41:19.706984 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.706886    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume\") pod \"049d927c-3300-4b48-a802-24c3cfdab3e7\" (UID: \"049d927c-3300-4b48-a802-24c3cfdab3e7\") "
Sep 10 23:41:19.707057 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.707036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.707201 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.707173    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfd5j\" (UniqueName: \"kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.707338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.707218    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "049d927c-3300-4b48-a802-24c3cfdab3e7" (UID: "049d927c-3300-4b48-a802-24c3cfdab3e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:19.707393 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.707337    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049d927c-3300-4b48-a802-24c3cfdab3e7-extensions-socket-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:41:19.708833 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.708805    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn" (OuterVolumeSpecName: "kube-api-access-9rjpn") pod "049d927c-3300-4b48-a802-24c3cfdab3e7" (UID: "049d927c-3300-4b48-a802-24c3cfdab3e7"). InnerVolumeSpecName "kube-api-access-9rjpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:19.808678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.808641    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfd5j\" (UniqueName: \"kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.808854 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.808699    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.808854 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.808733    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rjpn\" (UniqueName: \"kubernetes.io/projected/049d927c-3300-4b48-a802-24c3cfdab3e7-kube-api-access-9rjpn\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:41:19.809050 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.809033    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.816938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.816904    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfd5j\" (UniqueName: \"kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nv9ls\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:19.946374 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:19.946332    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:20.218664 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.218642    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 10 23:41:20.220967 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:41:20.220931    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5004613e_9b18_4f52_8580_0ad8b1b45be1.slice/crio-f5c9ae838e5295835d56f62d4a0edfdb6a9aa411a243e390c852fbb53374e274 WatchSource:0}: Error finding container f5c9ae838e5295835d56f62d4a0edfdb6a9aa411a243e390c852fbb53374e274: Status 404 returned error can't find the container with id f5c9ae838e5295835d56f62d4a0edfdb6a9aa411a243e390c852fbb53374e274
Sep 10 23:41:20.580387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.580284    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" event={"ID":"5004613e-9b18-4f52-8580-0ad8b1b45be1","Type":"ContainerStarted","Data":"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"}
Sep 10 23:41:20.580387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.580360    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" event={"ID":"5004613e-9b18-4f52-8580-0ad8b1b45be1","Type":"ContainerStarted","Data":"f5c9ae838e5295835d56f62d4a0edfdb6a9aa411a243e390c852fbb53374e274"}
Sep 10 23:41:20.580753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.580477    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:20.580753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.580524    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"
Sep 10 23:41:20.599947 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.599896    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" podStartSLOduration=1.5998801889999998 podStartE2EDuration="1.599880189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:20.598332362 +0000 UTC m=+466.702619156" watchObservedRunningTime="2026-09-10 23:41:20.599880189 +0000 UTC m=+466.704166982"
Sep 10 23:41:20.609438 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.609409    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:20.616755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:20.614033    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hqdbz"]
Sep 10 23:41:22.429336 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:22.429282    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049d927c-3300-4b48-a802-24c3cfdab3e7" path="/var/lib/kubelet/pods/049d927c-3300-4b48-a802-24c3cfdab3e7/volumes"
Sep 10 23:41:31.587342 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:31.587285    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 10 23:41:48.627359 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.627330    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:41:48.632096 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.632075    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.634662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.634645    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rk876\""
Sep 10 23:41:48.634829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.634810    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 23:41:48.640162 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.640137    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:41:48.724974 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.724942    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:41:48.765044 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.765013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.765214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.765057    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7959q\" (UniqueName: \"kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.866526 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.866488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.866699 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.866542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7959q\" (UniqueName: \"kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.867196 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.867176    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.874286 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.874256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7959q\" (UniqueName: \"kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q\") pod \"limitador-limitador-8588749977-ghj78\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") " pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:48.943389 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:48.943357    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:49.213225 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:49.213199    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:41:49.215805 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:41:49.215776    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a6bbc3_592b_4f61_8041_c206b4bbff02.slice/crio-07de7e94080c03dba8d52f5af9e4336b80c2e4b35b3f60069c0b9063bea42705 WatchSource:0}: Error finding container 07de7e94080c03dba8d52f5af9e4336b80c2e4b35b3f60069c0b9063bea42705: Status 404 returned error can't find the container with id 07de7e94080c03dba8d52f5af9e4336b80c2e4b35b3f60069c0b9063bea42705
Sep 10 23:41:49.718599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:49.718565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" event={"ID":"23a6bbc3-592b-4f61-8041-c206b4bbff02","Type":"ContainerStarted","Data":"07de7e94080c03dba8d52f5af9e4336b80c2e4b35b3f60069c0b9063bea42705"}
Sep 10 23:41:50.725449 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:50.725352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" event={"ID":"23a6bbc3-592b-4f61-8041-c206b4bbff02","Type":"ContainerStarted","Data":"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"}
Sep 10 23:41:50.725449 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:50.725436    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:41:50.741171 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:41:50.741109    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" podStartSLOduration=1.523168279 podStartE2EDuration="2.74108913s" totalImagesPullingTime="1.217920851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:50.740285025 +0000 UTC m=+496.844571843" watchObservedRunningTime="2026-09-10 23:41:50.74108913 +0000 UTC m=+496.845375925"
Sep 10 23:42:01.736078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:01.736048    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:42:03.757944 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:03.757907    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:42:03.758421 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:03.758102    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" podUID="23a6bbc3-592b-4f61-8041-c206b4bbff02" containerName="limitador" containerID="cri-o://0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e" gracePeriod=30
Sep 10 23:42:04.295074 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.295051    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:42:04.395194 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.395169    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file\") pod \"23a6bbc3-592b-4f61-8041-c206b4bbff02\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") "
Sep 10 23:42:04.395353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.395291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7959q\" (UniqueName: \"kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q\") pod \"23a6bbc3-592b-4f61-8041-c206b4bbff02\" (UID: \"23a6bbc3-592b-4f61-8041-c206b4bbff02\") "
Sep 10 23:42:04.395550 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.395528    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file" (OuterVolumeSpecName: "config-file") pod "23a6bbc3-592b-4f61-8041-c206b4bbff02" (UID: "23a6bbc3-592b-4f61-8041-c206b4bbff02"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:42:04.397349 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.397323    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q" (OuterVolumeSpecName: "kube-api-access-7959q") pod "23a6bbc3-592b-4f61-8041-c206b4bbff02" (UID: "23a6bbc3-592b-4f61-8041-c206b4bbff02"). InnerVolumeSpecName "kube-api-access-7959q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:04.496755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.496730    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7959q\" (UniqueName: \"kubernetes.io/projected/23a6bbc3-592b-4f61-8041-c206b4bbff02-kube-api-access-7959q\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:42:04.496755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.496753    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a6bbc3-592b-4f61-8041-c206b4bbff02-config-file\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:42:04.795330 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.795212    2566 generic.go:356] "Generic (PLEG): container finished" podID="23a6bbc3-592b-4f61-8041-c206b4bbff02" containerID="0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e" exitCode=0
Sep 10 23:42:04.795330 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.795260    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-ghj78"
Sep 10 23:42:04.795330 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.795292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" event={"ID":"23a6bbc3-592b-4f61-8041-c206b4bbff02","Type":"ContainerDied","Data":"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"}
Sep 10 23:42:04.795825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.795364    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-ghj78" event={"ID":"23a6bbc3-592b-4f61-8041-c206b4bbff02","Type":"ContainerDied","Data":"07de7e94080c03dba8d52f5af9e4336b80c2e4b35b3f60069c0b9063bea42705"}
Sep 10 23:42:04.795825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.795389    2566 scope.go:117] "RemoveContainer" containerID="0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"
Sep 10 23:42:04.803947 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.803927    2566 scope.go:117] "RemoveContainer" containerID="0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"
Sep 10 23:42:04.804228 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:42:04.804202    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e\": container with ID starting with 0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e not found: ID does not exist" containerID="0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"
Sep 10 23:42:04.804344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.804233    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e"} err="failed to get container status \"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e\": rpc error: code = NotFound desc = could not find container \"0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e\": container with ID starting with 0ea7a151541029b457fb69cc5477b19366ac07fb9ae21fc51373ac252143558e not found: ID does not exist"
Sep 10 23:42:04.810338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.810313    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:42:04.812376 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:04.812355    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-ghj78"]
Sep 10 23:42:06.432670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:06.432640    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a6bbc3-592b-4f61-8041-c206b4bbff02" path="/var/lib/kubelet/pods/23a6bbc3-592b-4f61-8041-c206b4bbff02/volumes"
Sep 10 23:42:09.254257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.254224    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"]
Sep 10 23:42:09.254741 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.254577    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a6bbc3-592b-4f61-8041-c206b4bbff02" containerName="limitador"
Sep 10 23:42:09.254741 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.254589    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a6bbc3-592b-4f61-8041-c206b4bbff02" containerName="limitador"
Sep 10 23:42:09.254741 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.254647    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a6bbc3-592b-4f61-8041-c206b4bbff02" containerName="limitador"
Sep 10 23:42:09.259219 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.259198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.261387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.261369    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 23:42:09.262142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.262121    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 23:42:09.262142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.262134    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-87pz4\""
Sep 10 23:42:09.262328 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.262133    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:42:09.266137 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.266116    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"]
Sep 10 23:42:09.336984 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.336950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77tv\" (UniqueName: \"kubernetes.io/projected/169f4af2-c429-4b89-8129-6be19ff6f258-kube-api-access-v77tv\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.337105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.337053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/169f4af2-c429-4b89-8129-6be19ff6f258-data\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.438105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.438069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/169f4af2-c429-4b89-8129-6be19ff6f258-data\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.438283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.438116    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77tv\" (UniqueName: \"kubernetes.io/projected/169f4af2-c429-4b89-8129-6be19ff6f258-kube-api-access-v77tv\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.438485 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.438466    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/169f4af2-c429-4b89-8129-6be19ff6f258-data\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.446233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.446208    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77tv\" (UniqueName: \"kubernetes.io/projected/169f4af2-c429-4b89-8129-6be19ff6f258-kube-api-access-v77tv\") pod \"postgres-69fb4594cf-8j6bz\" (UID: \"169f4af2-c429-4b89-8129-6be19ff6f258\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.571121 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.571057    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:09.844492 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:09.844464    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"]
Sep 10 23:42:09.846105 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:42:09.846081    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169f4af2_c429_4b89_8129_6be19ff6f258.slice/crio-8aec67cc3e697d42c6d13e55318a2730ee3cb41e1314690f7588032a59b59b73 WatchSource:0}: Error finding container 8aec67cc3e697d42c6d13e55318a2730ee3cb41e1314690f7588032a59b59b73: Status 404 returned error can't find the container with id 8aec67cc3e697d42c6d13e55318a2730ee3cb41e1314690f7588032a59b59b73
Sep 10 23:42:10.829416 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:10.829374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz" event={"ID":"169f4af2-c429-4b89-8129-6be19ff6f258","Type":"ContainerStarted","Data":"8aec67cc3e697d42c6d13e55318a2730ee3cb41e1314690f7588032a59b59b73"}
Sep 10 23:42:14.853824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:14.853739    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz" event={"ID":"169f4af2-c429-4b89-8129-6be19ff6f258","Type":"ContainerStarted","Data":"4c1c893cd228e867447e0f8da66d3f8c23e82782dafd128f8f8969b7a7306dc3"}
Sep 10 23:42:14.854183 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:14.853831    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:14.869378 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:14.869334    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz" podStartSLOduration=1.245534284 podStartE2EDuration="5.869319818s" totalImagesPullingTime="4.623785534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:14.867945133 +0000 UTC m=+520.972231954" watchObservedRunningTime="2026-09-10 23:42:14.869319818 +0000 UTC m=+520.973606606"
Sep 10 23:42:20.888480 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:20.888449    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8j6bz"
Sep 10 23:42:28.295111 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.295025    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:28.300660 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.300636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.303123 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.303092    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 23:42:28.303239 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.303194    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 23:42:28.303362 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.303346    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 23:42:28.304059 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.304038    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dvnwp\""
Sep 10 23:42:28.313179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.313153    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:28.397808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.397776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.397944 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.397810    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbps\" (UniqueName: \"kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.397944 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.397840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.468342 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.468314    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 10 23:42:28.471800 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.471780    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.480845 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.480818    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 10 23:42:28.498591 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.498725 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498635    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.498725 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.498839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbps\" (UniqueName: \"kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.498839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.498839 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:42:28.498778    2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 23:42:28.498839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.498819    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhcc\" (UniqueName: \"kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.499040 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:42:28.498958    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs podName:dfc4052c-229c-4307-bea0-ace149aa901b nodeName:}" failed. No retries permitted until 2026-09-10 23:42:28.99893526 +0000 UTC m=+535.103222032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs") pod "maas-controller-57fc49d68f-qfm9g" (UID: "dfc4052c-229c-4307-bea0-ace149aa901b") : secret "maas-controller-metrics-tls" not found
Sep 10 23:42:28.501100 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.501081    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.506838 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.506807    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbps\" (UniqueName: \"kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:28.600353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.600262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.600461 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.600375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhcc\" (UniqueName: \"kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.600522 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.600490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.602527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.602505    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.602744 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.602726    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.607479 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.607462    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhcc\" (UniqueName: \"kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc\") pod \"maas-controller-6978bcbbd5-rghqk\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") " pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:28.783598 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:28.783566    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:29.004382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.004340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:29.006626 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.006592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") pod \"maas-controller-57fc49d68f-qfm9g\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") " pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:29.054969 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.054934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 10 23:42:29.060535 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:42:29.060506    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f67d45_fa7a_41fb_ad9f_7a94b62d794c.slice/crio-6b127a323ec2d71772ba3f0db6e1d88562b050f4d113c2be2dbdfdfee687852b WatchSource:0}: Error finding container 6b127a323ec2d71772ba3f0db6e1d88562b050f4d113c2be2dbdfdfee687852b: Status 404 returned error can't find the container with id 6b127a323ec2d71772ba3f0db6e1d88562b050f4d113c2be2dbdfdfee687852b
Sep 10 23:42:29.210720 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.210670    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:29.479479 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.479452    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:29.481174 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:42:29.481144    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc4052c_229c_4307_bea0_ace149aa901b.slice/crio-43f2fe5c1b6b9000b62ec67e6ac34e86b17a0e97ed9ebefeddb130c02fa80157 WatchSource:0}: Error finding container 43f2fe5c1b6b9000b62ec67e6ac34e86b17a0e97ed9ebefeddb130c02fa80157: Status 404 returned error can't find the container with id 43f2fe5c1b6b9000b62ec67e6ac34e86b17a0e97ed9ebefeddb130c02fa80157
Sep 10 23:42:29.926768 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.926719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" event={"ID":"dfc4052c-229c-4307-bea0-ace149aa901b","Type":"ContainerStarted","Data":"43f2fe5c1b6b9000b62ec67e6ac34e86b17a0e97ed9ebefeddb130c02fa80157"}
Sep 10 23:42:29.928270 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:29.928238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" event={"ID":"51f67d45-fa7a-41fb-ad9f-7a94b62d794c","Type":"ContainerStarted","Data":"6b127a323ec2d71772ba3f0db6e1d88562b050f4d113c2be2dbdfdfee687852b"}
Sep 10 23:42:31.940186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:31.940152    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" event={"ID":"dfc4052c-229c-4307-bea0-ace149aa901b","Type":"ContainerStarted","Data":"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"}
Sep 10 23:42:31.940635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:31.940250    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:31.941767 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:31.941748    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" event={"ID":"51f67d45-fa7a-41fb-ad9f-7a94b62d794c","Type":"ContainerStarted","Data":"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"}
Sep 10 23:42:31.941867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:31.941799    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:31.980005 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:31.979963    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" podStartSLOduration=1.84470544 podStartE2EDuration="3.979950855s" totalImagesPullingTime="2.135245415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:31.977598268 +0000 UTC m=+538.081885077" watchObservedRunningTime="2026-09-10 23:42:31.979950855 +0000 UTC m=+538.084237648"
Sep 10 23:42:32.016525 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:32.016484    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" podStartSLOduration=1.470746847 podStartE2EDuration="4.016471115s" totalImagesPullingTime="2.545724268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:32.015940378 +0000 UTC m=+538.120227313" watchObservedRunningTime="2026-09-10 23:42:32.016471115 +0000 UTC m=+538.120757908"
Sep 10 23:42:42.948322 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:42.948276    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:42.948720 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:42.948457    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 10 23:42:43.007767 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.007726    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:43.008039 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.008009    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" podUID="dfc4052c-229c-4307-bea0-ace149aa901b" containerName="manager" containerID="cri-o://66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db" gracePeriod=30
Sep 10 23:42:43.253232 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.253210    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:43.333531 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.333502    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") pod \"dfc4052c-229c-4307-bea0-ace149aa901b\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") "
Sep 10 23:42:43.333680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.333539    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbps\" (UniqueName: \"kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps\") pod \"dfc4052c-229c-4307-bea0-ace149aa901b\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") "
Sep 10 23:42:43.333680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.333607    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert\") pod \"dfc4052c-229c-4307-bea0-ace149aa901b\" (UID: \"dfc4052c-229c-4307-bea0-ace149aa901b\") "
Sep 10 23:42:43.335745 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.335703    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dfc4052c-229c-4307-bea0-ace149aa901b" (UID: "dfc4052c-229c-4307-bea0-ace149aa901b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:42:43.335855 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.335752    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dfc4052c-229c-4307-bea0-ace149aa901b" (UID: "dfc4052c-229c-4307-bea0-ace149aa901b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:42:43.335855 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.335788    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps" (OuterVolumeSpecName: "kube-api-access-ffbps") pod "dfc4052c-229c-4307-bea0-ace149aa901b" (UID: "dfc4052c-229c-4307-bea0-ace149aa901b"). InnerVolumeSpecName "kube-api-access-ffbps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:43.435087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.435059    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:42:43.435087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.435082    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc4052c-229c-4307-bea0-ace149aa901b-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:42:43.435087 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:43.435091    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbps\" (UniqueName: \"kubernetes.io/projected/dfc4052c-229c-4307-bea0-ace149aa901b-kube-api-access-ffbps\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:42:44.001658 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.001626    2566 generic.go:356] "Generic (PLEG): container finished" podID="dfc4052c-229c-4307-bea0-ace149aa901b" containerID="66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db" exitCode=0
Sep 10 23:42:44.002038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.001669    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57fc49d68f-qfm9g"
Sep 10 23:42:44.002038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.001721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" event={"ID":"dfc4052c-229c-4307-bea0-ace149aa901b","Type":"ContainerDied","Data":"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"}
Sep 10 23:42:44.002038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.001768    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57fc49d68f-qfm9g" event={"ID":"dfc4052c-229c-4307-bea0-ace149aa901b","Type":"ContainerDied","Data":"43f2fe5c1b6b9000b62ec67e6ac34e86b17a0e97ed9ebefeddb130c02fa80157"}
Sep 10 23:42:44.002038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.001790    2566 scope.go:117] "RemoveContainer" containerID="66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"
Sep 10 23:42:44.011118 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.010990    2566 scope.go:117] "RemoveContainer" containerID="66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"
Sep 10 23:42:44.011274 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:42:44.011255    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db\": container with ID starting with 66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db not found: ID does not exist" containerID="66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"
Sep 10 23:42:44.011344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.011281    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db"} err="failed to get container status \"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db\": rpc error: code = NotFound desc = could not find container \"66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db\": container with ID starting with 66459b928b7d0d239f84c086dca3c028edd8de64c76c93577ace1ce5cd9c04db not found: ID does not exist"
Sep 10 23:42:44.022190 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.022167    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:44.025444 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.025425    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57fc49d68f-qfm9g"]
Sep 10 23:42:44.428869 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:42:44.428841    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc4052c-229c-4307-bea0-ace149aa901b" path="/var/lib/kubelet/pods/dfc4052c-229c-4307-bea0-ace149aa901b/volumes"
Sep 10 23:43:02.666180 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.666147    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 10 23:43:02.666701 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.666540    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc4052c-229c-4307-bea0-ace149aa901b" containerName="manager"
Sep 10 23:43:02.666701 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.666552    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc4052c-229c-4307-bea0-ace149aa901b" containerName="manager"
Sep 10 23:43:02.666701 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.666610    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc4052c-229c-4307-bea0-ace149aa901b" containerName="manager"
Sep 10 23:43:02.669757 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.669738    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.671904 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.671880    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 23:43:02.672025 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.671916    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7fgh2\""
Sep 10 23:43:02.672025 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.672006    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 23:43:02.679591 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.679565    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 10 23:43:02.803164 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.803127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.803361 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.803233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5977s\" (UniqueName: \"kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.803361 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.803279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.803361 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.803325    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.903871 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.903833    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.904060 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.903885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.904060 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.903994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5977s\" (UniqueName: \"kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.904060 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.904032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.904235 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:43:02.904140    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 10 23:43:02.904235 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:43:02.904226    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs podName:d5aa8eaa-08b3-4a87-bc65-5193bb5401aa nodeName:}" failed. No retries permitted until 2026-09-10 23:43:03.404203834 +0000 UTC m=+569.508490626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs") pod "maas-api-6545cd6846-8mbgs" (UID: "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa") : secret "maas-api-metrics-tls" not found
Sep 10 23:43:02.904697 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.904672    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.906468 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.906448    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:02.911801 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:02.911782    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5977s\" (UniqueName: \"kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:03.153779 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.153743    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"]
Sep 10 23:43:03.157259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.157231    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.159750 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.159719    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bgpsq\""
Sep 10 23:43:03.159884 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.159773    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 23:43:03.166610 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.166585    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"]
Sep 10 23:43:03.308436 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.308399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6z9s\" (UniqueName: \"kubernetes.io/projected/9e0b83cf-839e-4383-b0d9-4209a82fb10c-kube-api-access-t6z9s\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.308436 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.308440    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0b83cf-839e-4383-b0d9-4209a82fb10c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.409244 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.409160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6z9s\" (UniqueName: \"kubernetes.io/projected/9e0b83cf-839e-4383-b0d9-4209a82fb10c-kube-api-access-t6z9s\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.409244 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.409198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0b83cf-839e-4383-b0d9-4209a82fb10c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.409465 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.409255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:03.410059 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.410037    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0b83cf-839e-4383-b0d9-4209a82fb10c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.411803 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.411784    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") pod \"maas-api-6545cd6846-8mbgs\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") " pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:03.417177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.417154    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6z9s\" (UniqueName: \"kubernetes.io/projected/9e0b83cf-839e-4383-b0d9-4209a82fb10c-kube-api-access-t6z9s\") pod \"payload-processing-5b54b7fbb7-9tnhb\" (UID: \"9e0b83cf-839e-4383-b0d9-4209a82fb10c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.470367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.470327    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:03.581560 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.581524    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:03.743579 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.743554    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"]
Sep 10 23:43:03.745700 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:43:03.745669    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0b83cf_839e_4383_b0d9_4209a82fb10c.slice/crio-6e460f291e1ce0de877a78954a2f440922ea38fdc29beb9d76697799575c40ad WatchSource:0}: Error finding container 6e460f291e1ce0de877a78954a2f440922ea38fdc29beb9d76697799575c40ad: Status 404 returned error can't find the container with id 6e460f291e1ce0de877a78954a2f440922ea38fdc29beb9d76697799575c40ad
Sep 10 23:43:03.852825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:03.852797    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 10 23:43:03.855096 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:43:03.855072    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aa8eaa_08b3_4a87_bc65_5193bb5401aa.slice/crio-3d10f9bdffbe6f76ffeb1d2d42e1d7db6232c694597c8b70b9d91bb45367a42e WatchSource:0}: Error finding container 3d10f9bdffbe6f76ffeb1d2d42e1d7db6232c694597c8b70b9d91bb45367a42e: Status 404 returned error can't find the container with id 3d10f9bdffbe6f76ffeb1d2d42e1d7db6232c694597c8b70b9d91bb45367a42e
Sep 10 23:43:04.106351 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:04.106236    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb" event={"ID":"9e0b83cf-839e-4383-b0d9-4209a82fb10c","Type":"ContainerStarted","Data":"6e460f291e1ce0de877a78954a2f440922ea38fdc29beb9d76697799575c40ad"}
Sep 10 23:43:04.107748 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:04.107722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" event={"ID":"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa","Type":"ContainerStarted","Data":"3d10f9bdffbe6f76ffeb1d2d42e1d7db6232c694597c8b70b9d91bb45367a42e"}
Sep 10 23:43:06.119823 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.119787    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb" event={"ID":"9e0b83cf-839e-4383-b0d9-4209a82fb10c","Type":"ContainerStarted","Data":"eee66afb25cde0765024980292eb0303aaee519f9dc6b0a85b24e9edfa7dda16"}
Sep 10 23:43:06.120319 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.119908    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:06.121468 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.121443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" event={"ID":"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa","Type":"ContainerStarted","Data":"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"}
Sep 10 23:43:06.121582 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.121503    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:06.136221 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.136165    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb" podStartSLOduration=0.93308447 podStartE2EDuration="3.136150596s" totalImagesPullingTime="2.203066126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:06.134364062 +0000 UTC m=+572.238650876" watchObservedRunningTime="2026-09-10 23:43:06.136150596 +0000 UTC m=+572.240437390"
Sep 10 23:43:06.149311 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:06.149266    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" podStartSLOduration=2.055722535 podStartE2EDuration="4.149253143s" totalImagesPullingTime="2.093530608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:06.148398367 +0000 UTC m=+572.252685184" watchObservedRunningTime="2026-09-10 23:43:06.149253143 +0000 UTC m=+572.253539939"
Sep 10 23:43:12.134814 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:12.134780    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 10 23:43:17.131546 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:17.131511    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tnhb"
Sep 10 23:43:42.687607 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.687571    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"]
Sep 10 23:43:42.692752 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.692730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.695938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.695914    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 23:43:42.695938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.695925    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 23:43:42.696116 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.695919    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2vpzq\""
Sep 10 23:43:42.696116 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.695916    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 23:43:42.700096 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.700073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"]
Sep 10 23:43:42.853153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.853153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853152    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.853440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06669687-7377-463a-8c6f-9230f4281612-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.853440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853243    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.853440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.853440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.853334    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjzlp\" (UniqueName: \"kubernetes.io/projected/06669687-7377-463a-8c6f-9230f4281612-kube-api-access-xjzlp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954100    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjzlp\" (UniqueName: \"kubernetes.io/projected/06669687-7377-463a-8c6f-9230f4281612-kube-api-access-xjzlp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954233    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06669687-7377-463a-8c6f-9230f4281612-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954615 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.954673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.954661    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.956496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.956475    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06669687-7377-463a-8c6f-9230f4281612-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.956794 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.956775    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06669687-7377-463a-8c6f-9230f4281612-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:42.961731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:42.961710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjzlp\" (UniqueName: \"kubernetes.io/projected/06669687-7377-463a-8c6f-9230f4281612-kube-api-access-xjzlp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lpjk5\" (UID: \"06669687-7377-463a-8c6f-9230f4281612\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:43.005538 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:43.005512    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:43.280558 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:43.280530    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"]
Sep 10 23:43:43.283196 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:43:43.283164    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06669687_7377_463a_8c6f_9230f4281612.slice/crio-8de3208ec38a824c70dc2ef35b32f091563541aae9cc1a64f3caf38e2eecd018 WatchSource:0}: Error finding container 8de3208ec38a824c70dc2ef35b32f091563541aae9cc1a64f3caf38e2eecd018: Status 404 returned error can't find the container with id 8de3208ec38a824c70dc2ef35b32f091563541aae9cc1a64f3caf38e2eecd018
Sep 10 23:43:43.296741 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:43.296713    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5" event={"ID":"06669687-7377-463a-8c6f-9230f4281612","Type":"ContainerStarted","Data":"8de3208ec38a824c70dc2ef35b32f091563541aae9cc1a64f3caf38e2eecd018"}
Sep 10 23:43:45.308586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:45.308546    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5" event={"ID":"06669687-7377-463a-8c6f-9230f4281612","Type":"ContainerStarted","Data":"e9fe379582a640775eb9676a97ddc3c2f4dd884a47a223e165322499e1574a9e"}
Sep 10 23:43:45.327149 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:45.327091    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5" podStartSLOduration=2.3589741699999998 podStartE2EDuration="3.327042592s" totalImagesPullingTime="968.068422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:45.326091355 +0000 UTC m=+611.430378163" watchObservedRunningTime="2026-09-10 23:43:45.327042592 +0000 UTC m=+611.431329387"
Sep 10 23:43:53.005965 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:53.005931    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:53.008459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:53.005989    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:53.018388 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:53.018363    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:43:53.358989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:43:53.358907    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lpjk5"
Sep 10 23:46:00.723924 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.723891    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:46:00.727827 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.727789    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.730195 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.730169    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-487960-serving-cert\""
Sep 10 23:46:00.741517 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.741486    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:46:00.866605 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.866569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.866783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.866654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.866783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.866749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq7sv\" (UniqueName: \"kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.866874 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.866786    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.967533 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.967498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.967708 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.967575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.967708 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.967630    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.967708 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.967698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq7sv\" (UniqueName: \"kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.967846 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:00.967737    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-serving-cert: secret "maas-api-e2e-inf-a-487960-serving-cert" not found
Sep 10 23:46:00.967846 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:00.967802    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls podName:edb744e7-8c30-49b5-ab99-7f9c187c1ed3 nodeName:}" failed. No retries permitted until 2026-09-10 23:46:01.467784448 +0000 UTC m=+747.572071220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls") pod "maas-api-e2e-inf-a-487960-58f75df4-jkwv7" (UID: "edb744e7-8c30-49b5-ab99-7f9c187c1ed3") : secret "maas-api-e2e-inf-a-487960-serving-cert" not found
Sep 10 23:46:00.968282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.968256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.970161 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.970138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:00.977469 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:00.977407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq7sv\" (UniqueName: \"kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:01.439433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.439395    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:46:01.443107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.443083    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.445278 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.445252    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-487960\""
Sep 10 23:46:01.445436 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.445373    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-487960-dockercfg-wfgv2\""
Sep 10 23:46:01.451583 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.451507    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:46:01.474108 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.474071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:01.476883 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.476850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") pod \"maas-api-e2e-inf-a-487960-58f75df4-jkwv7\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:01.574799 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.574757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.574972 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.574863    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7m9j\" (UniqueName: \"kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.639998 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.639959    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:01.676327 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.676278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7m9j\" (UniqueName: \"kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.676496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.676383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.677160 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.677138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.684348 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.684289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7m9j\" (UniqueName: \"kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j\") pod \"payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.756125 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.756087    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:01.921186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.921160    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:46:01.923870 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:01.923840    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb744e7_8c30_49b5_ab99_7f9c187c1ed3.slice/crio-5157457e3e6db949eb4eda1acc97af1b5c331ff08a4da6b78b342679b11bf20b WatchSource:0}: Error finding container 5157457e3e6db949eb4eda1acc97af1b5c331ff08a4da6b78b342679b11bf20b: Status 404 returned error can't find the container with id 5157457e3e6db949eb4eda1acc97af1b5c331ff08a4da6b78b342679b11bf20b
Sep 10 23:46:01.925247 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.925226    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:46:01.992107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:01.992027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" event={"ID":"edb744e7-8c30-49b5-ab99-7f9c187c1ed3","Type":"ContainerStarted","Data":"5157457e3e6db949eb4eda1acc97af1b5c331ff08a4da6b78b342679b11bf20b"}
Sep 10 23:46:02.027816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:02.027772    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:46:02.030025 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:02.030002    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cdaa3e_daf9_4297_b8e7_4afced529baa.slice/crio-82bcd86d8d09cea56c7439691b5e0b0f4ed2df00163e0d9bea0b2ba54586cc91 WatchSource:0}: Error finding container 82bcd86d8d09cea56c7439691b5e0b0f4ed2df00163e0d9bea0b2ba54586cc91: Status 404 returned error can't find the container with id 82bcd86d8d09cea56c7439691b5e0b0f4ed2df00163e0d9bea0b2ba54586cc91
Sep 10 23:46:02.998364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:02.998317    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" event={"ID":"edb744e7-8c30-49b5-ab99-7f9c187c1ed3","Type":"ContainerStarted","Data":"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"}
Sep 10 23:46:02.998831 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:02.998530    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:02.999977 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:02.999952    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" event={"ID":"67cdaa3e-daf9-4297-b8e7-4afced529baa","Type":"ContainerStarted","Data":"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"}
Sep 10 23:46:03.000097 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:02.999990    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" event={"ID":"67cdaa3e-daf9-4297-b8e7-4afced529baa","Type":"ContainerStarted","Data":"82bcd86d8d09cea56c7439691b5e0b0f4ed2df00163e0d9bea0b2ba54586cc91"}
Sep 10 23:46:03.000097 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:03.000019    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:03.015401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:03.015354    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" podStartSLOduration=2.612991395 podStartE2EDuration="3.015340967s" totalImagesPullingTime="402.349572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:03.014564198 +0000 UTC m=+749.118851004" watchObservedRunningTime="2026-09-10 23:46:03.015340967 +0000 UTC m=+749.119627760"
Sep 10 23:46:03.032816 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:03.032770    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" podStartSLOduration=2.032756404 podStartE2EDuration="2.032756404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:03.030557533 +0000 UTC m=+749.134844327" watchObservedRunningTime="2026-09-10 23:46:03.032756404 +0000 UTC m=+749.137043214"
Sep 10 23:46:08.496283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.496248    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:08.501459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.501434    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.503911 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.503886    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9dfc47f0-serving-cert\""
Sep 10 23:46:08.511248 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.511219    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:08.639826 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.639791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.639826 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.639825    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.640041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.639842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtqn\" (UniqueName: \"kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.640041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.639871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.741377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.741344    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.741377 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.741388    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.741613 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.741416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtqn\" (UniqueName: \"kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.741613 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.741451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.742027 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.742003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.744069 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.744035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.744196 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.744085    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.757889 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.757828    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtqn\" (UniqueName: \"kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn\") pod \"maas-api-e2e-ait-9dfc47f0-775988874d-wmxls\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:08.814819 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:08.814777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:09.010050 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.009978    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:46:09.090780 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.090753    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:09.092598 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:09.092568    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc006f3db_b7a9_431f_8f75_e863970ad7bc.slice/crio-3017b07afb29d65e22a6ab8047c41359e942fec5df06e072e688910ace335fc6 WatchSource:0}: Error finding container 3017b07afb29d65e22a6ab8047c41359e942fec5df06e072e688910ace335fc6: Status 404 returned error can't find the container with id 3017b07afb29d65e22a6ab8047c41359e942fec5df06e072e688910ace335fc6
Sep 10 23:46:09.218235 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.218193    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:09.223146 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.223126    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.225596 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.225575    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9dfc47f0\""
Sep 10 23:46:09.225693 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.225603    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9dfc47f0-dockercfg-5h5rn\""
Sep 10 23:46:09.235976 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.235950    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:09.250473 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.250450    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:09.253930 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.253914    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.267805 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.267748    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:09.347989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.347944    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.348153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.347998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxgb\" (UniqueName: \"kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.348153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.348030    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgx6\" (UniqueName: \"kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.348153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.348101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.448936 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.448899    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.448936 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.448944    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxgb\" (UniqueName: \"kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.449176 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.448969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgx6\" (UniqueName: \"kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.449176 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.449043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.450048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.450006    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.450139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.450061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.459946 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.459922    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgx6\" (UniqueName: \"kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6\") pod \"payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.460045 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.459964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxgb\" (UniqueName: \"kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb\") pod \"payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") " pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.534620 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.534546    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:09.571805 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.571767    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:09.812731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.812706    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:09.814325 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:09.814282    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dde88bc_2e73_476d_ba5e_f39e5a415dcc.slice/crio-a4ec0a2b3ebd1bdcb2a785f3fb11f369b1a37a2fe53a0b6ba1cc806676a275e6 WatchSource:0}: Error finding container a4ec0a2b3ebd1bdcb2a785f3fb11f369b1a37a2fe53a0b6ba1cc806676a275e6: Status 404 returned error can't find the container with id a4ec0a2b3ebd1bdcb2a785f3fb11f369b1a37a2fe53a0b6ba1cc806676a275e6
Sep 10 23:46:09.854446 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:09.854420    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:09.858329 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:09.858284    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0038394_3449_4dc0_bce9_f665c76e61fb.slice/crio-f4b86a2c53526abbb1ab0f59178be432acff47c3c7bd557b6c9c0d4ef684bf87 WatchSource:0}: Error finding container f4b86a2c53526abbb1ab0f59178be432acff47c3c7bd557b6c9c0d4ef684bf87: Status 404 returned error can't find the container with id f4b86a2c53526abbb1ab0f59178be432acff47c3c7bd557b6c9c0d4ef684bf87
Sep 10 23:46:10.038909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.038875    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" event={"ID":"7dde88bc-2e73-476d-ba5e-f39e5a415dcc","Type":"ContainerStarted","Data":"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"}
Sep 10 23:46:10.039121 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.038962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" event={"ID":"7dde88bc-2e73-476d-ba5e-f39e5a415dcc","Type":"ContainerStarted","Data":"a4ec0a2b3ebd1bdcb2a785f3fb11f369b1a37a2fe53a0b6ba1cc806676a275e6"}
Sep 10 23:46:10.039121 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.039005    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:10.040701 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.040674    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" event={"ID":"c006f3db-b7a9-431f-8f75-e863970ad7bc","Type":"ContainerStarted","Data":"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"}
Sep 10 23:46:10.040831 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.040722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" event={"ID":"c006f3db-b7a9-431f-8f75-e863970ad7bc","Type":"ContainerStarted","Data":"3017b07afb29d65e22a6ab8047c41359e942fec5df06e072e688910ace335fc6"}
Sep 10 23:46:10.040831 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.040749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:10.042368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.042332    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" event={"ID":"c0038394-3449-4dc0-bce9-f665c76e61fb","Type":"ContainerStarted","Data":"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"}
Sep 10 23:46:10.042495 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.042379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" event={"ID":"c0038394-3449-4dc0-bce9-f665c76e61fb","Type":"ContainerStarted","Data":"f4b86a2c53526abbb1ab0f59178be432acff47c3c7bd557b6c9c0d4ef684bf87"}
Sep 10 23:46:10.042495 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.042425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:10.055766 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.055702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" podStartSLOduration=1.055681868 podStartE2EDuration="1.055681868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:10.053618059 +0000 UTC m=+756.157904881" watchObservedRunningTime="2026-09-10 23:46:10.055681868 +0000 UTC m=+756.159968666"
Sep 10 23:46:10.072734 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.072628    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" podStartSLOduration=1.07260838 podStartE2EDuration="1.07260838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:10.071094336 +0000 UTC m=+756.175381158" watchObservedRunningTime="2026-09-10 23:46:10.07260838 +0000 UTC m=+756.176895177"
Sep 10 23:46:10.088660 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.088608    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" podStartSLOduration=1.7317941989999999 podStartE2EDuration="2.088587207s" totalImagesPullingTime="356.793008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:10.087194954 +0000 UTC m=+756.191481793" watchObservedRunningTime="2026-09-10 23:46:10.088587207 +0000 UTC m=+756.192874005"
Sep 10 23:46:10.115606 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.115573    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:46:10.119468 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.119445    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.121777 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.121756    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-abe3de-serving-cert\""
Sep 10 23:46:10.132250 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.132161    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:46:10.256579 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.256536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.256760 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.256601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjv7\" (UniqueName: \"kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.256760 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.256682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.256888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.256815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.358057 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.357960    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.358057 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.358037    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.358283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.358069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjv7\" (UniqueName: \"kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.358283 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.358101    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.358283 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:10.358132    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-serving-cert: secret "maas-api-e2e-autores-abe3de-serving-cert" not found
Sep 10 23:46:10.358283 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:10.358220    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls podName:18eade75-cbef-44a5-ba14-4cec53536efa nodeName:}" failed. No retries permitted until 2026-09-10 23:46:10.858198751 +0000 UTC m=+756.962485537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls") pod "maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa") : secret "maas-api-e2e-autores-abe3de-serving-cert" not found
Sep 10 23:46:10.358971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.358945    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.360939 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.360905    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.368412 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.368389    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjv7\" (UniqueName: \"kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.863112 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:10.863065    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:10.863562 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:10.863227    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-serving-cert: secret "maas-api-e2e-autores-abe3de-serving-cert" not found
Sep 10 23:46:10.863562 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:10.863335    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls podName:18eade75-cbef-44a5-ba14-4cec53536efa nodeName:}" failed. No retries permitted until 2026-09-10 23:46:11.863288679 +0000 UTC m=+757.967575452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls") pod "maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa") : secret "maas-api-e2e-autores-abe3de-serving-cert" not found
Sep 10 23:46:11.874155 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:11.874117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:11.876686 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:11.876662    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:11.936872 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:11.936838    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:12.208114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:12.208020    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:46:12.210370 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:12.210344    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18eade75_cbef_44a5_ba14_4cec53536efa.slice/crio-f279dce2fc38a3ac435e41933b91311822239b73899599afe504e68fa672e331 WatchSource:0}: Error finding container f279dce2fc38a3ac435e41933b91311822239b73899599afe504e68fa672e331: Status 404 returned error can't find the container with id f279dce2fc38a3ac435e41933b91311822239b73899599afe504e68fa672e331
Sep 10 23:46:13.061983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:13.061946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" event={"ID":"18eade75-cbef-44a5-ba14-4cec53536efa","Type":"ContainerStarted","Data":"c9f6c0aa1df189606c45c3a12cd17ff0f9ffad6f5e4536c31d1c28b2b48f2819"}
Sep 10 23:46:13.062381 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:13.062005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" event={"ID":"18eade75-cbef-44a5-ba14-4cec53536efa","Type":"ContainerStarted","Data":"f279dce2fc38a3ac435e41933b91311822239b73899599afe504e68fa672e331"}
Sep 10 23:46:13.062381 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:13.062036    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:13.080569 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:13.080514    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" podStartSLOduration=2.72064114 podStartE2EDuration="3.080498811s" totalImagesPullingTime="359.857671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:13.077951567 +0000 UTC m=+759.182238417" watchObservedRunningTime="2026-09-10 23:46:13.080498811 +0000 UTC m=+759.184785604"
Sep 10 23:46:14.007402 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:14.007371    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:46:16.053558 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:16.053531    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:19.072988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:19.072958    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:46:21.050909 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:21.050874    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:21.051347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:21.050951    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:29.010512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.010472    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:46:29.016269 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.016244    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.018843 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.018821    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ea66ce-serving-cert\""
Sep 10 23:46:29.025047 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.025018    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:46:29.137066 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.137035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.137221 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.137079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74c52\" (UniqueName: \"kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.137221 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.137209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.137312 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.137237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.238286 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.238252    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.238447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.238312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74c52\" (UniqueName: \"kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.238447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.238423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.238565 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.238451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.238565 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:29.238456    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-serving-cert: secret "maas-api-e2e-inf-b-ea66ce-serving-cert" not found
Sep 10 23:46:29.238565 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:29.238534    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls podName:ef129237-e2ab-4485-b69a-aa4fa307fc47 nodeName:}" failed. No retries permitted until 2026-09-10 23:46:29.738512869 +0000 UTC m=+775.842799660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls") pod "maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" (UID: "ef129237-e2ab-4485-b69a-aa4fa307fc47") : secret "maas-api-e2e-inf-b-ea66ce-serving-cert" not found
Sep 10 23:46:29.239116 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.239091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.240787 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.240767    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.246223 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.246196    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74c52\" (UniqueName: \"kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.742861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.742825    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:46:29.743084 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.742908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.745648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.745620    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.746824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.746804    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.749151 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.749126    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ea66ce\""
Sep 10 23:46:29.749245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.749236    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ea66ce-dockercfg-q46tg\""
Sep 10 23:46:29.757165 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.757140    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:46:29.843704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.843648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqbr\" (UniqueName: \"kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.843903 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.843813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.932353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.932319    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:29.944861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.944829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.945080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.945015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqbr\" (UniqueName: \"kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.946044 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.946020    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:29.954257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:29.954229    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqbr\" (UniqueName: \"kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr\") pod \"payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:30.066213 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:30.066131    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:30.208401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:30.208377    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:46:30.210039 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:30.210010    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef129237_e2ab_4485_b69a_aa4fa307fc47.slice/crio-8d67c9ececa9a5f1e763ff3360652dbc4f3cd1f5566c7d9cf8869d8e94e92f3f WatchSource:0}: Error finding container 8d67c9ececa9a5f1e763ff3360652dbc4f3cd1f5566c7d9cf8869d8e94e92f3f: Status 404 returned error can't find the container with id 8d67c9ececa9a5f1e763ff3360652dbc4f3cd1f5566c7d9cf8869d8e94e92f3f
Sep 10 23:46:30.338544 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:30.338517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:46:30.341107 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:30.341079    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1919de2_1010_49b2_ad77_a13f6d5d80e0.slice/crio-0b1d6cb099011e7ecacbb6206f569ccce2c4d9a94dec9c7f39b3c82e03d59811 WatchSource:0}: Error finding container 0b1d6cb099011e7ecacbb6206f569ccce2c4d9a94dec9c7f39b3c82e03d59811: Status 404 returned error can't find the container with id 0b1d6cb099011e7ecacbb6206f569ccce2c4d9a94dec9c7f39b3c82e03d59811
Sep 10 23:46:31.161125 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.161080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" event={"ID":"a1919de2-1010-49b2-ad77-a13f6d5d80e0","Type":"ContainerStarted","Data":"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"}
Sep 10 23:46:31.161660 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.161151    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" event={"ID":"a1919de2-1010-49b2-ad77-a13f6d5d80e0","Type":"ContainerStarted","Data":"0b1d6cb099011e7ecacbb6206f569ccce2c4d9a94dec9c7f39b3c82e03d59811"}
Sep 10 23:46:31.161660 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.161184    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:31.162905 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.162880    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" event={"ID":"ef129237-e2ab-4485-b69a-aa4fa307fc47","Type":"ContainerStarted","Data":"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"}
Sep 10 23:46:31.163004 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.162924    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" event={"ID":"ef129237-e2ab-4485-b69a-aa4fa307fc47","Type":"ContainerStarted","Data":"8d67c9ececa9a5f1e763ff3360652dbc4f3cd1f5566c7d9cf8869d8e94e92f3f"}
Sep 10 23:46:31.163004 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.162944    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:31.188266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.188214    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" podStartSLOduration=2.188200469 podStartE2EDuration="2.188200469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:31.185687356 +0000 UTC m=+777.289974146" watchObservedRunningTime="2026-09-10 23:46:31.188200469 +0000 UTC m=+777.292487262"
Sep 10 23:46:31.217563 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:31.217512    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" podStartSLOduration=2.8863345430000003 podStartE2EDuration="3.217494739s" totalImagesPullingTime="331.160196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:31.216118374 +0000 UTC m=+777.320405169" watchObservedRunningTime="2026-09-10 23:46:31.217494739 +0000 UTC m=+777.321781535"
Sep 10 23:46:37.174157 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:37.174131    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:46:39.286896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.286859    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:39.287285 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.287144    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" podUID="c006f3db-b7a9-431f-8f75-e863970ad7bc" containerName="maas-api" containerID="cri-o://0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56" gracePeriod=30
Sep 10 23:46:39.337574 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.337539    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:39.337802 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.337777    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" podUID="c0038394-3449-4dc0-bce9-f665c76e61fb" containerName="payload-processing" containerID="cri-o://a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf" gracePeriod=30
Sep 10 23:46:39.346131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.346001    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:39.346371 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.346283    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" podUID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" containerName="payload-pre-processing" containerID="cri-o://ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379" gracePeriod=30
Sep 10 23:46:39.625656 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.625612    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:39.674679 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.674649    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:39.684328 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.684276    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:39.745913 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745885    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls\") pod \"c006f3db-b7a9-431f-8f75-e863970ad7bc\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") "
Sep 10 23:46:39.745913 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745914    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca\") pod \"c006f3db-b7a9-431f-8f75-e863970ad7bc\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745931    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs\") pod \"c006f3db-b7a9-431f-8f75-e863970ad7bc\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745948    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwtqn\" (UniqueName: \"kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn\") pod \"c006f3db-b7a9-431f-8f75-e863970ad7bc\" (UID: \"c006f3db-b7a9-431f-8f75-e863970ad7bc\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745966    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume\") pod \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.745990    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfgx6\" (UniqueName: \"kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6\") pod \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\" (UID: \"7dde88bc-2e73-476d-ba5e-f39e5a415dcc\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.746010    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjxgb\" (UniqueName: \"kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb\") pod \"c0038394-3449-4dc0-bce9-f665c76e61fb\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") "
Sep 10 23:46:39.746179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.746051    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume\") pod \"c0038394-3449-4dc0-bce9-f665c76e61fb\" (UID: \"c0038394-3449-4dc0-bce9-f665c76e61fb\") "
Sep 10 23:46:39.746576 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.746368    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c006f3db-b7a9-431f-8f75-e863970ad7bc" (UID: "c006f3db-b7a9-431f-8f75-e863970ad7bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:46:39.746576 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.746458    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7dde88bc-2e73-476d-ba5e-f39e5a415dcc" (UID: "7dde88bc-2e73-476d-ba5e-f39e5a415dcc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:46:39.746690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.746565    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c0038394-3449-4dc0-bce9-f665c76e61fb" (UID: "c0038394-3449-4dc0-bce9-f665c76e61fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:46:39.748690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.748663    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb" (OuterVolumeSpecName: "kube-api-access-vjxgb") pod "c0038394-3449-4dc0-bce9-f665c76e61fb" (UID: "c0038394-3449-4dc0-bce9-f665c76e61fb"). InnerVolumeSpecName "kube-api-access-vjxgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:46:39.748841 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.748825    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6" (OuterVolumeSpecName: "kube-api-access-mfgx6") pod "7dde88bc-2e73-476d-ba5e-f39e5a415dcc" (UID: "7dde88bc-2e73-476d-ba5e-f39e5a415dcc"). InnerVolumeSpecName "kube-api-access-mfgx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:46:39.748988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.748961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c006f3db-b7a9-431f-8f75-e863970ad7bc" (UID: "c006f3db-b7a9-431f-8f75-e863970ad7bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:46:39.749062 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.749010    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn" (OuterVolumeSpecName: "kube-api-access-xwtqn") pod "c006f3db-b7a9-431f-8f75-e863970ad7bc" (UID: "c006f3db-b7a9-431f-8f75-e863970ad7bc"). InnerVolumeSpecName "kube-api-access-xwtqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:46:39.749900 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.749880    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c006f3db-b7a9-431f-8f75-e863970ad7bc" (UID: "c006f3db-b7a9-431f-8f75-e863970ad7bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847650    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847681    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c006f3db-b7a9-431f-8f75-e863970ad7bc-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847691    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c006f3db-b7a9-431f-8f75-e863970ad7bc-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847700    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwtqn\" (UniqueName: \"kubernetes.io/projected/c006f3db-b7a9-431f-8f75-e863970ad7bc-kube-api-access-xwtqn\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847709    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847720    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfgx6\" (UniqueName: \"kubernetes.io/projected/7dde88bc-2e73-476d-ba5e-f39e5a415dcc-kube-api-access-mfgx6\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847728    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxgb\" (UniqueName: \"kubernetes.io/projected/c0038394-3449-4dc0-bce9-f665c76e61fb-kube-api-access-vjxgb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:39.847732 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:39.847736    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0038394-3449-4dc0-bce9-f665c76e61fb-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:46:40.213470 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.213436    2566 generic.go:356] "Generic (PLEG): container finished" podID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" containerID="ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379" exitCode=0
Sep 10 23:46:40.213677 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.213481    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"
Sep 10 23:46:40.213677 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.213532    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" event={"ID":"7dde88bc-2e73-476d-ba5e-f39e5a415dcc","Type":"ContainerDied","Data":"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"}
Sep 10 23:46:40.213677 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.213599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c" event={"ID":"7dde88bc-2e73-476d-ba5e-f39e5a415dcc","Type":"ContainerDied","Data":"a4ec0a2b3ebd1bdcb2a785f3fb11f369b1a37a2fe53a0b6ba1cc806676a275e6"}
Sep 10 23:46:40.213677 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.213632    2566 scope.go:117] "RemoveContainer" containerID="ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"
Sep 10 23:46:40.214938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.214915    2566 generic.go:356] "Generic (PLEG): container finished" podID="c006f3db-b7a9-431f-8f75-e863970ad7bc" containerID="0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56" exitCode=0
Sep 10 23:46:40.215013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.214960    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"
Sep 10 23:46:40.215064 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.214953    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" event={"ID":"c006f3db-b7a9-431f-8f75-e863970ad7bc","Type":"ContainerDied","Data":"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"}
Sep 10 23:46:40.215123 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.215095    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls" event={"ID":"c006f3db-b7a9-431f-8f75-e863970ad7bc","Type":"ContainerDied","Data":"3017b07afb29d65e22a6ab8047c41359e942fec5df06e072e688910ace335fc6"}
Sep 10 23:46:40.216592 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.216569    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0038394-3449-4dc0-bce9-f665c76e61fb" containerID="a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf" exitCode=0
Sep 10 23:46:40.216693 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.216602    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" event={"ID":"c0038394-3449-4dc0-bce9-f665c76e61fb","Type":"ContainerDied","Data":"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"}
Sep 10 23:46:40.216693 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.216622    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"
Sep 10 23:46:40.216693 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.216655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf" event={"ID":"c0038394-3449-4dc0-bce9-f665c76e61fb","Type":"ContainerDied","Data":"f4b86a2c53526abbb1ab0f59178be432acff47c3c7bd557b6c9c0d4ef684bf87"}
Sep 10 23:46:40.224714 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.224693    2566 scope.go:117] "RemoveContainer" containerID="ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"
Sep 10 23:46:40.225075 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:40.225033    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379\": container with ID starting with ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379 not found: ID does not exist" containerID="ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"
Sep 10 23:46:40.225150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.225084    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379"} err="failed to get container status \"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379\": rpc error: code = NotFound desc = could not find container \"ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379\": container with ID starting with ffe81daaa3fcfe2c104769e182030cc2345db3b2589ffef61a24767570ada379 not found: ID does not exist"
Sep 10 23:46:40.225150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.225102    2566 scope.go:117] "RemoveContainer" containerID="0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"
Sep 10 23:46:40.236735 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.236711    2566 scope.go:117] "RemoveContainer" containerID="0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"
Sep 10 23:46:40.237176 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:40.237147    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56\": container with ID starting with 0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56 not found: ID does not exist" containerID="0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"
Sep 10 23:46:40.237251 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.237206    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56"} err="failed to get container status \"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56\": rpc error: code = NotFound desc = could not find container \"0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56\": container with ID starting with 0ab01c4d6e387188231daa9c4e49f6f4eda492b8ce2524a18a737467d7d6ae56 not found: ID does not exist"
Sep 10 23:46:40.237318 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.237262    2566 scope.go:117] "RemoveContainer" containerID="a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"
Sep 10 23:46:40.246519 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.246500    2566 scope.go:117] "RemoveContainer" containerID="a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"
Sep 10 23:46:40.246827 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:40.246808    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf\": container with ID starting with a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf not found: ID does not exist" containerID="a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"
Sep 10 23:46:40.246891 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.246837    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf"} err="failed to get container status \"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf\": rpc error: code = NotFound desc = could not find container \"a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf\": container with ID starting with a5e6dff20eb9ec7b0bc6c1a48f9a961f907eaf73c6e9cffdbd080563b29cdbaf not found: ID does not exist"
Sep 10 23:46:40.253728 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.253703    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:40.261638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.261615    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dfc47f0-5cc4d7664b-jpl9c"]
Sep 10 23:46:40.274809 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.274782    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:40.277040 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.277018    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dfc47f0-694779cbd5-4bbtf"]
Sep 10 23:46:40.288249 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.288225    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:40.292837 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.292812    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9dfc47f0-775988874d-wmxls"]
Sep 10 23:46:40.430391 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.430358    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" path="/var/lib/kubelet/pods/7dde88bc-2e73-476d-ba5e-f39e5a415dcc/volumes"
Sep 10 23:46:40.430743 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.430724    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0038394-3449-4dc0-bce9-f665c76e61fb" path="/var/lib/kubelet/pods/c0038394-3449-4dc0-bce9-f665c76e61fb/volumes"
Sep 10 23:46:40.431068 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:40.431055    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c006f3db-b7a9-431f-8f75-e863970ad7bc" path="/var/lib/kubelet/pods/c006f3db-b7a9-431f-8f75-e863970ad7bc/volumes"
Sep 10 23:46:42.171476 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:42.171442    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:46:46.840343 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.840312    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:46:46.840928 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.840904    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c006f3db-b7a9-431f-8f75-e863970ad7bc" containerName="maas-api"
Sep 10 23:46:46.841126 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841109    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c006f3db-b7a9-431f-8f75-e863970ad7bc" containerName="maas-api"
Sep 10 23:46:46.841367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841292    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" containerName="payload-pre-processing"
Sep 10 23:46:46.841367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841334    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" containerName="payload-pre-processing"
Sep 10 23:46:46.841528 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841378    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0038394-3449-4dc0-bce9-f665c76e61fb" containerName="payload-processing"
Sep 10 23:46:46.841528 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841388    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0038394-3449-4dc0-bce9-f665c76e61fb" containerName="payload-processing"
Sep 10 23:46:46.841635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841533    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c006f3db-b7a9-431f-8f75-e863970ad7bc" containerName="maas-api"
Sep 10 23:46:46.841635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841553    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dde88bc-2e73-476d-ba5e-f39e5a415dcc" containerName="payload-pre-processing"
Sep 10 23:46:46.841635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.841564    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0038394-3449-4dc0-bce9-f665c76e61fb" containerName="payload-processing"
Sep 10 23:46:46.846578 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.846554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:46.848813 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.848788    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-cd653317-serving-cert\""
Sep 10 23:46:46.856666 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:46.856640    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:46:47.018866 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.018829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkbzh\" (UniqueName: \"kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.019041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.018872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.019041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.018948    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.019041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.018968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.120051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.119958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkbzh\" (UniqueName: \"kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.120051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.120001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.120051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.120032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.120389 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:47.120118    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-serving-cert: secret "maas-api-e2e-migrate-cd653317-serving-cert" not found
Sep 10 23:46:47.120389 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.120155    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.120389 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:46:47.120203    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls podName:209189a2-f7ae-4759-9a38-36211cb1ed21 nodeName:}" failed. No retries permitted until 2026-09-10 23:46:47.620184223 +0000 UTC m=+793.724471001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls") pod "maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" (UID: "209189a2-f7ae-4759-9a38-36211cb1ed21") : secret "maas-api-e2e-migrate-cd653317-serving-cert" not found
Sep 10 23:46:47.120843 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.120818    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.122762 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.122738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.129089 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.129059    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkbzh\" (UniqueName: \"kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.486194 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.486156    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:46:47.490069 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.490044    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.493521 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.493492    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-cd653317\""
Sep 10 23:46:47.493654 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.493523    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-cd653317-dockercfg-sn5mv\""
Sep 10 23:46:47.502837 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.502807    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:46:47.625680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.625647    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.625829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.625717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.625829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.625778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmql\" (UniqueName: \"kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.628284 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.628257    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") pod \"maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.727355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.727316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.727541 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.727392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmql\" (UniqueName: \"kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.728007 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.727987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.735045 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.735016    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmql\" (UniqueName: \"kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql\") pod \"payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:47.760770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.760660    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:47.803581 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:47.803546    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:48.037761 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.037737    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:46:48.039136 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:48.039112    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209189a2_f7ae_4759_9a38_36211cb1ed21.slice/crio-ef2127373145c520ae53577c5cf88edc3a5dea81b003122d878ac257a51c3597 WatchSource:0}: Error finding container ef2127373145c520ae53577c5cf88edc3a5dea81b003122d878ac257a51c3597: Status 404 returned error can't find the container with id ef2127373145c520ae53577c5cf88edc3a5dea81b003122d878ac257a51c3597
Sep 10 23:46:48.082569 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.082547    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:46:48.084451 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:46:48.084424    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b471c1a_c52b_4db0_bdc3_7a8beeedbe9d.slice/crio-6ff6a645c1f93f34a557067df758c84b405c481f9930eafd68eab820603d8757 WatchSource:0}: Error finding container 6ff6a645c1f93f34a557067df758c84b405c481f9930eafd68eab820603d8757: Status 404 returned error can't find the container with id 6ff6a645c1f93f34a557067df758c84b405c481f9930eafd68eab820603d8757
Sep 10 23:46:48.264991 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.264946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" event={"ID":"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d","Type":"ContainerStarted","Data":"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"}
Sep 10 23:46:48.265179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.265013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" event={"ID":"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d","Type":"ContainerStarted","Data":"6ff6a645c1f93f34a557067df758c84b405c481f9930eafd68eab820603d8757"}
Sep 10 23:46:48.265179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.265043    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:46:48.266372 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.266345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" event={"ID":"209189a2-f7ae-4759-9a38-36211cb1ed21","Type":"ContainerStarted","Data":"ef2127373145c520ae53577c5cf88edc3a5dea81b003122d878ac257a51c3597"}
Sep 10 23:46:48.281786 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:48.281744    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" podStartSLOduration=1.2817278 podStartE2EDuration="1.2817278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:48.280031517 +0000 UTC m=+794.384318336" watchObservedRunningTime="2026-09-10 23:46:48.2817278 +0000 UTC m=+794.386014588"
Sep 10 23:46:49.273931 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:49.273893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" event={"ID":"209189a2-f7ae-4759-9a38-36211cb1ed21","Type":"ContainerStarted","Data":"626d750b381454990cc1ec7b79a11cfef2b1c2b3a0669cea43d22acfd2356c9c"}
Sep 10 23:46:49.274355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:49.273973    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:49.289527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:49.289472    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" podStartSLOduration=2.849324052 podStartE2EDuration="3.289451898s" totalImagesPullingTime="440.127846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:49.288371837 +0000 UTC m=+795.392658845" watchObservedRunningTime="2026-09-10 23:46:49.289451898 +0000 UTC m=+795.393738693"
Sep 10 23:46:55.284171 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:55.284138    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:46:59.276530 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:46:59.276446    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:47:18.314802 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.314764    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:47:18.315398 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.315035    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" podUID="209189a2-f7ae-4759-9a38-36211cb1ed21" containerName="maas-api" containerID="cri-o://626d750b381454990cc1ec7b79a11cfef2b1c2b3a0669cea43d22acfd2356c9c" gracePeriod=30
Sep 10 23:47:18.368041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.368008    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:47:18.368314 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.368248    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" podUID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" containerName="payload-pre-processing" containerID="cri-o://84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27" gracePeriod=30
Sep 10 23:47:18.442452 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.442417    2566 generic.go:356] "Generic (PLEG): container finished" podID="209189a2-f7ae-4759-9a38-36211cb1ed21" containerID="626d750b381454990cc1ec7b79a11cfef2b1c2b3a0669cea43d22acfd2356c9c" exitCode=0
Sep 10 23:47:18.442591 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.442484    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" event={"ID":"209189a2-f7ae-4759-9a38-36211cb1ed21","Type":"ContainerDied","Data":"626d750b381454990cc1ec7b79a11cfef2b1c2b3a0669cea43d22acfd2356c9c"}
Sep 10 23:47:18.616876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.616840    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:47:18.649078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.649049    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:47:18.711429 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711396    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjmql\" (UniqueName: \"kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql\") pod \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") "
Sep 10 23:47:18.711586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711446    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume\") pod \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\" (UID: \"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d\") "
Sep 10 23:47:18.711586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711466    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkbzh\" (UniqueName: \"kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh\") pod \"209189a2-f7ae-4759-9a38-36211cb1ed21\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") "
Sep 10 23:47:18.711586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711498    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs\") pod \"209189a2-f7ae-4759-9a38-36211cb1ed21\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") "
Sep 10 23:47:18.711586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711547    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca\") pod \"209189a2-f7ae-4759-9a38-36211cb1ed21\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") "
Sep 10 23:47:18.711586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711571    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") pod \"209189a2-f7ae-4759-9a38-36211cb1ed21\" (UID: \"209189a2-f7ae-4759-9a38-36211cb1ed21\") "
Sep 10 23:47:18.711980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711920    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "209189a2-f7ae-4759-9a38-36211cb1ed21" (UID: "209189a2-f7ae-4759-9a38-36211cb1ed21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:18.712107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.711981    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" (UID: "5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:18.713691 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.713668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "209189a2-f7ae-4759-9a38-36211cb1ed21" (UID: "209189a2-f7ae-4759-9a38-36211cb1ed21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:47:18.713770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.713692    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "209189a2-f7ae-4759-9a38-36211cb1ed21" (UID: "209189a2-f7ae-4759-9a38-36211cb1ed21"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:47:18.714000 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.713981    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh" (OuterVolumeSpecName: "kube-api-access-nkbzh") pod "209189a2-f7ae-4759-9a38-36211cb1ed21" (UID: "209189a2-f7ae-4759-9a38-36211cb1ed21"). InnerVolumeSpecName "kube-api-access-nkbzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:18.714095 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.714008    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql" (OuterVolumeSpecName: "kube-api-access-fjmql") pod "5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" (UID: "5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d"). InnerVolumeSpecName "kube-api-access-fjmql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:18.812795 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812756    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjmql\" (UniqueName: \"kubernetes.io/projected/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-kube-api-access-fjmql\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:18.812795 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812794    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:18.813001 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812813    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkbzh\" (UniqueName: \"kubernetes.io/projected/209189a2-f7ae-4759-9a38-36211cb1ed21-kube-api-access-nkbzh\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:18.813001 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812827    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:18.813001 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812840    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/209189a2-f7ae-4759-9a38-36211cb1ed21-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:18.813001 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:18.812852    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/209189a2-f7ae-4759-9a38-36211cb1ed21-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:19.451164 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.451119    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"
Sep 10 23:47:19.451661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.451139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj" event={"ID":"209189a2-f7ae-4759-9a38-36211cb1ed21","Type":"ContainerDied","Data":"ef2127373145c520ae53577c5cf88edc3a5dea81b003122d878ac257a51c3597"}
Sep 10 23:47:19.451661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.451490    2566 scope.go:117] "RemoveContainer" containerID="626d750b381454990cc1ec7b79a11cfef2b1c2b3a0669cea43d22acfd2356c9c"
Sep 10 23:47:19.453177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.452883    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" containerID="84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27" exitCode=0
Sep 10 23:47:19.453177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.452965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" event={"ID":"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d","Type":"ContainerDied","Data":"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"}
Sep 10 23:47:19.453177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.453018    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2" event={"ID":"5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d","Type":"ContainerDied","Data":"6ff6a645c1f93f34a557067df758c84b405c481f9930eafd68eab820603d8757"}
Sep 10 23:47:19.453177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.453085    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"
Sep 10 23:47:19.468382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.468365    2566 scope.go:117] "RemoveContainer" containerID="84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"
Sep 10 23:47:19.478233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.478214    2566 scope.go:117] "RemoveContainer" containerID="84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"
Sep 10 23:47:19.478529 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:47:19.478505    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27\": container with ID starting with 84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27 not found: ID does not exist" containerID="84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"
Sep 10 23:47:19.478623 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.478532    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27"} err="failed to get container status \"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27\": rpc error: code = NotFound desc = could not find container \"84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27\": container with ID starting with 84fca87082d803e057ec5eae65bcf881f67b2f7365bcb018a87ad1256e9a4c27 not found: ID does not exist"
Sep 10 23:47:19.479763 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.479744    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:47:19.483540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.483518    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd653317-585567b4c6-n9wxj"]
Sep 10 23:47:19.495706 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.495685    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:47:19.501287 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:19.501269    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cd653317-5cddccf754-trrn2"]
Sep 10 23:47:20.431285 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:20.431245    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209189a2-f7ae-4759-9a38-36211cb1ed21" path="/var/lib/kubelet/pods/209189a2-f7ae-4759-9a38-36211cb1ed21/volumes"
Sep 10 23:47:20.431840 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:20.431811    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" path="/var/lib/kubelet/pods/5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d/volumes"
Sep 10 23:47:22.796665 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796059    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796742    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" containerName="payload-pre-processing"
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796764    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" containerName="payload-pre-processing"
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796781    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209189a2-f7ae-4759-9a38-36211cb1ed21" containerName="maas-api"
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796792    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="209189a2-f7ae-4759-9a38-36211cb1ed21" containerName="maas-api"
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796896    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b471c1a-c52b-4db0-bdc3-7a8beeedbe9d" containerName="payload-pre-processing"
Sep 10 23:47:22.797013 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.796908    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="209189a2-f7ae-4759-9a38-36211cb1ed21" containerName="maas-api"
Sep 10 23:47:22.807357 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.807330    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:22.811589 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.811549    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d949bf5d-serving-cert\""
Sep 10 23:47:22.811950 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.811925    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:22.951454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.951418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:22.951631 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.951464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbfv\" (UniqueName: \"kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:22.951631 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.951547    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:22.951631 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:22.951575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.052742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.052648    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.052742 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.052692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.052973 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.052822    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.052973 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.052858    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbfv\" (UniqueName: \"kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.053428 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.053399    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.055044 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.055022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.055163 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.055145    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.062124 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.062093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbfv\" (UniqueName: \"kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv\") pod \"maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.123999 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.123963    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:23.386143 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.386062    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:23.390112 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.390089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.392430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.392407    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d949bf5d\""
Sep 10 23:47:23.392555 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.392489    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d949bf5d-dockercfg-whkkr\""
Sep 10 23:47:23.401206 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.400274    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:23.403067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.403052    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:23.405570 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:47:23.405547    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e164c19_3dac_41d3_bf46_0aaf1321ffeb.slice/crio-a649e8843fa16e490ebea4cfbc0af4430f8aec424834b51a91b66957b3301948 WatchSource:0}: Error finding container a649e8843fa16e490ebea4cfbc0af4430f8aec424834b51a91b66957b3301948: Status 404 returned error can't find the container with id a649e8843fa16e490ebea4cfbc0af4430f8aec424834b51a91b66957b3301948
Sep 10 23:47:23.421037 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.421013    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:23.424904 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.424884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.432970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.432268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:23.478717 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.478686    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" event={"ID":"1e164c19-3dac-41d3-bf46-0aaf1321ffeb","Type":"ContainerStarted","Data":"a649e8843fa16e490ebea4cfbc0af4430f8aec424834b51a91b66957b3301948"}
Sep 10 23:47:23.556543 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.556503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.556713 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.556574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.556713 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.556605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjbl\" (UniqueName: \"kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.556713 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.556641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.658056 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.658020    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.658252 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.658087    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.658252 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.658119    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjbl\" (UniqueName: \"kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.658252 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.658157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.659060 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.659035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.659111 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.659035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.671879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.671855    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4\") pod \"payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") " pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.673529 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.673501    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjbl\" (UniqueName: \"kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl\") pod \"payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.702982 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.702955    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:23.738035 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.738003    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:23.981059 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:23.980939    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:23.983524 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:47:23.983493    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2203de0_b0f2_416b_a23b_3ecfdcabab26.slice/crio-21a510bdc7ac8754beaa2d997b76fd8d9ded5c054ac7d15998db1ad2bb597b40 WatchSource:0}: Error finding container 21a510bdc7ac8754beaa2d997b76fd8d9ded5c054ac7d15998db1ad2bb597b40: Status 404 returned error can't find the container with id 21a510bdc7ac8754beaa2d997b76fd8d9ded5c054ac7d15998db1ad2bb597b40
Sep 10 23:47:24.021168 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.021146    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:24.023664 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:47:24.023634    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45120c90_a021_48fb_a555_55ad9cc73ff3.slice/crio-f815cbedbe71ec0113a2ffce5171f19384a63aa03cd3eec310648afd1fa2f520 WatchSource:0}: Error finding container f815cbedbe71ec0113a2ffce5171f19384a63aa03cd3eec310648afd1fa2f520: Status 404 returned error can't find the container with id f815cbedbe71ec0113a2ffce5171f19384a63aa03cd3eec310648afd1fa2f520
Sep 10 23:47:24.486124 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.486089    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" event={"ID":"1e164c19-3dac-41d3-bf46-0aaf1321ffeb","Type":"ContainerStarted","Data":"feef8391462c16e2d54cad4beffbd9bebee1848787a166b6966591497e8dec79"}
Sep 10 23:47:24.486345 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.486206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:24.487853 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.487823    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" event={"ID":"e2203de0-b0f2-416b-a23b-3ecfdcabab26","Type":"ContainerStarted","Data":"e01600940552384592f33b5467e779c23c353081d641cb6fa6bf88c8b00ad6cf"}
Sep 10 23:47:24.487989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.487873    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" event={"ID":"e2203de0-b0f2-416b-a23b-3ecfdcabab26","Type":"ContainerStarted","Data":"21a510bdc7ac8754beaa2d997b76fd8d9ded5c054ac7d15998db1ad2bb597b40"}
Sep 10 23:47:24.487989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.487898    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:24.489983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.489958    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" event={"ID":"45120c90-a021-48fb-a555-55ad9cc73ff3","Type":"ContainerStarted","Data":"c9601aa94157bb65ea1825025dcb97983da8bdc68c2286e7520a54da479580e7"}
Sep 10 23:47:24.490085 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.490006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" event={"ID":"45120c90-a021-48fb-a555-55ad9cc73ff3","Type":"ContainerStarted","Data":"f815cbedbe71ec0113a2ffce5171f19384a63aa03cd3eec310648afd1fa2f520"}
Sep 10 23:47:24.490147 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.490093    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:24.507203 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.507149    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" podStartSLOduration=1.8070349060000002 podStartE2EDuration="2.507128512s" totalImagesPullingTime="700.093606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:24.504178184 +0000 UTC m=+830.608464980" watchObservedRunningTime="2026-09-10 23:47:24.507128512 +0000 UTC m=+830.611415307"
Sep 10 23:47:24.519914 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.519873    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" podStartSLOduration=1.519859273 podStartE2EDuration="1.519859273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:24.518399341 +0000 UTC m=+830.622686163" watchObservedRunningTime="2026-09-10 23:47:24.519859273 +0000 UTC m=+830.624146067"
Sep 10 23:47:24.536473 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:24.536432    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" podStartSLOduration=1.536416881 podStartE2EDuration="1.536416881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:24.533381006 +0000 UTC m=+830.637667817" watchObservedRunningTime="2026-09-10 23:47:24.536416881 +0000 UTC m=+830.640703677"
Sep 10 23:47:30.502922 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:30.502894    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:34.413637 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:34.413605    2566 scope.go:117] "RemoveContainer" containerID="ef230a7c5b3ad7b4bffb5d9d4a60f780f8f0224ea46c1adccc584f74a9923a55"
Sep 10 23:47:35.499853 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:35.499826    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:35.500347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:35.499902    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:53.315260 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.315222    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:53.316563 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.315645    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" podUID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" containerName="maas-api" containerID="cri-o://feef8391462c16e2d54cad4beffbd9bebee1848787a166b6966591497e8dec79" gracePeriod=30
Sep 10 23:47:53.364943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.364908    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:53.365226 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.365176    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" podUID="45120c90-a021-48fb-a555-55ad9cc73ff3" containerName="payload-processing" containerID="cri-o://c9601aa94157bb65ea1825025dcb97983da8bdc68c2286e7520a54da479580e7" gracePeriod=30
Sep 10 23:47:53.373322 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.373033    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:53.373893 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.373859    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" podUID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" containerName="payload-pre-processing" containerID="cri-o://e01600940552384592f33b5467e779c23c353081d641cb6fa6bf88c8b00ad6cf" gracePeriod=30
Sep 10 23:47:53.651227 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.651046    2566 generic.go:356] "Generic (PLEG): container finished" podID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" containerID="feef8391462c16e2d54cad4beffbd9bebee1848787a166b6966591497e8dec79" exitCode=0
Sep 10 23:47:53.651227 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.651144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" event={"ID":"1e164c19-3dac-41d3-bf46-0aaf1321ffeb","Type":"ContainerDied","Data":"feef8391462c16e2d54cad4beffbd9bebee1848787a166b6966591497e8dec79"}
Sep 10 23:47:53.653271 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.653241    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" containerID="e01600940552384592f33b5467e779c23c353081d641cb6fa6bf88c8b00ad6cf" exitCode=0
Sep 10 23:47:53.653420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.653327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" event={"ID":"e2203de0-b0f2-416b-a23b-3ecfdcabab26","Type":"ContainerDied","Data":"e01600940552384592f33b5467e779c23c353081d641cb6fa6bf88c8b00ad6cf"}
Sep 10 23:47:53.655502 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.655477    2566 generic.go:356] "Generic (PLEG): container finished" podID="45120c90-a021-48fb-a555-55ad9cc73ff3" containerID="c9601aa94157bb65ea1825025dcb97983da8bdc68c2286e7520a54da479580e7" exitCode=0
Sep 10 23:47:53.655635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.655562    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" event={"ID":"45120c90-a021-48fb-a555-55ad9cc73ff3","Type":"ContainerDied","Data":"c9601aa94157bb65ea1825025dcb97983da8bdc68c2286e7520a54da479580e7"}
Sep 10 23:47:53.685235 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.685217    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:53.688490 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.688470    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:53.691747 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.691729    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:53.741945 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.741920    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca\") pod \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") "
Sep 10 23:47:53.742103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.741951    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjbl\" (UniqueName: \"kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl\") pod \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") "
Sep 10 23:47:53.742103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742033    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4\") pod \"45120c90-a021-48fb-a555-55ad9cc73ff3\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") "
Sep 10 23:47:53.742103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742053    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume\") pod \"45120c90-a021-48fb-a555-55ad9cc73ff3\" (UID: \"45120c90-a021-48fb-a555-55ad9cc73ff3\") "
Sep 10 23:47:53.742103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742079    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs\") pod \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") "
Sep 10 23:47:53.742375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742113    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls\") pod \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") "
Sep 10 23:47:53.742375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742151    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lbfv\" (UniqueName: \"kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv\") pod \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\" (UID: \"1e164c19-3dac-41d3-bf46-0aaf1321ffeb\") "
Sep 10 23:47:53.742375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742177    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume\") pod \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\" (UID: \"e2203de0-b0f2-416b-a23b-3ecfdcabab26\") "
Sep 10 23:47:53.742540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742370    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e164c19-3dac-41d3-bf46-0aaf1321ffeb" (UID: "1e164c19-3dac-41d3-bf46-0aaf1321ffeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:53.742540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742482    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45120c90-a021-48fb-a555-55ad9cc73ff3" (UID: "45120c90-a021-48fb-a555-55ad9cc73ff3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:53.742648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742542    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.742648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742562    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45120c90-a021-48fb-a555-55ad9cc73ff3-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.742813 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.742770    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2203de0-b0f2-416b-a23b-3ecfdcabab26" (UID: "e2203de0-b0f2-416b-a23b-3ecfdcabab26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:47:53.744797 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.744764    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e164c19-3dac-41d3-bf46-0aaf1321ffeb" (UID: "1e164c19-3dac-41d3-bf46-0aaf1321ffeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:47:53.744797 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.744778    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e164c19-3dac-41d3-bf46-0aaf1321ffeb" (UID: "1e164c19-3dac-41d3-bf46-0aaf1321ffeb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:47:53.745016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.745000    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl" (OuterVolumeSpecName: "kube-api-access-xrjbl") pod "e2203de0-b0f2-416b-a23b-3ecfdcabab26" (UID: "e2203de0-b0f2-416b-a23b-3ecfdcabab26"). InnerVolumeSpecName "kube-api-access-xrjbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:53.745079 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.745062    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv" (OuterVolumeSpecName: "kube-api-access-8lbfv") pod "1e164c19-3dac-41d3-bf46-0aaf1321ffeb" (UID: "1e164c19-3dac-41d3-bf46-0aaf1321ffeb"). InnerVolumeSpecName "kube-api-access-8lbfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:53.745355 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.745326    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4" (OuterVolumeSpecName: "kube-api-access-m26t4") pod "45120c90-a021-48fb-a555-55ad9cc73ff3" (UID: "45120c90-a021-48fb-a555-55ad9cc73ff3"). InnerVolumeSpecName "kube-api-access-m26t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843900    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjbl\" (UniqueName: \"kubernetes.io/projected/e2203de0-b0f2-416b-a23b-3ecfdcabab26-kube-api-access-xrjbl\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843929    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/45120c90-a021-48fb-a555-55ad9cc73ff3-kube-api-access-m26t4\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843939    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843948    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843957    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lbfv\" (UniqueName: \"kubernetes.io/projected/1e164c19-3dac-41d3-bf46-0aaf1321ffeb-kube-api-access-8lbfv\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:53.843979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:53.843966    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2203de0-b0f2-416b-a23b-3ecfdcabab26-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:47:54.661484 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.661443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7" event={"ID":"1e164c19-3dac-41d3-bf46-0aaf1321ffeb","Type":"ContainerDied","Data":"a649e8843fa16e490ebea4cfbc0af4430f8aec424834b51a91b66957b3301948"}
Sep 10 23:47:54.661484 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.661463    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"
Sep 10 23:47:54.662040 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.661516    2566 scope.go:117] "RemoveContainer" containerID="feef8391462c16e2d54cad4beffbd9bebee1848787a166b6966591497e8dec79"
Sep 10 23:47:54.662978 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.662943    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"
Sep 10 23:47:54.663106 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.662937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4" event={"ID":"e2203de0-b0f2-416b-a23b-3ecfdcabab26","Type":"ContainerDied","Data":"21a510bdc7ac8754beaa2d997b76fd8d9ded5c054ac7d15998db1ad2bb597b40"}
Sep 10 23:47:54.665140 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.664922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl" event={"ID":"45120c90-a021-48fb-a555-55ad9cc73ff3","Type":"ContainerDied","Data":"f815cbedbe71ec0113a2ffce5171f19384a63aa03cd3eec310648afd1fa2f520"}
Sep 10 23:47:54.665140 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.664971    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"
Sep 10 23:47:54.673947 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.673933    2566 scope.go:117] "RemoveContainer" containerID="e01600940552384592f33b5467e779c23c353081d641cb6fa6bf88c8b00ad6cf"
Sep 10 23:47:54.681475 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.681454    2566 scope.go:117] "RemoveContainer" containerID="c9601aa94157bb65ea1825025dcb97983da8bdc68c2286e7520a54da479580e7"
Sep 10 23:47:54.685014 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.684994    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:54.688859 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.688837    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d949bf5d-b589dfbf6-v28w7"]
Sep 10 23:47:54.698472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.698449    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:54.702320 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.702287    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d949bf5d-6688c89458-lwtr4"]
Sep 10 23:47:54.711208 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.711129    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:54.712993 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:54.712970    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d949bf5d-78dbc97c49-wgjdl"]
Sep 10 23:47:56.429191 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:56.429157    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" path="/var/lib/kubelet/pods/1e164c19-3dac-41d3-bf46-0aaf1321ffeb/volumes"
Sep 10 23:47:56.429585 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:56.429564    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45120c90-a021-48fb-a555-55ad9cc73ff3" path="/var/lib/kubelet/pods/45120c90-a021-48fb-a555-55ad9cc73ff3/volumes"
Sep 10 23:47:56.429903 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:56.429889    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" path="/var/lib/kubelet/pods/e2203de0-b0f2-416b-a23b-3ecfdcabab26/volumes"
Sep 10 23:47:59.623663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.623627    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:47:59.624291 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624273    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" containerName="maas-api"
Sep 10 23:47:59.624364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624308    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" containerName="maas-api"
Sep 10 23:47:59.624364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624326    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45120c90-a021-48fb-a555-55ad9cc73ff3" containerName="payload-processing"
Sep 10 23:47:59.624364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624336    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45120c90-a021-48fb-a555-55ad9cc73ff3" containerName="payload-processing"
Sep 10 23:47:59.624459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624365    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" containerName="payload-pre-processing"
Sep 10 23:47:59.624459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624374    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" containerName="payload-pre-processing"
Sep 10 23:47:59.624516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624468    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45120c90-a021-48fb-a555-55ad9cc73ff3" containerName="payload-processing"
Sep 10 23:47:59.624516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624482    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2203de0-b0f2-416b-a23b-3ecfdcabab26" containerName="payload-pre-processing"
Sep 10 23:47:59.624516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.624493    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e164c19-3dac-41d3-bf46-0aaf1321ffeb" containerName="maas-api"
Sep 10 23:47:59.630047 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.629961    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.632727 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.632700    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-51b15052-serving-cert\""
Sep 10 23:47:59.635376 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.635338    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:47:59.699839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.699809    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.699970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.699846    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.699970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.699867    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.699970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.699928    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.801273 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.801236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.801273 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.801276    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.801502 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.801317    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.801502 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.801351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.801502 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:47:59.801418    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-serving-cert: secret "maas-api-e2e-derive-51b15052-serving-cert" not found
Sep 10 23:47:59.801502 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:47:59.801492    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls podName:9cdbed13-2c2b-48cd-9d28-c66d02b1fed2 nodeName:}" failed. No retries permitted until 2026-09-10 23:48:00.3014732 +0000 UTC m=+866.405759979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls") pod "maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" (UID: "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2") : secret "maas-api-e2e-derive-51b15052-serving-cert" not found
Sep 10 23:47:59.801921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.801904    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.803670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.803647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:47:59.809508 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:47:59.809487    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:00.197631 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.197593    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:00.201615 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.201599    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.203842 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.203817    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-51b15052\""
Sep 10 23:48:00.204020 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.204003    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-51b15052-dockercfg-wjvjs\""
Sep 10 23:48:00.209718 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.209688    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:00.305571 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.305423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.305571 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.305557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:00.305571 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.305589    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9bmm\" (UniqueName: \"kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.308068 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.308038    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") pod \"maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:00.406122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.406083    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.406287 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.406139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9bmm\" (UniqueName: \"kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.406877 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.406854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.413568 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.413546    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9bmm\" (UniqueName: \"kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm\") pod \"payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.513414 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.513341    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:00.543571 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.543531    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:00.813663 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.813592    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:00.817235 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:48:00.817207    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc5a02f_d67f_4918_a2ee_98222c60e84a.slice/crio-8bdbc9c8dcf4e982a61988e924a3a8a7a8115f880ac454e33518f1aa28d6c12a WatchSource:0}: Error finding container 8bdbc9c8dcf4e982a61988e924a3a8a7a8115f880ac454e33518f1aa28d6c12a: Status 404 returned error can't find the container with id 8bdbc9c8dcf4e982a61988e924a3a8a7a8115f880ac454e33518f1aa28d6c12a
Sep 10 23:48:00.848844 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:00.848813    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:48:00.860778 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:48:00.860745    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdbed13_2c2b_48cd_9d28_c66d02b1fed2.slice/crio-be5cce8b0dd4359f53f3a61b55bc57171570e3a8b853ef5ec910e242df2d1594 WatchSource:0}: Error finding container be5cce8b0dd4359f53f3a61b55bc57171570e3a8b853ef5ec910e242df2d1594: Status 404 returned error can't find the container with id be5cce8b0dd4359f53f3a61b55bc57171570e3a8b853ef5ec910e242df2d1594
Sep 10 23:48:01.706056 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.706016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" event={"ID":"adc5a02f-d67f-4918-a2ee-98222c60e84a","Type":"ContainerStarted","Data":"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"}
Sep 10 23:48:01.706243 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.706082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" event={"ID":"adc5a02f-d67f-4918-a2ee-98222c60e84a","Type":"ContainerStarted","Data":"8bdbc9c8dcf4e982a61988e924a3a8a7a8115f880ac454e33518f1aa28d6c12a"}
Sep 10 23:48:01.706243 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.706214    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:01.707636 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.707610    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" event={"ID":"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2","Type":"ContainerStarted","Data":"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"}
Sep 10 23:48:01.707772 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.707648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" event={"ID":"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2","Type":"ContainerStarted","Data":"be5cce8b0dd4359f53f3a61b55bc57171570e3a8b853ef5ec910e242df2d1594"}
Sep 10 23:48:01.707772 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.707684    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:01.723213 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.723166    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" podStartSLOduration=1.723148709 podStartE2EDuration="1.723148709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:01.720429637 +0000 UTC m=+867.824716454" watchObservedRunningTime="2026-09-10 23:48:01.723148709 +0000 UTC m=+867.827435502"
Sep 10 23:48:01.738047 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:01.737997    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" podStartSLOduration=2.3569523390000002 podStartE2EDuration="2.737977221s" totalImagesPullingTime="381.024882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:01.73558025 +0000 UTC m=+867.839867078" watchObservedRunningTime="2026-09-10 23:48:01.737977221 +0000 UTC m=+867.842264136"
Sep 10 23:48:07.719078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:07.719044    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:09.521182 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.521144    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:48:09.521690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.521435    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" podUID="18eade75-cbef-44a5-ba14-4cec53536efa" containerName="maas-api" containerID="cri-o://c9f6c0aa1df189606c45c3a12cd17ff0f9ffad6f5e4536c31d1c28b2b48f2819" gracePeriod=30
Sep 10 23:48:09.751668 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.751637    2566 generic.go:356] "Generic (PLEG): container finished" podID="18eade75-cbef-44a5-ba14-4cec53536efa" containerID="c9f6c0aa1df189606c45c3a12cd17ff0f9ffad6f5e4536c31d1c28b2b48f2819" exitCode=0
Sep 10 23:48:09.751825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.751706    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" event={"ID":"18eade75-cbef-44a5-ba14-4cec53536efa","Type":"ContainerDied","Data":"c9f6c0aa1df189606c45c3a12cd17ff0f9ffad6f5e4536c31d1c28b2b48f2819"}
Sep 10 23:48:09.777457 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.777400    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:48:09.892594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.892561    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggjv7\" (UniqueName: \"kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7\") pod \"18eade75-cbef-44a5-ba14-4cec53536efa\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") "
Sep 10 23:48:09.892758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.892625    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca\") pod \"18eade75-cbef-44a5-ba14-4cec53536efa\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") "
Sep 10 23:48:09.892758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.892714    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs\") pod \"18eade75-cbef-44a5-ba14-4cec53536efa\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") "
Sep 10 23:48:09.892758 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.892749    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") pod \"18eade75-cbef-44a5-ba14-4cec53536efa\" (UID: \"18eade75-cbef-44a5-ba14-4cec53536efa\") "
Sep 10 23:48:09.893064 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.893035    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18eade75-cbef-44a5-ba14-4cec53536efa" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:48:09.894933 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.894894    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "18eade75-cbef-44a5-ba14-4cec53536efa" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:09.895275 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.895247    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18eade75-cbef-44a5-ba14-4cec53536efa" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:09.895530 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.895503    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7" (OuterVolumeSpecName: "kube-api-access-ggjv7") pod "18eade75-cbef-44a5-ba14-4cec53536efa" (UID: "18eade75-cbef-44a5-ba14-4cec53536efa"). InnerVolumeSpecName "kube-api-access-ggjv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:09.993921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.993890    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:09.993921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.993916    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18eade75-cbef-44a5-ba14-4cec53536efa-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:09.993921 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.993925    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggjv7\" (UniqueName: \"kubernetes.io/projected/18eade75-cbef-44a5-ba14-4cec53536efa-kube-api-access-ggjv7\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:09.994142 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:09.993935    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18eade75-cbef-44a5-ba14-4cec53536efa-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:10.758224 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:10.758144    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"
Sep 10 23:48:10.758680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:10.758144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2" event={"ID":"18eade75-cbef-44a5-ba14-4cec53536efa","Type":"ContainerDied","Data":"f279dce2fc38a3ac435e41933b91311822239b73899599afe504e68fa672e331"}
Sep 10 23:48:10.758680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:10.758323    2566 scope.go:117] "RemoveContainer" containerID="c9f6c0aa1df189606c45c3a12cd17ff0f9ffad6f5e4536c31d1c28b2b48f2819"
Sep 10 23:48:10.773556 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:10.773532    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:48:10.777254 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:10.777227    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-abe3de-85c5ff997d-rnqt2"]
Sep 10 23:48:12.430131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:12.430097    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18eade75-cbef-44a5-ba14-4cec53536efa" path="/var/lib/kubelet/pods/18eade75-cbef-44a5-ba14-4cec53536efa/volumes"
Sep 10 23:48:12.715234 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:12.715151    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:21.416254 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.416215    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:48:21.416877 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.416858    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18eade75-cbef-44a5-ba14-4cec53536efa" containerName="maas-api"
Sep 10 23:48:21.416928 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.416880    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="18eade75-cbef-44a5-ba14-4cec53536efa" containerName="maas-api"
Sep 10 23:48:21.416968 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.416957    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="18eade75-cbef-44a5-ba14-4cec53536efa" containerName="maas-api"
Sep 10 23:48:21.421725 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.421702    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.424362 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.424344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a66ef6-serving-cert\""
Sep 10 23:48:21.429401 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.429379    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:48:21.499369 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.499343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.499480 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.499419    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.499523 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.499482    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.499559 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.499542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz5kn\" (UniqueName: \"kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.600018 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.599968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.600176 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.600058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.600176 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.600094    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.600176 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.600122    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz5kn\" (UniqueName: \"kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.600363 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:48:21.600265    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-serving-cert: secret "maas-api-e2e-explicit-a66ef6-serving-cert" not found
Sep 10 23:48:21.600412 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:48:21.600369    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls podName:e4debee3-125d-43f5-ba14-50aa888af347 nodeName:}" failed. No retries permitted until 2026-09-10 23:48:22.100348799 +0000 UTC m=+888.204635575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls") pod "maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" (UID: "e4debee3-125d-43f5-ba14-50aa888af347") : secret "maas-api-e2e-explicit-a66ef6-serving-cert" not found
Sep 10 23:48:21.600839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.600810    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.602492 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.602472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:21.609050 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:21.609008    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz5kn\" (UniqueName: \"kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:22.090564 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.090529    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:48:22.094347 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.094326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.096791 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.096767    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a66ef6-dockercfg-4dfqc\""
Sep 10 23:48:22.096898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.096810    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a66ef6\""
Sep 10 23:48:22.104049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.104026    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:48:22.105852 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.105826    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.105968 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.105946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:22.106034 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.106007    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxwdf\" (UniqueName: \"kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.108926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.108900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") pod \"maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:22.138962 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.138935    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:48:22.142439 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.142422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.153073 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.153044    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:48:22.207338 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.207278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7lgk\" (UniqueName: \"kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.207507 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.207356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxwdf\" (UniqueName: \"kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.207507 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.207397    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.207507 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.207456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.208403 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.208342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.218700 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.218673    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxwdf\" (UniqueName: \"kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf\") pod \"payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.308736 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.308696    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7lgk\" (UniqueName: \"kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.308912 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.308750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.309467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.309445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.316916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.316891    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7lgk\" (UniqueName: \"kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk\") pod \"payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.357872 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.357811    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:22.406974 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.406883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.454941 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.454749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.629945 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.629922    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:48:22.631881 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:48:22.631847    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4debee3_125d_43f5_ba14_50aa888af347.slice/crio-100d02719bc1da29b57901b5629bf717874a281b4561d611649051cb378f3a97 WatchSource:0}: Error finding container 100d02719bc1da29b57901b5629bf717874a281b4561d611649051cb378f3a97: Status 404 returned error can't find the container with id 100d02719bc1da29b57901b5629bf717874a281b4561d611649051cb378f3a97
Sep 10 23:48:22.702850 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.702827    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:48:22.704613 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:48:22.704569    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode436772e_853a_434a_b536_7bbf980d02d5.slice/crio-4d462ed2f3e1b5d8fdb925b93fb62e6b8ca3b603d353a43a2af2f87a490c9141 WatchSource:0}: Error finding container 4d462ed2f3e1b5d8fdb925b93fb62e6b8ca3b603d353a43a2af2f87a490c9141: Status 404 returned error can't find the container with id 4d462ed2f3e1b5d8fdb925b93fb62e6b8ca3b603d353a43a2af2f87a490c9141
Sep 10 23:48:22.736824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.736797    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:48:22.737867 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:48:22.737843    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b25a91_94c3_4be7_9c1e_7d9877fa94cd.slice/crio-960ec89a114afd6f7129e84145b97a114b6507cb268b7b683b37d5d2df4fd264 WatchSource:0}: Error finding container 960ec89a114afd6f7129e84145b97a114b6507cb268b7b683b37d5d2df4fd264: Status 404 returned error can't find the container with id 960ec89a114afd6f7129e84145b97a114b6507cb268b7b683b37d5d2df4fd264
Sep 10 23:48:22.832053 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.832012    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" event={"ID":"e4debee3-125d-43f5-ba14-50aa888af347","Type":"ContainerStarted","Data":"100d02719bc1da29b57901b5629bf717874a281b4561d611649051cb378f3a97"}
Sep 10 23:48:22.833987 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.833946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" event={"ID":"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd","Type":"ContainerStarted","Data":"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"}
Sep 10 23:48:22.834155 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.834012    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" event={"ID":"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd","Type":"ContainerStarted","Data":"960ec89a114afd6f7129e84145b97a114b6507cb268b7b683b37d5d2df4fd264"}
Sep 10 23:48:22.834155 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.834087    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:22.835751 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.835729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" event={"ID":"e436772e-853a-434a-b536-7bbf980d02d5","Type":"ContainerStarted","Data":"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"}
Sep 10 23:48:22.835879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.835773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" event={"ID":"e436772e-853a-434a-b536-7bbf980d02d5","Type":"ContainerStarted","Data":"4d462ed2f3e1b5d8fdb925b93fb62e6b8ca3b603d353a43a2af2f87a490c9141"}
Sep 10 23:48:22.835879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.835823    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:48:22.851181 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.851111    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" podStartSLOduration=0.85109761 podStartE2EDuration="851.09761ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:22.849555502 +0000 UTC m=+888.953842324" watchObservedRunningTime="2026-09-10 23:48:22.85109761 +0000 UTC m=+888.955384403"
Sep 10 23:48:22.866727 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:22.866670    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" podStartSLOduration=0.866651911 podStartE2EDuration="866.651911ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:22.86625477 +0000 UTC m=+888.970541585" watchObservedRunningTime="2026-09-10 23:48:22.866651911 +0000 UTC m=+888.970938738"
Sep 10 23:48:23.844055 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:23.843956    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" event={"ID":"e4debee3-125d-43f5-ba14-50aa888af347","Type":"ContainerStarted","Data":"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"}
Sep 10 23:48:23.860814 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:23.860762    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" podStartSLOduration=2.4277489660000002 podStartE2EDuration="2.860745633s" totalImagesPullingTime="432.996667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:48:23.859448338 +0000 UTC m=+889.963735158" watchObservedRunningTime="2026-09-10 23:48:23.860745633 +0000 UTC m=+889.965032427"
Sep 10 23:48:24.849948 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:24.849915    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:29.845382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:29.845280    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:48:29.846821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:29.846165    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" podUID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" containerName="maas-api" containerID="cri-o://b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5" gracePeriod=30
Sep 10 23:48:29.906698 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:29.906663    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:29.906934 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:29.906905    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" podUID="adc5a02f-d67f-4918-a2ee-98222c60e84a" containerName="payload-pre-processing" containerID="cri-o://e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98" gracePeriod=30
Sep 10 23:48:30.169093 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.169060    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:30.204808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.204776    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:30.284582 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284549    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume\") pod \"adc5a02f-d67f-4918-a2ee-98222c60e84a\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") "
Sep 10 23:48:30.284773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284637    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs\") pod \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") "
Sep 10 23:48:30.284773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284661    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2\") pod \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") "
Sep 10 23:48:30.284773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284683    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") pod \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") "
Sep 10 23:48:30.284773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284697    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca\") pod \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\" (UID: \"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2\") "
Sep 10 23:48:30.284773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.284715    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9bmm\" (UniqueName: \"kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm\") pod \"adc5a02f-d67f-4918-a2ee-98222c60e84a\" (UID: \"adc5a02f-d67f-4918-a2ee-98222c60e84a\") "
Sep 10 23:48:30.285055 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.285023    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adc5a02f-d67f-4918-a2ee-98222c60e84a" (UID: "adc5a02f-d67f-4918-a2ee-98222c60e84a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:48:30.285105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.285069    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" (UID: "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:48:30.286970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.286937    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" (UID: "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:30.287086 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.286980    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" (UID: "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:48:30.287086 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.287024    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm" (OuterVolumeSpecName: "kube-api-access-s9bmm") pod "adc5a02f-d67f-4918-a2ee-98222c60e84a" (UID: "adc5a02f-d67f-4918-a2ee-98222c60e84a"). InnerVolumeSpecName "kube-api-access-s9bmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:30.287261 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.287241    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2" (OuterVolumeSpecName: "kube-api-access-84nr2") pod "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" (UID: "9cdbed13-2c2b-48cd-9d28-c66d02b1fed2"). InnerVolumeSpecName "kube-api-access-84nr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385523    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc5a02f-d67f-4918-a2ee-98222c60e84a-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385555    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385565    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-kube-api-access-84nr2\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385573    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385583    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.385608 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.385591    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9bmm\" (UniqueName: \"kubernetes.io/projected/adc5a02f-d67f-4918-a2ee-98222c60e84a-kube-api-access-s9bmm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:48:30.864770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.864743    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:48:30.888698 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.888666    2566 generic.go:356] "Generic (PLEG): container finished" podID="adc5a02f-d67f-4918-a2ee-98222c60e84a" containerID="e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98" exitCode=0
Sep 10 23:48:30.888875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.888709    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"
Sep 10 23:48:30.888875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.888759    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" event={"ID":"adc5a02f-d67f-4918-a2ee-98222c60e84a","Type":"ContainerDied","Data":"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"}
Sep 10 23:48:30.888875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.888811    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg" event={"ID":"adc5a02f-d67f-4918-a2ee-98222c60e84a","Type":"ContainerDied","Data":"8bdbc9c8dcf4e982a61988e924a3a8a7a8115f880ac454e33518f1aa28d6c12a"}
Sep 10 23:48:30.888875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.888837    2566 scope.go:117] "RemoveContainer" containerID="e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"
Sep 10 23:48:30.890210 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.890178    2566 generic.go:356] "Generic (PLEG): container finished" podID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" containerID="b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5" exitCode=0
Sep 10 23:48:30.890284 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.890241    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"
Sep 10 23:48:30.890284 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.890262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" event={"ID":"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2","Type":"ContainerDied","Data":"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"}
Sep 10 23:48:30.890420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.890319    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc" event={"ID":"9cdbed13-2c2b-48cd-9d28-c66d02b1fed2","Type":"ContainerDied","Data":"be5cce8b0dd4359f53f3a61b55bc57171570e3a8b853ef5ec910e242df2d1594"}
Sep 10 23:48:30.898455 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.898401    2566 scope.go:117] "RemoveContainer" containerID="e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"
Sep 10 23:48:30.898698 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:48:30.898675    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98\": container with ID starting with e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98 not found: ID does not exist" containerID="e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"
Sep 10 23:48:30.898778 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.898705    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98"} err="failed to get container status \"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98\": rpc error: code = NotFound desc = could not find container \"e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98\": container with ID starting with e7aacb50eca3001c4cbd921b482ceaabd546ab9426bb6cdbc39d202e24dc2a98 not found: ID does not exist"
Sep 10 23:48:30.898778 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.898725    2566 scope.go:117] "RemoveContainer" containerID="b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"
Sep 10 23:48:30.910653 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.910636    2566 scope.go:117] "RemoveContainer" containerID="b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"
Sep 10 23:48:30.911081 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:48:30.911003    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5\": container with ID starting with b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5 not found: ID does not exist" containerID="b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"
Sep 10 23:48:30.911081 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.911058    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5"} err="failed to get container status \"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5\": rpc error: code = NotFound desc = could not find container \"b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5\": container with ID starting with b2d6d6a7943c896facfafa305a7ed1640d776808c316c2b9227d4bfe44c2b2f5 not found: ID does not exist"
Sep 10 23:48:30.919882 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.919850    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:48:30.922990 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.922967    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-51b15052-5d787cd56f-f5ksc"]
Sep 10 23:48:30.934971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.934944    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:30.938953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:30.938930    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-51b15052-64f8bddd6b-drbmg"]
Sep 10 23:48:32.430036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:32.430000    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" path="/var/lib/kubelet/pods/9cdbed13-2c2b-48cd-9d28-c66d02b1fed2/volumes"
Sep 10 23:48:32.430586 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:32.430566    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc5a02f-d67f-4918-a2ee-98222c60e84a" path="/var/lib/kubelet/pods/adc5a02f-d67f-4918-a2ee-98222c60e84a/volumes"
Sep 10 23:48:33.846453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:33.846418    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:48:33.846896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:48:33.846778    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:49:22.053588 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.053549    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:49:22.056386 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.053847    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" podUID="e4debee3-125d-43f5-ba14-50aa888af347" containerName="maas-api" containerID="cri-o://78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb" gracePeriod=30
Sep 10 23:49:22.111133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.111098    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:49:22.111440 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.111391    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" podUID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" containerName="payload-processing" containerID="cri-o://cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46" gracePeriod=30
Sep 10 23:49:22.117220 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.117193    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:49:22.117451 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.117420    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" podUID="e436772e-853a-434a-b536-7bbf980d02d5" containerName="payload-pre-processing" containerID="cri-o://c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277" gracePeriod=30
Sep 10 23:49:22.392635 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.392607    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:49:22.404339 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.404315    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:49:22.439271 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.439244    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:49:22.466609 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca\") pod \"e4debee3-125d-43f5-ba14-50aa888af347\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") "
Sep 10 23:49:22.466755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466695    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume\") pod \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") "
Sep 10 23:49:22.466755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466735    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs\") pod \"e4debee3-125d-43f5-ba14-50aa888af347\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") "
Sep 10 23:49:22.466878 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466810    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz5kn\" (UniqueName: \"kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn\") pod \"e4debee3-125d-43f5-ba14-50aa888af347\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") "
Sep 10 23:49:22.466878 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466861    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7lgk\" (UniqueName: \"kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk\") pod \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\" (UID: \"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd\") "
Sep 10 23:49:22.466976 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466903    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") pod \"e4debee3-125d-43f5-ba14-50aa888af347\" (UID: \"e4debee3-125d-43f5-ba14-50aa888af347\") "
Sep 10 23:49:22.466976 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.466936    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4debee3-125d-43f5-ba14-50aa888af347" (UID: "e4debee3-125d-43f5-ba14-50aa888af347"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:49:22.467114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.467087    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" (UID: "f1b25a91-94c3-4be7-9c1e-7d9877fa94cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:49:22.468721 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.468690    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.468843 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.468725    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4debee3-125d-43f5-ba14-50aa888af347-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.479266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.472213    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4debee3-125d-43f5-ba14-50aa888af347" (UID: "e4debee3-125d-43f5-ba14-50aa888af347"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:49:22.479534 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.479502    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn" (OuterVolumeSpecName: "kube-api-access-xz5kn") pod "e4debee3-125d-43f5-ba14-50aa888af347" (UID: "e4debee3-125d-43f5-ba14-50aa888af347"). InnerVolumeSpecName "kube-api-access-xz5kn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:22.479649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.479559    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk" (OuterVolumeSpecName: "kube-api-access-s7lgk") pod "f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" (UID: "f1b25a91-94c3-4be7-9c1e-7d9877fa94cd"). InnerVolumeSpecName "kube-api-access-s7lgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:22.481131 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.481103    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4debee3-125d-43f5-ba14-50aa888af347" (UID: "e4debee3-125d-43f5-ba14-50aa888af347"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:49:22.569479 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569440    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxwdf\" (UniqueName: \"kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf\") pod \"e436772e-853a-434a-b536-7bbf980d02d5\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") "
Sep 10 23:49:22.569667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569556    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume\") pod \"e436772e-853a-434a-b536-7bbf980d02d5\" (UID: \"e436772e-853a-434a-b536-7bbf980d02d5\") "
Sep 10 23:49:22.569849 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569834    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.569916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569854    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz5kn\" (UniqueName: \"kubernetes.io/projected/e4debee3-125d-43f5-ba14-50aa888af347-kube-api-access-xz5kn\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.569916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569869    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7lgk\" (UniqueName: \"kubernetes.io/projected/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd-kube-api-access-s7lgk\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.569916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569883    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4debee3-125d-43f5-ba14-50aa888af347-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.569916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.569886    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e436772e-853a-434a-b536-7bbf980d02d5" (UID: "e436772e-853a-434a-b536-7bbf980d02d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:49:22.571493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.571471    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf" (OuterVolumeSpecName: "kube-api-access-kxwdf") pod "e436772e-853a-434a-b536-7bbf980d02d5" (UID: "e436772e-853a-434a-b536-7bbf980d02d5"). InnerVolumeSpecName "kube-api-access-kxwdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:22.670878 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.670842    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxwdf\" (UniqueName: \"kubernetes.io/projected/e436772e-853a-434a-b536-7bbf980d02d5-kube-api-access-kxwdf\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:22.670878 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:22.670874    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e436772e-853a-434a-b536-7bbf980d02d5-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:49:23.166591 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.166554    2566 generic.go:356] "Generic (PLEG): container finished" podID="e4debee3-125d-43f5-ba14-50aa888af347" containerID="78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb" exitCode=0
Sep 10 23:49:23.167048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.166613    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"
Sep 10 23:49:23.167048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.166639    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" event={"ID":"e4debee3-125d-43f5-ba14-50aa888af347","Type":"ContainerDied","Data":"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"}
Sep 10 23:49:23.167048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.166736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k" event={"ID":"e4debee3-125d-43f5-ba14-50aa888af347","Type":"ContainerDied","Data":"100d02719bc1da29b57901b5629bf717874a281b4561d611649051cb378f3a97"}
Sep 10 23:49:23.167048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.166767    2566 scope.go:117] "RemoveContainer" containerID="78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"
Sep 10 23:49:23.168321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.168188    2566 generic.go:356] "Generic (PLEG): container finished" podID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" containerID="cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46" exitCode=0
Sep 10 23:49:23.168321 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.168265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" event={"ID":"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd","Type":"ContainerDied","Data":"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"}
Sep 10 23:49:23.168467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.168335    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc" event={"ID":"f1b25a91-94c3-4be7-9c1e-7d9877fa94cd","Type":"ContainerDied","Data":"960ec89a114afd6f7129e84145b97a114b6507cb268b7b683b37d5d2df4fd264"}
Sep 10 23:49:23.168467 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.168381    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"
Sep 10 23:49:23.176595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.176442    2566 generic.go:356] "Generic (PLEG): container finished" podID="e436772e-853a-434a-b536-7bbf980d02d5" containerID="c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277" exitCode=0
Sep 10 23:49:23.176595 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.176498    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"
Sep 10 23:49:23.176785 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.176589    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" event={"ID":"e436772e-853a-434a-b536-7bbf980d02d5","Type":"ContainerDied","Data":"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"}
Sep 10 23:49:23.176785 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.176643    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw" event={"ID":"e436772e-853a-434a-b536-7bbf980d02d5","Type":"ContainerDied","Data":"4d462ed2f3e1b5d8fdb925b93fb62e6b8ca3b603d353a43a2af2f87a490c9141"}
Sep 10 23:49:23.179637 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.179615    2566 scope.go:117] "RemoveContainer" containerID="78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"
Sep 10 23:49:23.179944 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:49:23.179924    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb\": container with ID starting with 78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb not found: ID does not exist" containerID="78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"
Sep 10 23:49:23.180036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.179950    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb"} err="failed to get container status \"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb\": rpc error: code = NotFound desc = could not find container \"78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb\": container with ID starting with 78079a474263b15bccf3d17c2514ec13ff359748b463bc8a88da34dc640a45bb not found: ID does not exist"
Sep 10 23:49:23.180036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.179966    2566 scope.go:117] "RemoveContainer" containerID="cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"
Sep 10 23:49:23.189098 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.189080    2566 scope.go:117] "RemoveContainer" containerID="cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"
Sep 10 23:49:23.189436 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:49:23.189411    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46\": container with ID starting with cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46 not found: ID does not exist" containerID="cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"
Sep 10 23:49:23.189535 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.189441    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46"} err="failed to get container status \"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46\": rpc error: code = NotFound desc = could not find container \"cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46\": container with ID starting with cfb0f70d70c74bdccf92cf3129ef2b908b2836ed65de5e3aaad4d0a5d3f3ab46 not found: ID does not exist"
Sep 10 23:49:23.189535 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.189465    2566 scope.go:117] "RemoveContainer" containerID="c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"
Sep 10 23:49:23.192504 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.192482    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:49:23.197286 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.197266    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a66ef6-7fcc7b4f9f-vhr5k"]
Sep 10 23:49:23.198692 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.198677    2566 scope.go:117] "RemoveContainer" containerID="c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"
Sep 10 23:49:23.198957 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:49:23.198938    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277\": container with ID starting with c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277 not found: ID does not exist" containerID="c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"
Sep 10 23:49:23.199003 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.198966    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277"} err="failed to get container status \"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277\": rpc error: code = NotFound desc = could not find container \"c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277\": container with ID starting with c68a147634075c48867804cfeb3aa1c271a5b159927e4884a56f3aed752c4277 not found: ID does not exist"
Sep 10 23:49:23.205034 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.205013    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:49:23.207994 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.207973    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a66ef6-7b5b5d9cf4-7ghkw"]
Sep 10 23:49:23.216290 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.216265    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:49:23.219430 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:23.219411    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a66ef6-79b9c88557-d58fc"]
Sep 10 23:49:24.430180 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:24.430149    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e436772e-853a-434a-b536-7bbf980d02d5" path="/var/lib/kubelet/pods/e436772e-853a-434a-b536-7bbf980d02d5/volumes"
Sep 10 23:49:24.430596 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:24.430580    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4debee3-125d-43f5-ba14-50aa888af347" path="/var/lib/kubelet/pods/e4debee3-125d-43f5-ba14-50aa888af347/volumes"
Sep 10 23:49:24.430899 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:49:24.430888    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" path="/var/lib/kubelet/pods/f1b25a91-94c3-4be7-9c1e-7d9877fa94cd/volumes"
Sep 10 23:50:10.243158 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243047    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:10.243808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243751    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc5a02f-d67f-4918-a2ee-98222c60e84a" containerName="payload-pre-processing"
Sep 10 23:50:10.243808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243773    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc5a02f-d67f-4918-a2ee-98222c60e84a" containerName="payload-pre-processing"
Sep 10 23:50:10.243808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243799    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" containerName="maas-api"
Sep 10 23:50:10.243808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243808    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" containerName="maas-api"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243819    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" containerName="payload-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243828    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" containerName="payload-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243856    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4debee3-125d-43f5-ba14-50aa888af347" containerName="maas-api"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243863    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4debee3-125d-43f5-ba14-50aa888af347" containerName="maas-api"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243875    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e436772e-853a-434a-b536-7bbf980d02d5" containerName="payload-pre-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243884    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e436772e-853a-434a-b536-7bbf980d02d5" containerName="payload-pre-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.243988    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4debee3-125d-43f5-ba14-50aa888af347" containerName="maas-api"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.244002    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cdbed13-2c2b-48cd-9d28-c66d02b1fed2" containerName="maas-api"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.244012    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc5a02f-d67f-4918-a2ee-98222c60e84a" containerName="payload-pre-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.244021    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1b25a91-94c3-4be7-9c1e-7d9877fa94cd" containerName="payload-processing"
Sep 10 23:50:10.244067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.244035    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e436772e-853a-434a-b536-7bbf980d02d5" containerName="payload-pre-processing"
Sep 10 23:50:10.247981 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.247956    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.250252 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.250232    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e5eaec01-serving-cert\""
Sep 10 23:50:10.258900 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.258876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:10.401783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.401745    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndl7\" (UniqueName: \"kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.401783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.401784    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.402036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.401892    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.402036 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.401947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.503353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.503263    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.503491 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.503353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.503491 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.503435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndl7\" (UniqueName: \"kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.503491 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.503463    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.504155 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.504126    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.505802 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.505778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.505900 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.505830    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.511875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.511851    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndl7\" (UniqueName: \"kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7\") pod \"maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.562383 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.562360    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:10.836915 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.836887    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:10.839350 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:50:10.839321    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1301c425_5b81_4f5a_8fe6_f6735d1620e4.slice/crio-950936ba354963c46b8c38ceeb46685b8973d7de1a8c2e21f6be2b0b47c42b1a WatchSource:0}: Error finding container 950936ba354963c46b8c38ceeb46685b8973d7de1a8c2e21f6be2b0b47c42b1a: Status 404 returned error can't find the container with id 950936ba354963c46b8c38ceeb46685b8973d7de1a8c2e21f6be2b0b47c42b1a
Sep 10 23:50:10.996849 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:10.996816    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:11.001847 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.001831    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.004492 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.004225    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e5eaec01-dockercfg-kj47h\""
Sep 10 23:50:11.004683 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.004542    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e5eaec01\""
Sep 10 23:50:11.010292 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.010267    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:11.110423 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.110314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdb6k\" (UniqueName: \"kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.110587 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.110449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.211364 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.211330    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdb6k\" (UniqueName: \"kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.211518 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.211414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.212114 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.212085    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.219387 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.219363    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdb6k\" (UniqueName: \"kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k\") pod \"payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") " pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.315282 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.315258    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:11.428318 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.428259    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" event={"ID":"1301c425-5b81-4f5a-8fe6-f6735d1620e4","Type":"ContainerStarted","Data":"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"}
Sep 10 23:50:11.428483 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.428341    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" event={"ID":"1301c425-5b81-4f5a-8fe6-f6735d1620e4","Type":"ContainerStarted","Data":"950936ba354963c46b8c38ceeb46685b8973d7de1a8c2e21f6be2b0b47c42b1a"}
Sep 10 23:50:11.428483 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.428380    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:11.444359 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.444288    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" podStartSLOduration=1.005036005 podStartE2EDuration="1.444272214s" totalImagesPullingTime="439.236209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:11.442953377 +0000 UTC m=+997.547240200" watchObservedRunningTime="2026-09-10 23:50:11.444272214 +0000 UTC m=+997.548559030"
Sep 10 23:50:11.588531 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:11.588487    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:11.590728 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:50:11.590700    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfe9194_5bfb_4956_a49a_8dbd39512314.slice/crio-735ca3a98adf7cc27370e0f6d7b4cece5545e6df7dca73f607da5fc01d6bdc06 WatchSource:0}: Error finding container 735ca3a98adf7cc27370e0f6d7b4cece5545e6df7dca73f607da5fc01d6bdc06: Status 404 returned error can't find the container with id 735ca3a98adf7cc27370e0f6d7b4cece5545e6df7dca73f607da5fc01d6bdc06
Sep 10 23:50:12.435136 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:12.435099    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" event={"ID":"4dfe9194-5bfb-4956-a49a-8dbd39512314","Type":"ContainerStarted","Data":"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"}
Sep 10 23:50:12.435638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:12.435151    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" event={"ID":"4dfe9194-5bfb-4956-a49a-8dbd39512314","Type":"ContainerStarted","Data":"735ca3a98adf7cc27370e0f6d7b4cece5545e6df7dca73f607da5fc01d6bdc06"}
Sep 10 23:50:12.435638 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:12.435338    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:12.450134 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:12.450080    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" podStartSLOduration=2.450061326 podStartE2EDuration="2.450061326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:12.448884289 +0000 UTC m=+998.553171103" watchObservedRunningTime="2026-09-10 23:50:12.450061326 +0000 UTC m=+998.554348121"
Sep 10 23:50:16.436593 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.436557    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:50:16.437163 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.436763    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" podUID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" containerName="maas-api" containerID="cri-o://6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a" gracePeriod=30
Sep 10 23:50:16.485506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.485474    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:50:16.485717 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.485679    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" podUID="67cdaa3e-daf9-4297-b8e7-4afced529baa" containerName="payload-pre-processing" containerID="cri-o://29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179" gracePeriod=30
Sep 10 23:50:16.740797 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.740771    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:50:16.770345 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.770317    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:50:16.864513 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864480    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq7sv\" (UniqueName: \"kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv\") pod \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") "
Sep 10 23:50:16.864661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864521    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca\") pod \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") "
Sep 10 23:50:16.864661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864574    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume\") pod \"67cdaa3e-daf9-4297-b8e7-4afced529baa\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") "
Sep 10 23:50:16.864661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864597    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7m9j\" (UniqueName: \"kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j\") pod \"67cdaa3e-daf9-4297-b8e7-4afced529baa\" (UID: \"67cdaa3e-daf9-4297-b8e7-4afced529baa\") "
Sep 10 23:50:16.864661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864635    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs\") pod \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") "
Sep 10 23:50:16.864865 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864687    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") pod \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\" (UID: \"edb744e7-8c30-49b5-ab99-7f9c187c1ed3\") "
Sep 10 23:50:16.864987 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864958    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edb744e7-8c30-49b5-ab99-7f9c187c1ed3" (UID: "edb744e7-8c30-49b5-ab99-7f9c187c1ed3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:16.865078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.864989    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67cdaa3e-daf9-4297-b8e7-4afced529baa" (UID: "67cdaa3e-daf9-4297-b8e7-4afced529baa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:16.866750 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.866726    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j" (OuterVolumeSpecName: "kube-api-access-n7m9j") pod "67cdaa3e-daf9-4297-b8e7-4afced529baa" (UID: "67cdaa3e-daf9-4297-b8e7-4afced529baa"). InnerVolumeSpecName "kube-api-access-n7m9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:16.866867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.866767    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edb744e7-8c30-49b5-ab99-7f9c187c1ed3" (UID: "edb744e7-8c30-49b5-ab99-7f9c187c1ed3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:16.866867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.866781    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "edb744e7-8c30-49b5-ab99-7f9c187c1ed3" (UID: "edb744e7-8c30-49b5-ab99-7f9c187c1ed3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:16.866867 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.866780    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv" (OuterVolumeSpecName: "kube-api-access-mq7sv") pod "edb744e7-8c30-49b5-ab99-7f9c187c1ed3" (UID: "edb744e7-8c30-49b5-ab99-7f9c187c1ed3"). InnerVolumeSpecName "kube-api-access-mq7sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:16.965549 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965513    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq7sv\" (UniqueName: \"kubernetes.io/projected/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-kube-api-access-mq7sv\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:16.965549 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965543    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:16.965730 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965556    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67cdaa3e-daf9-4297-b8e7-4afced529baa-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:16.965730 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965568    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7m9j\" (UniqueName: \"kubernetes.io/projected/67cdaa3e-daf9-4297-b8e7-4afced529baa-kube-api-access-n7m9j\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:16.965730 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965582    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:16.965730 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:16.965594    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edb744e7-8c30-49b5-ab99-7f9c187c1ed3-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:17.441268 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.441238    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:17.465472 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.465439    2566 generic.go:356] "Generic (PLEG): container finished" podID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" containerID="6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a" exitCode=0
Sep 10 23:50:17.465644 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.465506    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"
Sep 10 23:50:17.465644 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.465530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" event={"ID":"edb744e7-8c30-49b5-ab99-7f9c187c1ed3","Type":"ContainerDied","Data":"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"}
Sep 10 23:50:17.465644 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.465597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7" event={"ID":"edb744e7-8c30-49b5-ab99-7f9c187c1ed3","Type":"ContainerDied","Data":"5157457e3e6db949eb4eda1acc97af1b5c331ff08a4da6b78b342679b11bf20b"}
Sep 10 23:50:17.466030 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.465629    2566 scope.go:117] "RemoveContainer" containerID="6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"
Sep 10 23:50:17.467931 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.467910    2566 generic.go:356] "Generic (PLEG): container finished" podID="67cdaa3e-daf9-4297-b8e7-4afced529baa" containerID="29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179" exitCode=0
Sep 10 23:50:17.468116 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.467942    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" event={"ID":"67cdaa3e-daf9-4297-b8e7-4afced529baa","Type":"ContainerDied","Data":"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"}
Sep 10 23:50:17.468238 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.468149    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554" event={"ID":"67cdaa3e-daf9-4297-b8e7-4afced529baa","Type":"ContainerDied","Data":"82bcd86d8d09cea56c7439691b5e0b0f4ed2df00163e0d9bea0b2ba54586cc91"}
Sep 10 23:50:17.468238 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.467983    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"
Sep 10 23:50:17.479783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.479737    2566 scope.go:117] "RemoveContainer" containerID="6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"
Sep 10 23:50:17.480191 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:17.480160    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a\": container with ID starting with 6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a not found: ID does not exist" containerID="6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"
Sep 10 23:50:17.480327 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.480203    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a"} err="failed to get container status \"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a\": rpc error: code = NotFound desc = could not find container \"6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a\": container with ID starting with 6de6bee3dddcd22d72d13cb7d36be25e21e6d0bb075e469077544b1c37dd925a not found: ID does not exist"
Sep 10 23:50:17.480327 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.480228    2566 scope.go:117] "RemoveContainer" containerID="29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"
Sep 10 23:50:17.492606 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.492584    2566 scope.go:117] "RemoveContainer" containerID="29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"
Sep 10 23:50:17.497979 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:17.497948    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179\": container with ID starting with 29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179 not found: ID does not exist" containerID="29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"
Sep 10 23:50:17.498096 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.497989    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179"} err="failed to get container status \"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179\": rpc error: code = NotFound desc = could not find container \"29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179\": container with ID starting with 29b167d96baa755ae0aa842c229187a863df1e8c532a5d402def47554fc12179 not found: ID does not exist"
Sep 10 23:50:17.500990 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.500937    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:50:17.503411 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.503389    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-487960-794c8769b6-96554"]
Sep 10 23:50:17.513584 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.513560    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:50:17.516172 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:17.516150    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-487960-58f75df4-jkwv7"]
Sep 10 23:50:18.429351 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:18.429320    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cdaa3e-daf9-4297-b8e7-4afced529baa" path="/var/lib/kubelet/pods/67cdaa3e-daf9-4297-b8e7-4afced529baa/volumes"
Sep 10 23:50:18.429710 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:18.429697    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" path="/var/lib/kubelet/pods/edb744e7-8c30-49b5-ab99-7f9c187c1ed3/volumes"
Sep 10 23:50:23.441808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:23.441781    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:34.103639 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.103600    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:50:34.104125 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.103890    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" podUID="ef129237-e2ab-4485-b69a-aa4fa307fc47" containerName="maas-api" containerID="cri-o://8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7" gracePeriod=30
Sep 10 23:50:34.157125 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.157092    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:50:34.157382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.157350    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" podUID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" containerName="payload-pre-processing" containerID="cri-o://207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942" gracePeriod=30
Sep 10 23:50:34.447803 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.447522    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:50:34.529875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.529851    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dqbr\" (UniqueName: \"kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr\") pod \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") "
Sep 10 23:50:34.529979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.529886    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume\") pod \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\" (UID: \"a1919de2-1010-49b2-ad77-a13f6d5d80e0\") "
Sep 10 23:50:34.530285 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.530258    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1919de2-1010-49b2-ad77-a13f6d5d80e0" (UID: "a1919de2-1010-49b2-ad77-a13f6d5d80e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:34.533383 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.533359    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr" (OuterVolumeSpecName: "kube-api-access-2dqbr") pod "a1919de2-1010-49b2-ad77-a13f6d5d80e0" (UID: "a1919de2-1010-49b2-ad77-a13f6d5d80e0"). InnerVolumeSpecName "kube-api-access-2dqbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:34.560306 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.560274    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:50:34.561153 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.561129    2566 generic.go:356] "Generic (PLEG): container finished" podID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" containerID="207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942" exitCode=0
Sep 10 23:50:34.561224 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.561165    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"
Sep 10 23:50:34.561268 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.561210    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" event={"ID":"a1919de2-1010-49b2-ad77-a13f6d5d80e0","Type":"ContainerDied","Data":"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"}
Sep 10 23:50:34.561268 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.561264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn" event={"ID":"a1919de2-1010-49b2-ad77-a13f6d5d80e0","Type":"ContainerDied","Data":"0b1d6cb099011e7ecacbb6206f569ccce2c4d9a94dec9c7f39b3c82e03d59811"}
Sep 10 23:50:34.561390 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.561280    2566 scope.go:117] "RemoveContainer" containerID="207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"
Sep 10 23:50:34.562668 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.562648    2566 generic.go:356] "Generic (PLEG): container finished" podID="ef129237-e2ab-4485-b69a-aa4fa307fc47" containerID="8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7" exitCode=0
Sep 10 23:50:34.562753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.562695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" event={"ID":"ef129237-e2ab-4485-b69a-aa4fa307fc47","Type":"ContainerDied","Data":"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"}
Sep 10 23:50:34.562753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.562732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p" event={"ID":"ef129237-e2ab-4485-b69a-aa4fa307fc47","Type":"ContainerDied","Data":"8d67c9ececa9a5f1e763ff3360652dbc4f3cd1f5566c7d9cf8869d8e94e92f3f"}
Sep 10 23:50:34.562840 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.562749    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"
Sep 10 23:50:34.569759 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.569739    2566 scope.go:117] "RemoveContainer" containerID="207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"
Sep 10 23:50:34.570014 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:34.569997    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942\": container with ID starting with 207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942 not found: ID does not exist" containerID="207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"
Sep 10 23:50:34.570075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.570020    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942"} err="failed to get container status \"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942\": rpc error: code = NotFound desc = could not find container \"207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942\": container with ID starting with 207d399d711268afd843c8bec04587b2c267e33365e03a72234ae665743bb942 not found: ID does not exist"
Sep 10 23:50:34.570075 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.570036    2566 scope.go:117] "RemoveContainer" containerID="8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"
Sep 10 23:50:34.578674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.578654    2566 scope.go:117] "RemoveContainer" containerID="8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"
Sep 10 23:50:34.579003 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:34.578975    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7\": container with ID starting with 8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7 not found: ID does not exist" containerID="8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"
Sep 10 23:50:34.579074 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.579012    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7"} err="failed to get container status \"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7\": rpc error: code = NotFound desc = could not find container \"8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7\": container with ID starting with 8593d52fc2cbdf8ace12e9119aa6ddccdfe6dcfde41b34e41d8cca89ab32a0a7 not found: ID does not exist"
Sep 10 23:50:34.589104 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.589078    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:50:34.593247 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.593224    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ea66ce-6ffcd6c9f8-kdfdn"]
Sep 10 23:50:34.630496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630425    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74c52\" (UniqueName: \"kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52\") pod \"ef129237-e2ab-4485-b69a-aa4fa307fc47\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") "
Sep 10 23:50:34.630496 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630474    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") pod \"ef129237-e2ab-4485-b69a-aa4fa307fc47\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") "
Sep 10 23:50:34.630674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630565    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca\") pod \"ef129237-e2ab-4485-b69a-aa4fa307fc47\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") "
Sep 10 23:50:34.630674 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630612    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs\") pod \"ef129237-e2ab-4485-b69a-aa4fa307fc47\" (UID: \"ef129237-e2ab-4485-b69a-aa4fa307fc47\") "
Sep 10 23:50:34.631080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630972    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dqbr\" (UniqueName: \"kubernetes.io/projected/a1919de2-1010-49b2-ad77-a13f6d5d80e0-kube-api-access-2dqbr\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.631080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630985    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef129237-e2ab-4485-b69a-aa4fa307fc47" (UID: "ef129237-e2ab-4485-b69a-aa4fa307fc47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:34.631080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.630996    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1919de2-1010-49b2-ad77-a13f6d5d80e0-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.632714 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.632687    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52" (OuterVolumeSpecName: "kube-api-access-74c52") pod "ef129237-e2ab-4485-b69a-aa4fa307fc47" (UID: "ef129237-e2ab-4485-b69a-aa4fa307fc47"). InnerVolumeSpecName "kube-api-access-74c52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:34.632821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.632768    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef129237-e2ab-4485-b69a-aa4fa307fc47" (UID: "ef129237-e2ab-4485-b69a-aa4fa307fc47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:34.632821 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.632812    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef129237-e2ab-4485-b69a-aa4fa307fc47" (UID: "ef129237-e2ab-4485-b69a-aa4fa307fc47"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:34.732532 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.732499    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.732532 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.732526    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74c52\" (UniqueName: \"kubernetes.io/projected/ef129237-e2ab-4485-b69a-aa4fa307fc47-kube-api-access-74c52\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.732532 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.732538    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef129237-e2ab-4485-b69a-aa4fa307fc47-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.732773 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.732546    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef129237-e2ab-4485-b69a-aa4fa307fc47-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:34.885512 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.885438    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:50:34.887325 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:34.887276    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea66ce-6875475c4c-j5n7p"]
Sep 10 23:50:36.430185 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:36.430156    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" path="/var/lib/kubelet/pods/a1919de2-1010-49b2-ad77-a13f6d5d80e0/volumes"
Sep 10 23:50:36.430628 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:36.430612    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef129237-e2ab-4485-b69a-aa4fa307fc47" path="/var/lib/kubelet/pods/ef129237-e2ab-4485-b69a-aa4fa307fc47/volumes"
Sep 10 23:50:45.615410 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615377    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 10 23:50:45.615903 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615855    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" containerName="maas-api"
Sep 10 23:50:45.615903 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615876    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" containerName="maas-api"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615929    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cdaa3e-daf9-4297-b8e7-4afced529baa" containerName="payload-pre-processing"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615939    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cdaa3e-daf9-4297-b8e7-4afced529baa" containerName="payload-pre-processing"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615953    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" containerName="payload-pre-processing"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615962    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" containerName="payload-pre-processing"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615983    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef129237-e2ab-4485-b69a-aa4fa307fc47" containerName="maas-api"
Sep 10 23:50:45.616051 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.615991    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef129237-e2ab-4485-b69a-aa4fa307fc47" containerName="maas-api"
Sep 10 23:50:45.616397 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.616104    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef129237-e2ab-4485-b69a-aa4fa307fc47" containerName="maas-api"
Sep 10 23:50:45.616397 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.616117    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb744e7-8c30-49b5-ab99-7f9c187c1ed3" containerName="maas-api"
Sep 10 23:50:45.616397 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.616129    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1919de2-1010-49b2-ad77-a13f6d5d80e0" containerName="payload-pre-processing"
Sep 10 23:50:45.616397 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.616138    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cdaa3e-daf9-4297-b8e7-4afced529baa" containerName="payload-pre-processing"
Sep 10 23:50:45.621095 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.621073    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.623870 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.623848    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-0b637b-serving-cert\""
Sep 10 23:50:45.633230 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.633119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 10 23:50:45.738670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.738634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.738670 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.738677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.738880 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.738720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8vj\" (UniqueName: \"kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.738880 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.738763    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.840266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.840223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.840266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.840270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.840493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.840331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8vj\" (UniqueName: \"kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.840493 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.840374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.840493 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:45.840412    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-serving-cert: secret "maas-api-e2e-shared-a-w3-0b637b-serving-cert" not found
Sep 10 23:50:45.840593 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:45.840521    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls podName:4b8ca6a5-2ded-418b-a710-750de3983fec nodeName:}" failed. No retries permitted until 2026-09-10 23:50:46.340499031 +0000 UTC m=+1032.444785826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls") pod "maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" (UID: "4b8ca6a5-2ded-418b-a710-750de3983fec") : secret "maas-api-e2e-shared-a-w3-0b637b-serving-cert" not found
Sep 10 23:50:45.840981 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.840964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.842892 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.842860    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:45.848911 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:45.848887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8vj\" (UniqueName: \"kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:46.345375 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:46.345336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:46.348031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:46.347995    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:46.532341 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:46.532280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:46.808540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:46.808512    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 10 23:50:46.810612 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:50:46.810586    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8ca6a5_2ded_418b_a710_750de3983fec.slice/crio-2f7280586cf248ca0ff68c282a6748cdfd5bfec2cd7c2bc0ad49d4d3b3576cc2 WatchSource:0}: Error finding container 2f7280586cf248ca0ff68c282a6748cdfd5bfec2cd7c2bc0ad49d4d3b3576cc2: Status 404 returned error can't find the container with id 2f7280586cf248ca0ff68c282a6748cdfd5bfec2cd7c2bc0ad49d4d3b3576cc2
Sep 10 23:50:47.632466 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:47.632374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" event={"ID":"4b8ca6a5-2ded-418b-a710-750de3983fec","Type":"ContainerStarted","Data":"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"}
Sep 10 23:50:47.632466 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:47.632433    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" event={"ID":"4b8ca6a5-2ded-418b-a710-750de3983fec","Type":"ContainerStarted","Data":"2f7280586cf248ca0ff68c282a6748cdfd5bfec2cd7c2bc0ad49d4d3b3576cc2"}
Sep 10 23:50:47.632825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:47.632477    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:47.648592 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:47.648542    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" podStartSLOduration=2.302726 podStartE2EDuration="2.648523866s" totalImagesPullingTime="345.797866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:47.64765293 +0000 UTC m=+1033.751939758" watchObservedRunningTime="2026-09-10 23:50:47.648523866 +0000 UTC m=+1033.752810660"
Sep 10 23:50:52.215712 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.215678    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:52.216146 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.215895    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerName="maas-api" containerID="cri-o://89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6" gracePeriod=30
Sep 10 23:50:52.271565 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.271526    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:52.272094 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.272059    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" podUID="4dfe9194-5bfb-4956-a49a-8dbd39512314" containerName="payload-processing" containerID="cri-o://671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d" gracePeriod=30
Sep 10 23:50:52.521768 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.521741    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:52.561755 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.561732    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:52.607524 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.607482    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wndl7\" (UniqueName: \"kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7\") pod \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") "
Sep 10 23:50:52.607524 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.607521    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs\") pod \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") "
Sep 10 23:50:52.608258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.607544    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca\") pod \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") "
Sep 10 23:50:52.608258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.607672    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls\") pod \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\" (UID: \"1301c425-5b81-4f5a-8fe6-f6735d1620e4\") "
Sep 10 23:50:52.608258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.607887    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1301c425-5b81-4f5a-8fe6-f6735d1620e4" (UID: "1301c425-5b81-4f5a-8fe6-f6735d1620e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:52.608258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.608079    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1301c425-5b81-4f5a-8fe6-f6735d1620e4-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.609714 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.609690    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1301c425-5b81-4f5a-8fe6-f6735d1620e4" (UID: "1301c425-5b81-4f5a-8fe6-f6735d1620e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:52.609858 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.609842    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1301c425-5b81-4f5a-8fe6-f6735d1620e4" (UID: "1301c425-5b81-4f5a-8fe6-f6735d1620e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:50:52.609951 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.609862    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7" (OuterVolumeSpecName: "kube-api-access-wndl7") pod "1301c425-5b81-4f5a-8fe6-f6735d1620e4" (UID: "1301c425-5b81-4f5a-8fe6-f6735d1620e4"). InnerVolumeSpecName "kube-api-access-wndl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:52.659964 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.659936    2566 generic.go:356] "Generic (PLEG): container finished" podID="4dfe9194-5bfb-4956-a49a-8dbd39512314" containerID="671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d" exitCode=0
Sep 10 23:50:52.660103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.659993    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"
Sep 10 23:50:52.660103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.660015    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" event={"ID":"4dfe9194-5bfb-4956-a49a-8dbd39512314","Type":"ContainerDied","Data":"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"}
Sep 10 23:50:52.660103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.660065    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk" event={"ID":"4dfe9194-5bfb-4956-a49a-8dbd39512314","Type":"ContainerDied","Data":"735ca3a98adf7cc27370e0f6d7b4cece5545e6df7dca73f607da5fc01d6bdc06"}
Sep 10 23:50:52.660103 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.660085    2566 scope.go:117] "RemoveContainer" containerID="671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"
Sep 10 23:50:52.661477 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.661453    2566 generic.go:356] "Generic (PLEG): container finished" podID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerID="89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6" exitCode=0
Sep 10 23:50:52.661599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.661500    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"
Sep 10 23:50:52.661599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.661509    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" event={"ID":"1301c425-5b81-4f5a-8fe6-f6735d1620e4","Type":"ContainerDied","Data":"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"}
Sep 10 23:50:52.661599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.661541    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" event={"ID":"1301c425-5b81-4f5a-8fe6-f6735d1620e4","Type":"ContainerDied","Data":"950936ba354963c46b8c38ceeb46685b8973d7de1a8c2e21f6be2b0b47c42b1a"}
Sep 10 23:50:52.668829 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.668757    2566 scope.go:117] "RemoveContainer" containerID="671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"
Sep 10 23:50:52.669161 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:52.669122    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d\": container with ID starting with 671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d not found: ID does not exist" containerID="671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"
Sep 10 23:50:52.669274 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.669158    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d"} err="failed to get container status \"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d\": rpc error: code = NotFound desc = could not find container \"671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d\": container with ID starting with 671a0004964bbee823d2194a5d4d8691a0ed746aeb3c0af0de32196f85d6545d not found: ID does not exist"
Sep 10 23:50:52.669274 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.669180    2566 scope.go:117] "RemoveContainer" containerID="89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"
Sep 10 23:50:52.677184 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.677152    2566 scope.go:117] "RemoveContainer" containerID="89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"
Sep 10 23:50:52.677464 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:50:52.677444    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6\": container with ID starting with 89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6 not found: ID does not exist" containerID="89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"
Sep 10 23:50:52.677540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.677469    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6"} err="failed to get container status \"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6\": rpc error: code = NotFound desc = could not find container \"89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6\": container with ID starting with 89f218a97caa7417f267e20b4e4931296b3e64208f843034d80e849c8cc131c6 not found: ID does not exist"
Sep 10 23:50:52.699980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.699960    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:52.702789 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.702762    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9"]
Sep 10 23:50:52.708862 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.708842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdb6k\" (UniqueName: \"kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k\") pod \"4dfe9194-5bfb-4956-a49a-8dbd39512314\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") "
Sep 10 23:50:52.708960 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.708879    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume\") pod \"4dfe9194-5bfb-4956-a49a-8dbd39512314\" (UID: \"4dfe9194-5bfb-4956-a49a-8dbd39512314\") "
Sep 10 23:50:52.709144 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.709127    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.709216 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.709148    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wndl7\" (UniqueName: \"kubernetes.io/projected/1301c425-5b81-4f5a-8fe6-f6735d1620e4-kube-api-access-wndl7\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.709216 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.709162    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1301c425-5b81-4f5a-8fe6-f6735d1620e4-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.709310 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.709210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4dfe9194-5bfb-4956-a49a-8dbd39512314" (UID: "4dfe9194-5bfb-4956-a49a-8dbd39512314"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:52.710656 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.710636    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k" (OuterVolumeSpecName: "kube-api-access-xdb6k") pod "4dfe9194-5bfb-4956-a49a-8dbd39512314" (UID: "4dfe9194-5bfb-4956-a49a-8dbd39512314"). InnerVolumeSpecName "kube-api-access-xdb6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:52.810482 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.810413    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdb6k\" (UniqueName: \"kubernetes.io/projected/4dfe9194-5bfb-4956-a49a-8dbd39512314-kube-api-access-xdb6k\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.810482 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.810439    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dfe9194-5bfb-4956-a49a-8dbd39512314-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:50:52.982367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.982336    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:52.985219 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:52.985192    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e5eaec01-8cc956585-9j4xk"]
Sep 10 23:50:53.642981 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:53.642903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 10 23:50:54.430110 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:54.430067    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" path="/var/lib/kubelet/pods/1301c425-5b81-4f5a-8fe6-f6735d1620e4/volumes"
Sep 10 23:50:54.430555 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:54.430533    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dfe9194-5bfb-4956-a49a-8dbd39512314" path="/var/lib/kubelet/pods/4dfe9194-5bfb-4956-a49a-8dbd39512314/volumes"
Sep 10 23:50:55.436600 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:50:55.436557    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e5eaec01-69cf8b76bf-5x7b9" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.55:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:51:13.824268 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824222    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 10 23:51:13.824848 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824831    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerName="maas-api"
Sep 10 23:51:13.824893 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824852    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerName="maas-api"
Sep 10 23:51:13.824893 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824878    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dfe9194-5bfb-4956-a49a-8dbd39512314" containerName="payload-processing"
Sep 10 23:51:13.824893 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824887    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dfe9194-5bfb-4956-a49a-8dbd39512314" containerName="payload-processing"
Sep 10 23:51:13.824986 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824968    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1301c425-5b81-4f5a-8fe6-f6735d1620e4" containerName="maas-api"
Sep 10 23:51:13.824986 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.824978    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dfe9194-5bfb-4956-a49a-8dbd39512314" containerName="payload-processing"
Sep 10 23:51:13.828673 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.828651    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.830905 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.830882    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-6d2e31-serving-cert\""
Sep 10 23:51:13.838935 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.838901    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 10 23:51:13.891386 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.891353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.891570 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.891400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlrv9\" (UniqueName: \"kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.891570 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.891496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.891644 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.891580    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.992807 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.992767    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.992979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.992828    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.992979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.992868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.992979 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.992889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlrv9\" (UniqueName: \"kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.993089 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:13.993008    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-serving-cert: secret "maas-api-e2e-shared-b-w3-6d2e31-serving-cert" not found
Sep 10 23:51:13.993121 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:13.993093    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls podName:f0529d09-e468-4a2a-b1b1-7289ae552adf nodeName:}" failed. No retries permitted until 2026-09-10 23:51:14.493071088 +0000 UTC m=+1060.597357864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls") pod "maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" (UID: "f0529d09-e468-4a2a-b1b1-7289ae552adf") : secret "maas-api-e2e-shared-b-w3-6d2e31-serving-cert" not found
Sep 10 23:51:13.993550 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.993524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:13.995260 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:13.995235    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:14.001060 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.001035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlrv9\" (UniqueName: \"kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:14.498957 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.498925    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:14.501345 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.501312    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:14.542003 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.541971    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 10 23:51:14.546025 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.546000    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.548667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.548639    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-6d2e31\""
Sep 10 23:51:14.548667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.548654    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-6d2e31-dockercfg-sl8bq\""
Sep 10 23:51:14.558119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.558096    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 10 23:51:14.566971 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.566941    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 10 23:51:14.571173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.571148    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.585491 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.585464    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 10 23:51:14.600045 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.600016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.600198 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.600054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.600198 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.600131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwv5n\" (UniqueName: \"kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.600198 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.600179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45rf\" (UniqueName: \"kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.701705 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.701669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45rf\" (UniqueName: \"kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.701879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.701761    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.701879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.701795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.701879 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.701845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwv5n\" (UniqueName: \"kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.702567 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.702543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.702696 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.702673    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.709823 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.709786    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwv5n\" (UniqueName: \"kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n\") pod \"payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.710048 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.710026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45rf\" (UniqueName: \"kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf\") pod \"payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:14.740963 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.740933    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:14.859634 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.859590    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:14.883888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:14.883860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:15.018714 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.018689    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 10 23:51:15.021035 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:15.020998    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0529d09_e468_4a2a_b1b1_7289ae552adf.slice/crio-1ec852ed7329739060662b491eaa72e85db603fd1bf53ef4c6812563e8fccc3f WatchSource:0}: Error finding container 1ec852ed7329739060662b491eaa72e85db603fd1bf53ef4c6812563e8fccc3f: Status 404 returned error can't find the container with id 1ec852ed7329739060662b491eaa72e85db603fd1bf53ef4c6812563e8fccc3f
Sep 10 23:51:15.022552 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.022530    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:51:15.129863 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.129834    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 10 23:51:15.132103 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:15.132071    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0f8fa5_5677_40e3_ba8a_6b3efb5b01a9.slice/crio-b8e4780b62f9f6a1e6e00b0f2a506fbfdea7c09bf70c32bc3dc64984411320f4 WatchSource:0}: Error finding container b8e4780b62f9f6a1e6e00b0f2a506fbfdea7c09bf70c32bc3dc64984411320f4: Status 404 returned error can't find the container with id b8e4780b62f9f6a1e6e00b0f2a506fbfdea7c09bf70c32bc3dc64984411320f4
Sep 10 23:51:15.162049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.162024    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 10 23:51:15.174560 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:15.174532    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db438ec_b152_478f_97a3_1106517c8945.slice/crio-5e439edef3294b30bf6de9e4f7148c6e68eb925486a0c493fffd683b9a0adc4a WatchSource:0}: Error finding container 5e439edef3294b30bf6de9e4f7148c6e68eb925486a0c493fffd683b9a0adc4a: Status 404 returned error can't find the container with id 5e439edef3294b30bf6de9e4f7148c6e68eb925486a0c493fffd683b9a0adc4a
Sep 10 23:51:15.786594 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.786481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" event={"ID":"6db438ec-b152-478f-97a3-1106517c8945","Type":"ContainerStarted","Data":"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"}
Sep 10 23:51:15.786800 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.786657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:15.786800 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.786703    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" event={"ID":"6db438ec-b152-478f-97a3-1106517c8945","Type":"ContainerStarted","Data":"5e439edef3294b30bf6de9e4f7148c6e68eb925486a0c493fffd683b9a0adc4a"}
Sep 10 23:51:15.788243 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.788219    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" event={"ID":"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9","Type":"ContainerStarted","Data":"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"}
Sep 10 23:51:15.788382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.788267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" event={"ID":"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9","Type":"ContainerStarted","Data":"b8e4780b62f9f6a1e6e00b0f2a506fbfdea7c09bf70c32bc3dc64984411320f4"}
Sep 10 23:51:15.788382 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.788314    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:15.789898 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.789874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" event={"ID":"f0529d09-e468-4a2a-b1b1-7289ae552adf","Type":"ContainerStarted","Data":"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"}
Sep 10 23:51:15.790016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.789913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" event={"ID":"f0529d09-e468-4a2a-b1b1-7289ae552adf","Type":"ContainerStarted","Data":"1ec852ed7329739060662b491eaa72e85db603fd1bf53ef4c6812563e8fccc3f"}
Sep 10 23:51:15.790079 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.790019    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:15.826691 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.826638    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" podStartSLOduration=1.826622457 podStartE2EDuration="1.826622457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:15.824752342 +0000 UTC m=+1061.929039175" watchObservedRunningTime="2026-09-10 23:51:15.826622457 +0000 UTC m=+1061.930909250"
Sep 10 23:51:15.859771 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.859711    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" podStartSLOduration=2.482366164 podStartE2EDuration="2.859692887s" totalImagesPullingTime="377.326723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:15.855178696 +0000 UTC m=+1061.959465510" watchObservedRunningTime="2026-09-10 23:51:15.859692887 +0000 UTC m=+1061.963979681"
Sep 10 23:51:15.879988 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:15.879926    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" podStartSLOduration=1.8799024069999999 podStartE2EDuration="1.879902407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:15.879108688 +0000 UTC m=+1061.983395510" watchObservedRunningTime="2026-09-10 23:51:15.879902407 +0000 UTC m=+1061.984189207"
Sep 10 23:51:16.893174 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.893138    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:51:16.897633 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.897606    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:16.899896 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.899871    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4e0933-serving-cert\""
Sep 10 23:51:16.908150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.908121    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:51:16.921441 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.921404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsnqs\" (UniqueName: \"kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:16.921628 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.921464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:16.921628 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.921538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:16.921628 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:16.921584    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.022469 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.022434    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.022649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.022520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsnqs\" (UniqueName: \"kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.022649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.022563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.022649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.022611    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.022812 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:17.022792    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-serving-cert: secret "maas-api-e2e-shared-a-w2-4e0933-serving-cert" not found
Sep 10 23:51:17.022887 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:17.022876    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls podName:32d50fd5-98ba-4771-b23a-e5fdb1d125d5 nodeName:}" failed. No retries permitted until 2026-09-10 23:51:17.5228574 +0000 UTC m=+1063.627144180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" (UID: "32d50fd5-98ba-4771-b23a-e5fdb1d125d5") : secret "maas-api-e2e-shared-a-w2-4e0933-serving-cert" not found
Sep 10 23:51:17.023340 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.023320    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.024989 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.024969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.030970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.030946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsnqs\" (UniqueName: \"kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.527250 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.527197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.529667 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.529641    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:17.812179 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:17.812090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:18.087597 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:18.087572    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:51:18.089941 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:18.089911    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d50fd5_98ba_4771_b23a_e5fdb1d125d5.slice/crio-df815e24dd45da5deae2033fbbd86a8b8f2818f1f663d47a50619e0707883a47 WatchSource:0}: Error finding container df815e24dd45da5deae2033fbbd86a8b8f2818f1f663d47a50619e0707883a47: Status 404 returned error can't find the container with id df815e24dd45da5deae2033fbbd86a8b8f2818f1f663d47a50619e0707883a47
Sep 10 23:51:18.807772 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:18.807691    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" event={"ID":"32d50fd5-98ba-4771-b23a-e5fdb1d125d5","Type":"ContainerStarted","Data":"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"}
Sep 10 23:51:18.807772 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:18.807756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" event={"ID":"32d50fd5-98ba-4771-b23a-e5fdb1d125d5","Type":"ContainerStarted","Data":"df815e24dd45da5deae2033fbbd86a8b8f2818f1f663d47a50619e0707883a47"}
Sep 10 23:51:18.808017 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:18.807780    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:18.824117 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:18.824072    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" podStartSLOduration=2.468251982 podStartE2EDuration="2.82405733s" totalImagesPullingTime="355.805348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:18.82246656 +0000 UTC m=+1064.926753383" watchObservedRunningTime="2026-09-10 23:51:18.82405733 +0000 UTC m=+1064.928344124"
Sep 10 23:51:21.801056 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:21.801023    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 10 23:51:24.817779 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:24.817750    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:51:26.797807 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:26.797777    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 10 23:51:26.798221 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:26.798042    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 10 23:51:45.021770 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.021738    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:51:45.027260 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.027240    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.030160 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.030138    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-57be92-serving-cert\""
Sep 10 23:51:45.036542 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.036517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:51:45.179488 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.179449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.179488 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.179488    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.179744 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.179605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.179744 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.179737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfzq\" (UniqueName: \"kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.281054 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.280968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfzq\" (UniqueName: \"kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.281054 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.281011    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.281054 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.281030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.281272 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.281067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.281272 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:45.281128    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-serving-cert: secret "maas-api-e2e-shared-b-w2-57be92-serving-cert" not found
Sep 10 23:51:45.281272 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:51:45.281207    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls podName:ea1a1d17-52bc-4644-94cb-9ae89eb0627b nodeName:}" failed. No retries permitted until 2026-09-10 23:51:45.781188207 +0000 UTC m=+1091.885475003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls") pod "maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" (UID: "ea1a1d17-52bc-4644-94cb-9ae89eb0627b") : secret "maas-api-e2e-shared-b-w2-57be92-serving-cert" not found
Sep 10 23:51:45.281812 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.281790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.283648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.283627    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.291453 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.291433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfzq\" (UniqueName: \"kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.678049 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.678006    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:51:45.681875 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.681849    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.684270 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.684245    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-57be92-dockercfg-2xzdb\""
Sep 10 23:51:45.684410 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.684340    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-57be92\""
Sep 10 23:51:45.696420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.696399    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:51:45.785173 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.785143    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24w8\" (UniqueName: \"kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.785368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.785205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.785368 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.785232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.787679 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.787649    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.886558 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.886530    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.886722 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.886649    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24w8\" (UniqueName: \"kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.887279 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.887260    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.894928 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.894902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24w8\" (UniqueName: \"kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8\") pod \"payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:45.940888 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.940820    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:45.994786 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:45.994476    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:46.212647 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.212557    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:51:46.215031 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:46.215005    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1a1d17_52bc_4644_94cb_9ae89eb0627b.slice/crio-05b1a9e17457446db5b557e2e9a4d5116d49cc673dea40ed64901bb2a0a0bfec WatchSource:0}: Error finding container 05b1a9e17457446db5b557e2e9a4d5116d49cc673dea40ed64901bb2a0a0bfec: Status 404 returned error can't find the container with id 05b1a9e17457446db5b557e2e9a4d5116d49cc673dea40ed64901bb2a0a0bfec
Sep 10 23:51:46.274474 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.274448    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:51:46.276333 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:51:46.276290    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90213012_8103_4cfa_bbf9_8ff0cca498c3.slice/crio-7ddfca6aabc1c2adc419781cdbc9bebd49498fb8f70f9de739f2d883e8d44504 WatchSource:0}: Error finding container 7ddfca6aabc1c2adc419781cdbc9bebd49498fb8f70f9de739f2d883e8d44504: Status 404 returned error can't find the container with id 7ddfca6aabc1c2adc419781cdbc9bebd49498fb8f70f9de739f2d883e8d44504
Sep 10 23:51:46.958078 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.958031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" event={"ID":"ea1a1d17-52bc-4644-94cb-9ae89eb0627b","Type":"ContainerStarted","Data":"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"}
Sep 10 23:51:46.958270 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.958180    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:46.958270 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.958221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" event={"ID":"ea1a1d17-52bc-4644-94cb-9ae89eb0627b","Type":"ContainerStarted","Data":"05b1a9e17457446db5b557e2e9a4d5116d49cc673dea40ed64901bb2a0a0bfec"}
Sep 10 23:51:46.960217 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.960188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" event={"ID":"90213012-8103-4cfa-bbf9-8ff0cca498c3","Type":"ContainerStarted","Data":"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"}
Sep 10 23:51:46.960353 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.960236    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" event={"ID":"90213012-8103-4cfa-bbf9-8ff0cca498c3","Type":"ContainerStarted","Data":"7ddfca6aabc1c2adc419781cdbc9bebd49498fb8f70f9de739f2d883e8d44504"}
Sep 10 23:51:46.960426 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.960355    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:51:46.975053 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.975005    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" podStartSLOduration=1.6780673259999999 podStartE2EDuration="1.974992231s" totalImagesPullingTime="296.924905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:46.973228813 +0000 UTC m=+1093.077515636" watchObservedRunningTime="2026-09-10 23:51:46.974992231 +0000 UTC m=+1093.079279025"
Sep 10 23:51:46.989488 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:46.989445    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" podStartSLOduration=1.9894319679999999 podStartE2EDuration="1.989431968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:46.987785952 +0000 UTC m=+1093.092072768" watchObservedRunningTime="2026-09-10 23:51:46.989431968 +0000 UTC m=+1093.093718761"
Sep 10 23:51:52.970844 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:52.970813    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:51:57.968313 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:51:57.968273    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:52:23.302935 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.302896    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:52:23.306933 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.306911    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.309218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.309126    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-42591aef-serving-cert\""
Sep 10 23:52:23.316063 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.316039    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:52:23.434648 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.434617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.434836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.434658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.434836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.434692    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.434836 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.434779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdkx\" (UniqueName: \"kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.535953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.535921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.536085 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.535961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.536085 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.535996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdkx\" (UniqueName: \"kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.536175 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.536102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.536219 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:52:23.536198    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-serving-cert: secret "maas-api-e2e-mt-42591aef-serving-cert" not found
Sep 10 23:52:23.536276 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:52:23.536266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls podName:f51425aa-f924-44c3-94eb-51ddcd1ed4a3 nodeName:}" failed. No retries permitted until 2026-09-10 23:52:24.036244104 +0000 UTC m=+1130.140530876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls") pod "maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" (UID: "f51425aa-f924-44c3-94eb-51ddcd1ed4a3") : secret "maas-api-e2e-mt-42591aef-serving-cert" not found
Sep 10 23:52:23.536700 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.536679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.538501 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.538479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.545824 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.545802    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdkx\" (UniqueName: \"kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:23.936184 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.936151    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:52:23.942316 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.942258    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:23.945731 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.945692    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-42591aef\""
Sep 10 23:52:23.946101 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.946067    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-42591aef-dockercfg-c5d4k\""
Sep 10 23:52:23.951344 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:23.951317    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:52:24.041511 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.041474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t542\" (UniqueName: \"kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.041679 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.041520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.041751 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.041728    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:24.044662 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.044630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") pod \"maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:24.142348 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.142281    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t542\" (UniqueName: \"kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.142531 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.142372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.143439 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.143411    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.150219 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.150184    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t542\" (UniqueName: \"kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542\") pod \"payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") " pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.219629 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.219562    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:24.260928 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.260899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:24.492133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.492107    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:52:24.494050 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:52:24.494025    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51425aa_f924_44c3_94eb_51ddcd1ed4a3.slice/crio-54ca0ac40b1cddc10cbe5f127c39526b5e03cc5b7cb80ce38d7c3b4030f3012c WatchSource:0}: Error finding container 54ca0ac40b1cddc10cbe5f127c39526b5e03cc5b7cb80ce38d7c3b4030f3012c: Status 404 returned error can't find the container with id 54ca0ac40b1cddc10cbe5f127c39526b5e03cc5b7cb80ce38d7c3b4030f3012c
Sep 10 23:52:24.546031 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:24.546002    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:52:24.547594 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:52:24.547565    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d40904_8e2e_4036_9156_40ccb6d9ea9f.slice/crio-9488f6640c7637cc2524a2aa53c06a5645ad3c7fd6de861c159f1a0293a25a42 WatchSource:0}: Error finding container 9488f6640c7637cc2524a2aa53c06a5645ad3c7fd6de861c159f1a0293a25a42: Status 404 returned error can't find the container with id 9488f6640c7637cc2524a2aa53c06a5645ad3c7fd6de861c159f1a0293a25a42
Sep 10 23:52:25.151460 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.151424    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" event={"ID":"f51425aa-f924-44c3-94eb-51ddcd1ed4a3","Type":"ContainerStarted","Data":"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"}
Sep 10 23:52:25.151647 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.151488    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" event={"ID":"f51425aa-f924-44c3-94eb-51ddcd1ed4a3","Type":"ContainerStarted","Data":"54ca0ac40b1cddc10cbe5f127c39526b5e03cc5b7cb80ce38d7c3b4030f3012c"}
Sep 10 23:52:25.151647 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.151519    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:25.153156 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.153129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" event={"ID":"96d40904-8e2e-4036-9156-40ccb6d9ea9f","Type":"ContainerStarted","Data":"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"}
Sep 10 23:52:25.153276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.153179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" event={"ID":"96d40904-8e2e-4036-9156-40ccb6d9ea9f","Type":"ContainerStarted","Data":"9488f6640c7637cc2524a2aa53c06a5645ad3c7fd6de861c159f1a0293a25a42"}
Sep 10 23:52:25.153276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.153223    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:52:25.170324 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.170271    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" podStartSLOduration=1.788633582 podStartE2EDuration="2.170256682s" totalImagesPullingTime="381.6231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:25.167616605 +0000 UTC m=+1131.271903416" watchObservedRunningTime="2026-09-10 23:52:25.170256682 +0000 UTC m=+1131.274543475"
Sep 10 23:52:25.184000 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:25.183960    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" podStartSLOduration=2.183946237 podStartE2EDuration="2.183946237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:52:25.181940417 +0000 UTC m=+1131.286227212" watchObservedRunningTime="2026-09-10 23:52:25.183946237 +0000 UTC m=+1131.288233030"
Sep 10 23:52:31.164943 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:31.164911    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:52:36.160809 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:52:36.160772    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:53:46.742122 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:46.742084    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:53:46.742690 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:46.742356    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" podUID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" containerName="maas-api" containerID="cri-o://d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9" gracePeriod=30
Sep 10 23:53:46.787152 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:46.787115    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:53:46.787429 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:46.787396    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" podUID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" containerName="payload-processing" containerID="cri-o://8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7" gracePeriod=30
Sep 10 23:53:47.041540 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.041514    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:53:47.077887 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.077861    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:53:47.131071 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.131043    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkdkx\" (UniqueName: \"kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx\") pod \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") "
Sep 10 23:53:47.131240 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.131094    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca\") pod \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") "
Sep 10 23:53:47.131240 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.131164    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs\") pod \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") "
Sep 10 23:53:47.131240 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.131196    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") pod \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\" (UID: \"f51425aa-f924-44c3-94eb-51ddcd1ed4a3\") "
Sep 10 23:53:47.131525 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.131487    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f51425aa-f924-44c3-94eb-51ddcd1ed4a3" (UID: "f51425aa-f924-44c3-94eb-51ddcd1ed4a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:53:47.133373 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.133347    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f51425aa-f924-44c3-94eb-51ddcd1ed4a3" (UID: "f51425aa-f924-44c3-94eb-51ddcd1ed4a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:53:47.133517 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.133496    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f51425aa-f924-44c3-94eb-51ddcd1ed4a3" (UID: "f51425aa-f924-44c3-94eb-51ddcd1ed4a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:53:47.133580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.133522    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx" (OuterVolumeSpecName: "kube-api-access-dkdkx") pod "f51425aa-f924-44c3-94eb-51ddcd1ed4a3" (UID: "f51425aa-f924-44c3-94eb-51ddcd1ed4a3"). InnerVolumeSpecName "kube-api-access-dkdkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:47.232008 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.231980    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t542\" (UniqueName: \"kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542\") pod \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") "
Sep 10 23:53:47.232133 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232017    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume\") pod \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\" (UID: \"96d40904-8e2e-4036-9156-40ccb6d9ea9f\") "
Sep 10 23:53:47.232217 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232207    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.232256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232219    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.232256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232231    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkdkx\" (UniqueName: \"kubernetes.io/projected/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-kube-api-access-dkdkx\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.232256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232247    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51425aa-f924-44c3-94eb-51ddcd1ed4a3-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.232463 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.232443    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96d40904-8e2e-4036-9156-40ccb6d9ea9f" (UID: "96d40904-8e2e-4036-9156-40ccb6d9ea9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:53:47.233846 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.233828    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542" (OuterVolumeSpecName: "kube-api-access-9t542") pod "96d40904-8e2e-4036-9156-40ccb6d9ea9f" (UID: "96d40904-8e2e-4036-9156-40ccb6d9ea9f"). InnerVolumeSpecName "kube-api-access-9t542". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:53:47.333246 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.333171    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t542\" (UniqueName: \"kubernetes.io/projected/96d40904-8e2e-4036-9156-40ccb6d9ea9f-kube-api-access-9t542\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.333246 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.333199    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d40904-8e2e-4036-9156-40ccb6d9ea9f-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:53:47.591195 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.591119    2566 generic.go:356] "Generic (PLEG): container finished" podID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" containerID="8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7" exitCode=0
Sep 10 23:53:47.591195 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.591165    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"
Sep 10 23:53:47.591447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.591213    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" event={"ID":"96d40904-8e2e-4036-9156-40ccb6d9ea9f","Type":"ContainerDied","Data":"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"}
Sep 10 23:53:47.591447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.591274    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r" event={"ID":"96d40904-8e2e-4036-9156-40ccb6d9ea9f","Type":"ContainerDied","Data":"9488f6640c7637cc2524a2aa53c06a5645ad3c7fd6de861c159f1a0293a25a42"}
Sep 10 23:53:47.591447 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.591332    2566 scope.go:117] "RemoveContainer" containerID="8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"
Sep 10 23:53:47.592681 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.592661    2566 generic.go:356] "Generic (PLEG): container finished" podID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" containerID="d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9" exitCode=0
Sep 10 23:53:47.592774 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.592716    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"
Sep 10 23:53:47.592825 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.592718    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" event={"ID":"f51425aa-f924-44c3-94eb-51ddcd1ed4a3","Type":"ContainerDied","Data":"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"}
Sep 10 23:53:47.592876 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.592851    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq" event={"ID":"f51425aa-f924-44c3-94eb-51ddcd1ed4a3","Type":"ContainerDied","Data":"54ca0ac40b1cddc10cbe5f127c39526b5e03cc5b7cb80ce38d7c3b4030f3012c"}
Sep 10 23:53:47.602258 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.602238    2566 scope.go:117] "RemoveContainer" containerID="8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"
Sep 10 23:53:47.602671 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:53:47.602554    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7\": container with ID starting with 8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7 not found: ID does not exist" containerID="8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"
Sep 10 23:53:47.602671 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.602591    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7"} err="failed to get container status \"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7\": rpc error: code = NotFound desc = could not find container \"8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7\": container with ID starting with 8bfac39845f2b50f1f0f0d4e89630403fffae36cdf09086c7f5ba0a98c010cc7 not found: ID does not exist"
Sep 10 23:53:47.602671 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.602612    2566 scope.go:117] "RemoveContainer" containerID="d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"
Sep 10 23:53:47.611459 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.611436    2566 scope.go:117] "RemoveContainer" containerID="d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"
Sep 10 23:53:47.612215 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:53:47.612168    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9\": container with ID starting with d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9 not found: ID does not exist" containerID="d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"
Sep 10 23:53:47.612215 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.612200    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9"} err="failed to get container status \"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9\": rpc error: code = NotFound desc = could not find container \"d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9\": container with ID starting with d2d918f5124639468903b8352d6ba23b56554103bc890d72ab9700408eb14aa9 not found: ID does not exist"
Sep 10 23:53:47.614678 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.614657    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:53:47.616949 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.616927    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-42591aef-5777bdbf97-4f45r"]
Sep 10 23:53:47.628412 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.628387    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:53:47.632238 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:47.632218    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-42591aef-86998bb5bc-r5pzq"]
Sep 10 23:53:48.430155 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:48.430119    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" path="/var/lib/kubelet/pods/96d40904-8e2e-4036-9156-40ccb6d9ea9f/volumes"
Sep 10 23:53:48.430536 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:53:48.430511    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" path="/var/lib/kubelet/pods/f51425aa-f924-44c3-94eb-51ddcd1ed4a3/volumes"
Sep 10 23:55:22.525385 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.525347    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:55:22.526218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526191    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" containerName="payload-processing"
Sep 10 23:55:22.526218 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526218    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" containerName="payload-processing"
Sep 10 23:55:22.526454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526231    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" containerName="maas-api"
Sep 10 23:55:22.526454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526240    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" containerName="maas-api"
Sep 10 23:55:22.526454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526375    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f51425aa-f924-44c3-94eb-51ddcd1ed4a3" containerName="maas-api"
Sep 10 23:55:22.526454 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.526390    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d40904-8e2e-4036-9156-40ccb6d9ea9f" containerName="payload-processing"
Sep 10 23:55:22.529862 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.529841    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.532158 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.532137    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7c0647-serving-cert\""
Sep 10 23:55:22.539686 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.539664    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:55:22.623266 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.623239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257qt\" (UniqueName: \"kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.623433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.623287    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.623433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.623378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.623433 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.623421    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.724190 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.724161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257qt\" (UniqueName: \"kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.724367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.724210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.724367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.724244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.724367 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.724266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.725045 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.725020    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.726614 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.726582    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.726713 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.726618    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.732189 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.732167    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-257qt\" (UniqueName: \"kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt\") pod \"maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:22.842926 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:22.842861    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:23.117885 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:23.117862    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:55:23.120030 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:55:23.119998    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce6b3ce_35c6_4b0f_a90c_ebac76f1d982.slice/crio-d3335818c67e942b63ca03717336009fa99099e0c4c804cc75212c37e9f43aba WatchSource:0}: Error finding container d3335818c67e942b63ca03717336009fa99099e0c4c804cc75212c37e9f43aba: Status 404 returned error can't find the container with id d3335818c67e942b63ca03717336009fa99099e0c4c804cc75212c37e9f43aba
Sep 10 23:55:24.101442 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:24.101410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" event={"ID":"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982","Type":"ContainerStarted","Data":"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"}
Sep 10 23:55:24.101858 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:24.101458    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" event={"ID":"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982","Type":"ContainerStarted","Data":"d3335818c67e942b63ca03717336009fa99099e0c4c804cc75212c37e9f43aba"}
Sep 10 23:55:24.101858 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:24.101513    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:24.117797 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:24.117745    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" podStartSLOduration=1.666559002 podStartE2EDuration="2.117727947s" totalImagesPullingTime="451.168945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:24.116774201 +0000 UTC m=+1310.221061019" watchObservedRunningTime="2026-09-10 23:55:24.117727947 +0000 UTC m=+1310.222014741"
Sep 10 23:55:30.111562 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:30.111530    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:55:51.496177 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.496139    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:55:51.507139 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.505344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.508906 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.508871    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-bcad17-serving-cert\""
Sep 10 23:55:51.512996 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.512967    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:55:51.603233 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.603199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.603420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.603271    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2sb\" (UniqueName: \"kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.603420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.603341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.603420 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.603385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.704980 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.704947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.705150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.704997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2sb\" (UniqueName: \"kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.705150 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.705042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.705265 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.705185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.705351 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:55:51.705326    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-serving-cert: secret "maas-api-e2e-api-b-bcad17-serving-cert" not found
Sep 10 23:55:51.705428 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:55:51.705416    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls podName:39f25af6-e761-4795-9f91-27f63897fe4a nodeName:}" failed. No retries permitted until 2026-09-10 23:55:52.205399169 +0000 UTC m=+1338.309685941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls") pod "maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" (UID: "39f25af6-e761-4795-9f91-27f63897fe4a") : secret "maas-api-e2e-api-b-bcad17-serving-cert" not found
Sep 10 23:55:51.705734 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.705718    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.707231 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.707209    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:51.713202 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:51.713179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2sb\" (UniqueName: \"kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:52.209970 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:52.209936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:52.212360 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:52.212331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") pod \"maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:52.423856 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:52.423813    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:52.694516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:52.694491    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:55:52.696288 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:55:52.696259    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f25af6_e761_4795_9f91_27f63897fe4a.slice/crio-f65d3c6d0ba74ee9237fcc9e44527bcc749aeaa6a072c4aa5fb7bae0267f06e5 WatchSource:0}: Error finding container f65d3c6d0ba74ee9237fcc9e44527bcc749aeaa6a072c4aa5fb7bae0267f06e5: Status 404 returned error can't find the container with id f65d3c6d0ba74ee9237fcc9e44527bcc749aeaa6a072c4aa5fb7bae0267f06e5
Sep 10 23:55:53.256105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:53.256075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" event={"ID":"39f25af6-e761-4795-9f91-27f63897fe4a","Type":"ContainerStarted","Data":"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"}
Sep 10 23:55:53.256361 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:53.256131    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" event={"ID":"39f25af6-e761-4795-9f91-27f63897fe4a","Type":"ContainerStarted","Data":"f65d3c6d0ba74ee9237fcc9e44527bcc749aeaa6a072c4aa5fb7bae0267f06e5"}
Sep 10 23:55:53.256361 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:53.256170    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:55:53.272795 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:53.272750    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" podStartSLOduration=1.849201503 podStartE2EDuration="2.272734643s" totalImagesPullingTime="423.53314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:53.271984599 +0000 UTC m=+1339.376271426" watchObservedRunningTime="2026-09-10 23:55:53.272734643 +0000 UTC m=+1339.377021438"
Sep 10 23:55:59.267112 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:55:59.267033    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:56:33.599680 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.599642    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:56:33.600256 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.599925    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" podUID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" containerName="maas-api" containerID="cri-o://df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f" gracePeriod=30
Sep 10 23:56:33.855262 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.855192    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:56:33.913725 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.913693    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-257qt\" (UniqueName: \"kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt\") pod \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") "
Sep 10 23:56:33.913884 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.913737    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca\") pod \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") "
Sep 10 23:56:33.913884 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.913759    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs\") pod \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") "
Sep 10 23:56:33.913884 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.913822    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls\") pod \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\" (UID: \"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982\") "
Sep 10 23:56:33.914118 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.914089    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" (UID: "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:56:33.914257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.914157    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:33.915864 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.915832    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" (UID: "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:33.915946 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.915854    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" (UID: "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:33.915946 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:33.915902    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt" (OuterVolumeSpecName: "kube-api-access-257qt") pod "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" (UID: "1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982"). InnerVolumeSpecName "kube-api-access-257qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:34.016038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.016000    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-257qt\" (UniqueName: \"kubernetes.io/projected/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-kube-api-access-257qt\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:34.016038 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.016038    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:34.016239 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.016054    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:34.475791 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.475755    2566 generic.go:356] "Generic (PLEG): container finished" podID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" containerID="df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f" exitCode=0
Sep 10 23:56:34.475953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.475808    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"
Sep 10 23:56:34.475953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.475839    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" event={"ID":"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982","Type":"ContainerDied","Data":"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"}
Sep 10 23:56:34.475953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.475902    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc" event={"ID":"1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982","Type":"ContainerDied","Data":"d3335818c67e942b63ca03717336009fa99099e0c4c804cc75212c37e9f43aba"}
Sep 10 23:56:34.475953 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.475929    2566 scope.go:117] "RemoveContainer" containerID="df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"
Sep 10 23:56:34.486895 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.486875    2566 scope.go:117] "RemoveContainer" containerID="df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"
Sep 10 23:56:34.487186 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:56:34.487166    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f\": container with ID starting with df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f not found: ID does not exist" containerID="df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"
Sep 10 23:56:34.487257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.487197    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f"} err="failed to get container status \"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f\": rpc error: code = NotFound desc = could not find container \"df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f\": container with ID starting with df3dbfccf14a053f32decb00e2b92bb3b3a33938a9894f061891ef98f59f178f not found: ID does not exist"
Sep 10 23:56:34.496094 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.496070    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:56:34.500317 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:34.500283    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c0647-76758d48d4-fnrmc"]
Sep 10 23:56:36.430105 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:36.430075    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" path="/var/lib/kubelet/pods/1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982/volumes"
Sep 10 23:56:56.096276 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.096242    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:56:56.096768 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.096506    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" podUID="39f25af6-e761-4795-9f91-27f63897fe4a" containerName="maas-api" containerID="cri-o://73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c" gracePeriod=30
Sep 10 23:56:56.380939 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.380914    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:56:56.524826 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.524788    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") pod \"39f25af6-e761-4795-9f91-27f63897fe4a\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") "
Sep 10 23:56:56.525169 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.525148    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca\") pod \"39f25af6-e761-4795-9f91-27f63897fe4a\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") "
Sep 10 23:56:56.525380 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.525360    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs\") pod \"39f25af6-e761-4795-9f91-27f63897fe4a\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") "
Sep 10 23:56:56.525553 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.525536    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr2sb\" (UniqueName: \"kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb\") pod \"39f25af6-e761-4795-9f91-27f63897fe4a\" (UID: \"39f25af6-e761-4795-9f91-27f63897fe4a\") "
Sep 10 23:56:56.527906 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.527546    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39f25af6-e761-4795-9f91-27f63897fe4a" (UID: "39f25af6-e761-4795-9f91-27f63897fe4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:56:56.530251 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.530223    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39f25af6-e761-4795-9f91-27f63897fe4a" (UID: "39f25af6-e761-4795-9f91-27f63897fe4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:56.530473 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.530264    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39f25af6-e761-4795-9f91-27f63897fe4a" (UID: "39f25af6-e761-4795-9f91-27f63897fe4a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:56:56.530473 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.530371    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb" (OuterVolumeSpecName: "kube-api-access-jr2sb") pod "39f25af6-e761-4795-9f91-27f63897fe4a" (UID: "39f25af6-e761-4795-9f91-27f63897fe4a"). InnerVolumeSpecName "kube-api-access-jr2sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:56:56.587855 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.587825    2566 generic.go:356] "Generic (PLEG): container finished" podID="39f25af6-e761-4795-9f91-27f63897fe4a" containerID="73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c" exitCode=0
Sep 10 23:56:56.587957 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.587870    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"
Sep 10 23:56:56.587957 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.587907    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" event={"ID":"39f25af6-e761-4795-9f91-27f63897fe4a","Type":"ContainerDied","Data":"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"}
Sep 10 23:56:56.587957 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.587957    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv" event={"ID":"39f25af6-e761-4795-9f91-27f63897fe4a","Type":"ContainerDied","Data":"f65d3c6d0ba74ee9237fcc9e44527bcc749aeaa6a072c4aa5fb7bae0267f06e5"}
Sep 10 23:56:56.588123 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.587979    2566 scope.go:117] "RemoveContainer" containerID="73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"
Sep 10 23:56:56.596934 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.596920    2566 scope.go:117] "RemoveContainer" containerID="73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"
Sep 10 23:56:56.597181 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:56:56.597165    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c\": container with ID starting with 73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c not found: ID does not exist" containerID="73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"
Sep 10 23:56:56.597257 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.597188    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c"} err="failed to get container status \"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c\": rpc error: code = NotFound desc = could not find container \"73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c\": container with ID starting with 73b5e1165b684d75fb2a55a17e1e343a5f4a661c6e2258199a8a14358656240c not found: ID does not exist"
Sep 10 23:56:56.608797 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.608773    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:56:56.616542 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.616493    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bcad17-84fcddd4cb-v5lwv"]
Sep 10 23:56:56.627088 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.627067    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.627088 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.627087    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f25af6-e761-4795-9f91-27f63897fe4a-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.627199 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.627096    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39f25af6-e761-4795-9f91-27f63897fe4a-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:56.627199 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:56.627105    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr2sb\" (UniqueName: \"kubernetes.io/projected/39f25af6-e761-4795-9f91-27f63897fe4a-kube-api-access-jr2sb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:56:58.429753 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:56:58.429720    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f25af6-e761-4795-9f91-27f63897fe4a" path="/var/lib/kubelet/pods/39f25af6-e761-4795-9f91-27f63897fe4a/volumes"
Sep 10 23:57:13.840491 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:13.840457    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:57:13.841067 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:13.840677    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" podUID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" containerName="maas-api" containerID="cri-o://ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef" gracePeriod=30
Sep 10 23:57:14.095232 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.095173    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:57:14.197859 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.197831    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca\") pod \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") "
Sep 10 23:57:14.197859 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.197864    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsnqs\" (UniqueName: \"kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs\") pod \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") "
Sep 10 23:57:14.198119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.197898    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") pod \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") "
Sep 10 23:57:14.198119 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.198023    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs\") pod \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\" (UID: \"32d50fd5-98ba-4771-b23a-e5fdb1d125d5\") "
Sep 10 23:57:14.198236 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.198190    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32d50fd5-98ba-4771-b23a-e5fdb1d125d5" (UID: "32d50fd5-98ba-4771-b23a-e5fdb1d125d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:57:14.198405 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.198381    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:14.200064 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.200028    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "32d50fd5-98ba-4771-b23a-e5fdb1d125d5" (UID: "32d50fd5-98ba-4771-b23a-e5fdb1d125d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:57:14.200202 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.200153    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs" (OuterVolumeSpecName: "kube-api-access-fsnqs") pod "32d50fd5-98ba-4771-b23a-e5fdb1d125d5" (UID: "32d50fd5-98ba-4771-b23a-e5fdb1d125d5"). InnerVolumeSpecName "kube-api-access-fsnqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:14.200684 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.200655    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32d50fd5-98ba-4771-b23a-e5fdb1d125d5" (UID: "32d50fd5-98ba-4771-b23a-e5fdb1d125d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:57:14.299661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.299631    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsnqs\" (UniqueName: \"kubernetes.io/projected/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-kube-api-access-fsnqs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:14.299661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.299659    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:14.299661 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.299668    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32d50fd5-98ba-4771-b23a-e5fdb1d125d5-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:14.683478 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.683442    2566 generic.go:356] "Generic (PLEG): container finished" podID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" containerID="ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef" exitCode=0
Sep 10 23:57:14.683649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.683508    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"
Sep 10 23:57:14.683649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.683541    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" event={"ID":"32d50fd5-98ba-4771-b23a-e5fdb1d125d5","Type":"ContainerDied","Data":"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"}
Sep 10 23:57:14.683649 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.683629    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7" event={"ID":"32d50fd5-98ba-4771-b23a-e5fdb1d125d5","Type":"ContainerDied","Data":"df815e24dd45da5deae2033fbbd86a8b8f2818f1f663d47a50619e0707883a47"}
Sep 10 23:57:14.683782 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.683666    2566 scope.go:117] "RemoveContainer" containerID="ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"
Sep 10 23:57:14.693041 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.693017    2566 scope.go:117] "RemoveContainer" containerID="ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"
Sep 10 23:57:14.693279 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:57:14.693258    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef\": container with ID starting with ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef not found: ID does not exist" containerID="ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"
Sep 10 23:57:14.693345 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.693285    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef"} err="failed to get container status \"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef\": rpc error: code = NotFound desc = could not find container \"ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef\": container with ID starting with ae273af484d64c720e3c518c570b3e51c7bfba28d298737e1b632433e2c364ef not found: ID does not exist"
Sep 10 23:57:14.701815 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.701792    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:57:14.705490 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:14.705469    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4e0933-5d7c56f8d-kdkc7"]
Sep 10 23:57:16.430216 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:16.430178    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" path="/var/lib/kubelet/pods/32d50fd5-98ba-4771-b23a-e5fdb1d125d5/volumes"
Sep 10 23:57:31.164704 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.164523    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:57:31.165509 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.165474    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" podUID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" containerName="maas-api" containerID="cri-o://2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f" gracePeriod=30
Sep 10 23:57:31.217924 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.217892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:57:31.218169 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.218113    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" podUID="90213012-8103-4cfa-bbf9-8ff0cca498c3" containerName="payload-processing" containerID="cri-o://aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48" gracePeriod=30
Sep 10 23:57:31.478516 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.478490    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:57:31.518902 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.518875    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:57:31.557925 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.557893    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t24w8\" (UniqueName: \"kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8\") pod \"90213012-8103-4cfa-bbf9-8ff0cca498c3\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") "
Sep 10 23:57:31.558080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.557995    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkfzq\" (UniqueName: \"kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq\") pod \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") "
Sep 10 23:57:31.558080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558027    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs\") pod \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") "
Sep 10 23:57:31.558080 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558058    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca\") pod \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") "
Sep 10 23:57:31.558245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558139    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume\") pod \"90213012-8103-4cfa-bbf9-8ff0cca498c3\" (UID: \"90213012-8103-4cfa-bbf9-8ff0cca498c3\") "
Sep 10 23:57:31.558245 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558169    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") pod \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\" (UID: \"ea1a1d17-52bc-4644-94cb-9ae89eb0627b\") "
Sep 10 23:57:31.558527 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558470    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea1a1d17-52bc-4644-94cb-9ae89eb0627b" (UID: "ea1a1d17-52bc-4644-94cb-9ae89eb0627b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:57:31.558902 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.558850    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90213012-8103-4cfa-bbf9-8ff0cca498c3" (UID: "90213012-8103-4cfa-bbf9-8ff0cca498c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:57:31.560691 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.560668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq" (OuterVolumeSpecName: "kube-api-access-zkfzq") pod "ea1a1d17-52bc-4644-94cb-9ae89eb0627b" (UID: "ea1a1d17-52bc-4644-94cb-9ae89eb0627b"). InnerVolumeSpecName "kube-api-access-zkfzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:31.560783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.560750    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8" (OuterVolumeSpecName: "kube-api-access-t24w8") pod "90213012-8103-4cfa-bbf9-8ff0cca498c3" (UID: "90213012-8103-4cfa-bbf9-8ff0cca498c3"). InnerVolumeSpecName "kube-api-access-t24w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:57:31.561094 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.561065    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea1a1d17-52bc-4644-94cb-9ae89eb0627b" (UID: "ea1a1d17-52bc-4644-94cb-9ae89eb0627b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:57:31.561341 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.561321    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea1a1d17-52bc-4644-94cb-9ae89eb0627b" (UID: "ea1a1d17-52bc-4644-94cb-9ae89eb0627b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:57:31.659115 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659084    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t24w8\" (UniqueName: \"kubernetes.io/projected/90213012-8103-4cfa-bbf9-8ff0cca498c3-kube-api-access-t24w8\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.659264 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659118    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkfzq\" (UniqueName: \"kubernetes.io/projected/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-kube-api-access-zkfzq\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.659264 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659135    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.659264 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659152    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.659264 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659167    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90213012-8103-4cfa-bbf9-8ff0cca498c3-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.659264 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.659181    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea1a1d17-52bc-4644-94cb-9ae89eb0627b-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 10 23:57:31.771889 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.771798    2566 generic.go:356] "Generic (PLEG): container finished" podID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" containerID="2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f" exitCode=0
Sep 10 23:57:31.771889 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.771862    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"
Sep 10 23:57:31.772107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.771884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" event={"ID":"ea1a1d17-52bc-4644-94cb-9ae89eb0627b","Type":"ContainerDied","Data":"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"}
Sep 10 23:57:31.772107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.771973    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l" event={"ID":"ea1a1d17-52bc-4644-94cb-9ae89eb0627b","Type":"ContainerDied","Data":"05b1a9e17457446db5b557e2e9a4d5116d49cc673dea40ed64901bb2a0a0bfec"}
Sep 10 23:57:31.772107 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.772004    2566 scope.go:117] "RemoveContainer" containerID="2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"
Sep 10 23:57:31.773373 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.773349    2566 generic.go:356] "Generic (PLEG): container finished" podID="90213012-8103-4cfa-bbf9-8ff0cca498c3" containerID="aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48" exitCode=0
Sep 10 23:57:31.773506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.773406    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" event={"ID":"90213012-8103-4cfa-bbf9-8ff0cca498c3","Type":"ContainerDied","Data":"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"}
Sep 10 23:57:31.773506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.773443    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"
Sep 10 23:57:31.773506 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.773477    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf" event={"ID":"90213012-8103-4cfa-bbf9-8ff0cca498c3","Type":"ContainerDied","Data":"7ddfca6aabc1c2adc419781cdbc9bebd49498fb8f70f9de739f2d883e8d44504"}
Sep 10 23:57:31.782374 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.782346    2566 scope.go:117] "RemoveContainer" containerID="2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"
Sep 10 23:57:31.782704 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:57:31.782674    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f\": container with ID starting with 2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f not found: ID does not exist" containerID="2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"
Sep 10 23:57:31.782850 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.782714    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f"} err="failed to get container status \"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f\": rpc error: code = NotFound desc = could not find container \"2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f\": container with ID starting with 2322a4f9f5051ae87ad042c6212c55cf8ea4d03beadfdf59bed827c80433783f not found: ID does not exist"
Sep 10 23:57:31.782850 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.782737    2566 scope.go:117] "RemoveContainer" containerID="aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"
Sep 10 23:57:31.791363 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.791342    2566 scope.go:117] "RemoveContainer" containerID="aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"
Sep 10 23:57:31.791638 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:57:31.791619    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48\": container with ID starting with aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48 not found: ID does not exist" containerID="aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"
Sep 10 23:57:31.791713 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.791648    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48"} err="failed to get container status \"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48\": rpc error: code = NotFound desc = could not find container \"aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48\": container with ID starting with aeb96df508f32909932ab319830b473dfb118c81bf97da47a98abfec26700f48 not found: ID does not exist"
Sep 10 23:57:31.799380 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.799358    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:57:31.802226 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.802201    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-57be92-745f4c4bff-cxwzf"]
Sep 10 23:57:31.812271 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.812244    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:57:31.818452 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:31.818424    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-57be92-6854768b67-6rg9l"]
Sep 10 23:57:32.430839 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:32.430796    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90213012-8103-4cfa-bbf9-8ff0cca498c3" path="/var/lib/kubelet/pods/90213012-8103-4cfa-bbf9-8ff0cca498c3/volumes"
Sep 10 23:57:32.431423 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:57:32.431401    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" path="/var/lib/kubelet/pods/ea1a1d17-52bc-4644-94cb-9ae89eb0627b/volumes"
Sep 10 23:58:17.302612 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.302573    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303084    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303101    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303115    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90213012-8103-4cfa-bbf9-8ff0cca498c3" containerName="payload-processing"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303124    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90213012-8103-4cfa-bbf9-8ff0cca498c3" containerName="payload-processing"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303135    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303142    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303157    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303162    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303168    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f25af6-e761-4795-9f91-27f63897fe4a" containerName="maas-api"
Sep 10 23:58:17.303214 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303173    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f25af6-e761-4795-9f91-27f63897fe4a" containerName="maas-api"
Sep 10 23:58:17.303641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303243    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="90213012-8103-4cfa-bbf9-8ff0cca498c3" containerName="payload-processing"
Sep 10 23:58:17.303641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303254    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce6b3ce-35c6-4b0f-a90c-ebac76f1d982" containerName="maas-api"
Sep 10 23:58:17.303641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303262    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f25af6-e761-4795-9f91-27f63897fe4a" containerName="maas-api"
Sep 10 23:58:17.303641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303270    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d50fd5-98ba-4771-b23a-e5fdb1d125d5" containerName="maas-api"
Sep 10 23:58:17.303641 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.303275    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1a1d17-52bc-4644-94cb-9ae89eb0627b" containerName="maas-api"
Sep 10 23:58:17.306546 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.306524    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.308794 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.308775    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-71c1cb-serving-cert\""
Sep 10 23:58:17.316022 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.315675    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 10 23:58:17.370708 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.370668    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ncx5\" (UniqueName: \"kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.370905 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.370734    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.370983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.370915    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.370983 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.370956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.471709 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.471675    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.471916 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.471817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.471916 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:58:17.471858    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-serving-cert: secret "maas-api-e2e-ipp-a-71c1cb-serving-cert" not found
Sep 10 23:58:17.472037 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:58:17.471947    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls podName:13c9658f-e4e7-4e5a-99d1-673b0632bb47 nodeName:}" failed. No retries permitted until 2026-09-10 23:58:17.971925877 +0000 UTC m=+1484.076212655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls") pod "maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" (UID: "13c9658f-e4e7-4e5a-99d1-673b0632bb47") : secret "maas-api-e2e-ipp-a-71c1cb-serving-cert" not found
Sep 10 23:58:17.472037 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.472006    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.472182 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.472154    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncx5\" (UniqueName: \"kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.472766 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.472738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.474505 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.474483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.480869 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.480841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncx5\" (UniqueName: \"kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.977021 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.976981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:17.979685 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:17.979654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") pod \"maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:18.220483 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:18.220444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:18.497938 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:18.497893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 10 23:58:18.500568 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:58:18.500539    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c9658f_e4e7_4e5a_99d1_673b0632bb47.slice/crio-7001f5e95c8f0af693c4168a958cae32a396e85d15659be157292bebaefa65f4 WatchSource:0}: Error finding container 7001f5e95c8f0af693c4168a958cae32a396e85d15659be157292bebaefa65f4: Status 404 returned error can't find the container with id 7001f5e95c8f0af693c4168a958cae32a396e85d15659be157292bebaefa65f4
Sep 10 23:58:18.502580 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:18.502557    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:58:19.015113 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:19.015081    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" event={"ID":"13c9658f-e4e7-4e5a-99d1-673b0632bb47","Type":"ContainerStarted","Data":"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"}
Sep 10 23:58:19.015261 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:19.015130    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" event={"ID":"13c9658f-e4e7-4e5a-99d1-673b0632bb47","Type":"ContainerStarted","Data":"7001f5e95c8f0af693c4168a958cae32a396e85d15659be157292bebaefa65f4"}
Sep 10 23:58:19.015261 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:19.015236    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:19.031599 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:19.031546    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" podStartSLOduration=1.594552017 podStartE2EDuration="2.031525096s" totalImagesPullingTime="436.973079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:58:19.030887361 +0000 UTC m=+1485.135174185" watchObservedRunningTime="2026-09-10 23:58:19.031525096 +0000 UTC m=+1485.135811891"
Sep 10 23:58:25.025047 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:25.025017    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 10 23:58:46.521161 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.521114    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 10 23:58:46.525219 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.525199    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.527442 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.527421    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-5453e3-serving-cert\""
Sep 10 23:58:46.537466 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.537419    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 10 23:58:46.550848 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.550814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.551016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.550855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.551016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.550898    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.551016 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.550964    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrzfw\" (UniqueName: \"kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.651660 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.651612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrzfw\" (UniqueName: \"kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.651861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.651695    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.651861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.651736    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.651861 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.651799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.652036 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:58:46.651914    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-serving-cert: secret "maas-api-e2e-ipp-b-5453e3-serving-cert" not found
Sep 10 23:58:46.652036 ip-10-0-143-95 kubenswrapper[2566]: E0910 23:58:46.651983    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls podName:ca0302dc-121f-4eb5-9f4c-960facd127f1 nodeName:}" failed. No retries permitted until 2026-09-10 23:58:47.151962651 +0000 UTC m=+1513.256249429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls") pod "maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" (UID: "ca0302dc-121f-4eb5-9f4c-960facd127f1") : secret "maas-api-e2e-ipp-b-5453e3-serving-cert" not found
Sep 10 23:58:46.652466 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.652442    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.654374 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.654352    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:46.663340 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:46.663316    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrzfw\" (UniqueName: \"kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:47.156418 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:47.156386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:47.159259 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:47.159226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:47.439808 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:47.439697    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:47.713707 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:47.713681    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 10 23:58:47.715834 ip-10-0-143-95 kubenswrapper[2566]: W0910 23:58:47.715799    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0302dc_121f_4eb5_9f4c_960facd127f1.slice/crio-69e57dfac3f4c1972117ff212340b69d6f8f1031edcb772d34836aba7ced452d WatchSource:0}: Error finding container 69e57dfac3f4c1972117ff212340b69d6f8f1031edcb772d34836aba7ced452d: Status 404 returned error can't find the container with id 69e57dfac3f4c1972117ff212340b69d6f8f1031edcb772d34836aba7ced452d
Sep 10 23:58:48.159783 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:48.159747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" event={"ID":"ca0302dc-121f-4eb5-9f4c-960facd127f1","Type":"ContainerStarted","Data":"69e57dfac3f4c1972117ff212340b69d6f8f1031edcb772d34836aba7ced452d"}
Sep 10 23:58:49.167479 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:49.167438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" event={"ID":"ca0302dc-121f-4eb5-9f4c-960facd127f1","Type":"ContainerStarted","Data":"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"}
Sep 10 23:58:49.167899 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:49.167537    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:58:49.185186 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:49.185132    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" podStartSLOduration=2.748950175 podStartE2EDuration="3.185114154s" totalImagesPullingTime="436.163979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:58:49.18487861 +0000 UTC m=+1515.289165434" watchObservedRunningTime="2026-09-10 23:58:49.185114154 +0000 UTC m=+1515.289400946"
Sep 10 23:58:55.178784 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:58:55.178756    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 10 23:59:15.310009 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:59:15.309930    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 10 23:59:56.155475 ip-10-0-143-95 kubenswrapper[2566]: I0910 23:59:56.155442    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 11 00:00:00.168385 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.168350    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29818080-c999f"]
Sep 11 00:00:00.172063 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.172045    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.175157 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.175124    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-kkll9\""
Sep 11 00:00:00.175987 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.175967    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Sep 11 00:00:00.185430 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.185402    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29818080-c999f"]
Sep 11 00:00:00.330586 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.330550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8xv\" (UniqueName: \"kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.330755 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.330668    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.431822 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.431731    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8xv\" (UniqueName: \"kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.431988 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.431853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.432714 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.432683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.439325 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.439290    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8xv\" (UniqueName: \"kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv\") pod \"image-pruner-29818080-c999f\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") " pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.500801 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.500775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:00.782142 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.782118    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29818080-c999f"]
Sep 11 00:00:00.783969 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:00:00.783942    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20f01c1_3918_4caf_8126_ab8ad43eff8a.slice/crio-4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9 WatchSource:0}: Error finding container 4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9: Status 404 returned error can't find the container with id 4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9
Sep 11 00:00:00.992863 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.992680    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:00.997166 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.997140    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:00.999956 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:00.999932    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-8405fd-serving-cert\""
Sep 11 00:00:01.009108 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.009053    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:01.138899 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.138810    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgkb\" (UniqueName: \"kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.138899 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.138854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.139134 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.138923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.139134 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.138985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.240430 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.240395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgkb\" (UniqueName: \"kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.240856 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.240451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.240856 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.240503    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.240856 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.240533    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.241250 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.241228    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.242746 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.242721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.242839 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.242766    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.248348 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.248329    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgkb\" (UniqueName: \"kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb\") pod \"maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.310724 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.310689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:01.533427 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.533394    2566 generic.go:356] "Generic (PLEG): container finished" podID="f20f01c1-3918-4caf-8126-ab8ad43eff8a" containerID="b799b0a6773f98e29fee29b209afd128eadf79785e52608c101fd379b8db3a51" exitCode=0
Sep 11 00:00:01.533631 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.533483    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-c999f" event={"ID":"f20f01c1-3918-4caf-8126-ab8ad43eff8a","Type":"ContainerDied","Data":"b799b0a6773f98e29fee29b209afd128eadf79785e52608c101fd379b8db3a51"}
Sep 11 00:00:01.533631 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.533541    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-c999f" event={"ID":"f20f01c1-3918-4caf-8126-ab8ad43eff8a","Type":"ContainerStarted","Data":"4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9"}
Sep 11 00:00:01.587012 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.586984    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:01.588785 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:00:01.588755    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaa6f75_cc81_4563_9ba6_ac640699481a.slice/crio-fee9dc30449237492e0672d4a049c99d830943aa53c0f131a7549eb3aa820b5a WatchSource:0}: Error finding container fee9dc30449237492e0672d4a049c99d830943aa53c0f131a7549eb3aa820b5a: Status 404 returned error can't find the container with id fee9dc30449237492e0672d4a049c99d830943aa53c0f131a7549eb3aa820b5a
Sep 11 00:00:01.607878 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.607848    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:01.612737 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.612718    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.615043 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.615020    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8405fd-dockercfg-qlgcg\""
Sep 11 00:00:01.615154 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.615023    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8405fd\""
Sep 11 00:00:01.626110 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.626085    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:01.747856 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.747756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw84c\" (UniqueName: \"kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.748019 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.747935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.848735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.848702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw84c\" (UniqueName: \"kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.848925 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.848859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.849623 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.849598    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.856381 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.856351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw84c\" (UniqueName: \"kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c\") pod \"payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:01.924153 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:01.924113    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:02.198524 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.198472    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:02.201229 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:00:02.201202    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664ffc1a_9a84_486a_bafc_00f55ec6dbdc.slice/crio-1df3af0281488665792405d91eea432261f1e507ca6352e8dfdbea6261b9ad22 WatchSource:0}: Error finding container 1df3af0281488665792405d91eea432261f1e507ca6352e8dfdbea6261b9ad22: Status 404 returned error can't find the container with id 1df3af0281488665792405d91eea432261f1e507ca6352e8dfdbea6261b9ad22
Sep 11 00:00:02.540540 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.540453    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" event={"ID":"ccaa6f75-cc81-4563-9ba6-ac640699481a","Type":"ContainerStarted","Data":"fee9dc30449237492e0672d4a049c99d830943aa53c0f131a7549eb3aa820b5a"}
Sep 11 00:00:02.542060 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.542028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" event={"ID":"664ffc1a-9a84-486a-bafc-00f55ec6dbdc","Type":"ContainerStarted","Data":"b65eac07a28744efa1937680455bacc458f4a50718e4281e4c1df6fd5d1113d4"}
Sep 11 00:00:02.542198 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.542080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" event={"ID":"664ffc1a-9a84-486a-bafc-00f55ec6dbdc","Type":"ContainerStarted","Data":"1df3af0281488665792405d91eea432261f1e507ca6352e8dfdbea6261b9ad22"}
Sep 11 00:00:02.565235 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.565172    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" podStartSLOduration=1.565152416 podStartE2EDuration="1.565152416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:02.563645653 +0000 UTC m=+1588.667932466" watchObservedRunningTime="2026-09-11 00:00:02.565152416 +0000 UTC m=+1588.669439193"
Sep 11 00:00:02.698606 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.698582    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:02.860720 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.860632    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz8xv\" (UniqueName: \"kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv\") pod \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") "
Sep 11 00:00:02.860887 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.860736    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca\") pod \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\" (UID: \"f20f01c1-3918-4caf-8126-ab8ad43eff8a\") "
Sep 11 00:00:02.861351 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.861318    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca" (OuterVolumeSpecName: "serviceca") pod "f20f01c1-3918-4caf-8126-ab8ad43eff8a" (UID: "f20f01c1-3918-4caf-8126-ab8ad43eff8a"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:02.862957 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.862932    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv" (OuterVolumeSpecName: "kube-api-access-xz8xv") pod "f20f01c1-3918-4caf-8126-ab8ad43eff8a" (UID: "f20f01c1-3918-4caf-8126-ab8ad43eff8a"). InnerVolumeSpecName "kube-api-access-xz8xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:02.962488 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.962451    2566 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f20f01c1-3918-4caf-8126-ab8ad43eff8a-serviceca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:02.962488 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:02.962487    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8xv\" (UniqueName: \"kubernetes.io/projected/f20f01c1-3918-4caf-8126-ab8ad43eff8a-kube-api-access-xz8xv\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:03.549529 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.549448    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-c999f"
Sep 11 00:00:03.549529 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.549459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-c999f" event={"ID":"f20f01c1-3918-4caf-8126-ab8ad43eff8a","Type":"ContainerDied","Data":"4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9"}
Sep 11 00:00:03.549529 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.549508    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e3aadf19e036420ad7e2cca9827256db031690a5560f22de0a6807da7e510c9"
Sep 11 00:00:03.551825 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.551800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" event={"ID":"ccaa6f75-cc81-4563-9ba6-ac640699481a","Type":"ContainerStarted","Data":"6ee5b49d5379cb8324aff4f5a148a744cec5d398803ad496ef1eff3fde9b3473"}
Sep 11 00:00:03.551964 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.551865    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:03.552047 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.552007    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:03.569403 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:03.569352    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" podStartSLOduration=1.9853184019999999 podStartE2EDuration="3.569333906s" totalImagesPullingTime="1.584015504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:03.566947118 +0000 UTC m=+1589.671233937" watchObservedRunningTime="2026-09-11 00:00:03.569333906 +0000 UTC m=+1589.673620701"
Sep 11 00:00:09.565855 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:09.565825    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:14.562124 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:14.562090    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:31.477457 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.477370    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:31.478363 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.478329    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" podUID="ccaa6f75-cc81-4563-9ba6-ac640699481a" containerName="maas-api" containerID="cri-o://6ee5b49d5379cb8324aff4f5a148a744cec5d398803ad496ef1eff3fde9b3473" gracePeriod=30
Sep 11 00:00:31.535697 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.535597    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:31.535900 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.535863    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" podUID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" containerName="payload-pre-processing" containerID="cri-o://b65eac07a28744efa1937680455bacc458f4a50718e4281e4c1df6fd5d1113d4" gracePeriod=30
Sep 11 00:00:31.706753 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.706714    2566 generic.go:356] "Generic (PLEG): container finished" podID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" containerID="b65eac07a28744efa1937680455bacc458f4a50718e4281e4c1df6fd5d1113d4" exitCode=0
Sep 11 00:00:31.706950 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.706781    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" event={"ID":"664ffc1a-9a84-486a-bafc-00f55ec6dbdc","Type":"ContainerDied","Data":"b65eac07a28744efa1937680455bacc458f4a50718e4281e4c1df6fd5d1113d4"}
Sep 11 00:00:31.709240 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.709207    2566 generic.go:356] "Generic (PLEG): container finished" podID="ccaa6f75-cc81-4563-9ba6-ac640699481a" containerID="6ee5b49d5379cb8324aff4f5a148a744cec5d398803ad496ef1eff3fde9b3473" exitCode=0
Sep 11 00:00:31.709395 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.709260    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" event={"ID":"ccaa6f75-cc81-4563-9ba6-ac640699481a","Type":"ContainerDied","Data":"6ee5b49d5379cb8324aff4f5a148a744cec5d398803ad496ef1eff3fde9b3473"}
Sep 11 00:00:31.821349 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.821321    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:31.853957 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.853923    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:31.912617 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912587    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca\") pod \"ccaa6f75-cc81-4563-9ba6-ac640699481a\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") "
Sep 11 00:00:31.912805 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912693    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw84c\" (UniqueName: \"kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c\") pod \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") "
Sep 11 00:00:31.912805 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume\") pod \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\" (UID: \"664ffc1a-9a84-486a-bafc-00f55ec6dbdc\") "
Sep 11 00:00:31.912805 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912758    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs\") pod \"ccaa6f75-cc81-4563-9ba6-ac640699481a\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") "
Sep 11 00:00:31.912805 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912777    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls\") pod \"ccaa6f75-cc81-4563-9ba6-ac640699481a\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") "
Sep 11 00:00:31.912805 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912804    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcgkb\" (UniqueName: \"kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb\") pod \"ccaa6f75-cc81-4563-9ba6-ac640699481a\" (UID: \"ccaa6f75-cc81-4563-9ba6-ac640699481a\") "
Sep 11 00:00:31.912996 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.912921    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccaa6f75-cc81-4563-9ba6-ac640699481a" (UID: "ccaa6f75-cc81-4563-9ba6-ac640699481a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:31.913270 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.913242    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa6f75-cc81-4563-9ba6-ac640699481a-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:31.913399 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.913313    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "664ffc1a-9a84-486a-bafc-00f55ec6dbdc" (UID: "664ffc1a-9a84-486a-bafc-00f55ec6dbdc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:31.915007 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.914975    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccaa6f75-cc81-4563-9ba6-ac640699481a" (UID: "ccaa6f75-cc81-4563-9ba6-ac640699481a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:31.915115 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.915023    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb" (OuterVolumeSpecName: "kube-api-access-qcgkb") pod "ccaa6f75-cc81-4563-9ba6-ac640699481a" (UID: "ccaa6f75-cc81-4563-9ba6-ac640699481a"). InnerVolumeSpecName "kube-api-access-qcgkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:31.915178 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.915163    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c" (OuterVolumeSpecName: "kube-api-access-rw84c") pod "664ffc1a-9a84-486a-bafc-00f55ec6dbdc" (UID: "664ffc1a-9a84-486a-bafc-00f55ec6dbdc"). InnerVolumeSpecName "kube-api-access-rw84c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:31.915247 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:31.915232    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccaa6f75-cc81-4563-9ba6-ac640699481a" (UID: "ccaa6f75-cc81-4563-9ba6-ac640699481a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:32.014155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.014064    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcgkb\" (UniqueName: \"kubernetes.io/projected/ccaa6f75-cc81-4563-9ba6-ac640699481a-kube-api-access-qcgkb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:32.014155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.014093    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw84c\" (UniqueName: \"kubernetes.io/projected/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-kube-api-access-rw84c\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:32.014155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.014104    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/664ffc1a-9a84-486a-bafc-00f55ec6dbdc-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:32.014155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.014114    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:32.014155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.014123    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccaa6f75-cc81-4563-9ba6-ac640699481a-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:32.716080 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.715990    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"
Sep 11 00:00:32.716080 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.716003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9" event={"ID":"664ffc1a-9a84-486a-bafc-00f55ec6dbdc","Type":"ContainerDied","Data":"1df3af0281488665792405d91eea432261f1e507ca6352e8dfdbea6261b9ad22"}
Sep 11 00:00:32.716080 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.716061    2566 scope.go:117] "RemoveContainer" containerID="b65eac07a28744efa1937680455bacc458f4a50718e4281e4c1df6fd5d1113d4"
Sep 11 00:00:32.717500 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.717477    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr" event={"ID":"ccaa6f75-cc81-4563-9ba6-ac640699481a","Type":"ContainerDied","Data":"fee9dc30449237492e0672d4a049c99d830943aa53c0f131a7549eb3aa820b5a"}
Sep 11 00:00:32.717582 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.717504    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"
Sep 11 00:00:32.724838 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.724818    2566 scope.go:117] "RemoveContainer" containerID="6ee5b49d5379cb8324aff4f5a148a744cec5d398803ad496ef1eff3fde9b3473"
Sep 11 00:00:32.734681 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.734662    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:32.738701 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.738682    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8405fd-5bd4949544-42wcr"]
Sep 11 00:00:32.748671 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.748645    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:32.752043 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:32.752020    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8405fd-668dcbcfc8-qwgr9"]
Sep 11 00:00:34.432318 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:34.431427    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" path="/var/lib/kubelet/pods/664ffc1a-9a84-486a-bafc-00f55ec6dbdc/volumes"
Sep 11 00:00:34.432318 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:34.432087    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccaa6f75-cc81-4563-9ba6-ac640699481a" path="/var/lib/kubelet/pods/ccaa6f75-cc81-4563-9ba6-ac640699481a/volumes"
Sep 11 00:00:57.002954 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.002916    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 11 00:00:57.003458 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.003269    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" podUID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" containerName="maas-api" containerID="cri-o://9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a" gracePeriod=30
Sep 11 00:00:57.252864 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.252837    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 11 00:00:57.345706 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.345622    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ncx5\" (UniqueName: \"kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5\") pod \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") "
Sep 11 00:00:57.345706 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.345690    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") pod \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") "
Sep 11 00:00:57.345932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.345713    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs\") pod \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") "
Sep 11 00:00:57.345932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.345836    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca\") pod \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\" (UID: \"13c9658f-e4e7-4e5a-99d1-673b0632bb47\") "
Sep 11 00:00:57.346228 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.346197    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13c9658f-e4e7-4e5a-99d1-673b0632bb47" (UID: "13c9658f-e4e7-4e5a-99d1-673b0632bb47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:57.347815 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.347789    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13c9658f-e4e7-4e5a-99d1-673b0632bb47" (UID: "13c9658f-e4e7-4e5a-99d1-673b0632bb47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:57.347933 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.347825    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "13c9658f-e4e7-4e5a-99d1-673b0632bb47" (UID: "13c9658f-e4e7-4e5a-99d1-673b0632bb47"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:57.348112 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.348089    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5" (OuterVolumeSpecName: "kube-api-access-2ncx5") pod "13c9658f-e4e7-4e5a-99d1-673b0632bb47" (UID: "13c9658f-e4e7-4e5a-99d1-673b0632bb47"). InnerVolumeSpecName "kube-api-access-2ncx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:57.446786 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.446752    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ncx5\" (UniqueName: \"kubernetes.io/projected/13c9658f-e4e7-4e5a-99d1-673b0632bb47-kube-api-access-2ncx5\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:57.446786 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.446787    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:57.446980 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.446801    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13c9658f-e4e7-4e5a-99d1-673b0632bb47-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:57.446980 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.446814    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c9658f-e4e7-4e5a-99d1-673b0632bb47-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:00:57.856761 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.856726    2566 generic.go:356] "Generic (PLEG): container finished" podID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" containerID="9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a" exitCode=0
Sep 11 00:00:57.856761 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.856763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" event={"ID":"13c9658f-e4e7-4e5a-99d1-673b0632bb47","Type":"ContainerDied","Data":"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"}
Sep 11 00:00:57.857014 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.856785    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"
Sep 11 00:00:57.857014 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.856802    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl" event={"ID":"13c9658f-e4e7-4e5a-99d1-673b0632bb47","Type":"ContainerDied","Data":"7001f5e95c8f0af693c4168a958cae32a396e85d15659be157292bebaefa65f4"}
Sep 11 00:00:57.857014 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.856825    2566 scope.go:117] "RemoveContainer" containerID="9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"
Sep 11 00:00:57.866530 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.866510    2566 scope.go:117] "RemoveContainer" containerID="9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"
Sep 11 00:00:57.866822 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:00:57.866804    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a\": container with ID starting with 9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a not found: ID does not exist" containerID="9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"
Sep 11 00:00:57.866876 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.866829    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a"} err="failed to get container status \"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a\": rpc error: code = NotFound desc = could not find container \"9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a\": container with ID starting with 9ef63eaf3e3cf7ba1d758503a18e5d4de4f1bdf180ae58b6f7b09dfd58369a5a not found: ID does not exist"
Sep 11 00:00:57.878004 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.877978    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 11 00:00:57.879749 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:57.879730    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-71c1cb-5bff46c6dc-ppqsl"]
Sep 11 00:00:58.429742 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:00:58.429710    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" path="/var/lib/kubelet/pods/13c9658f-e4e7-4e5a-99d1-673b0632bb47/volumes"
Sep 11 00:02:10.263664 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.263451    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 11 00:02:10.264238 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.263855    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" podUID="ca0302dc-121f-4eb5-9f4c-960facd127f1" containerName="maas-api" containerID="cri-o://250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31" gracePeriod=30
Sep 11 00:02:10.524472 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.524397    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 11 00:02:10.629853 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.629822    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca\") pod \"ca0302dc-121f-4eb5-9f4c-960facd127f1\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") "
Sep 11 00:02:10.630059 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.629871    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs\") pod \"ca0302dc-121f-4eb5-9f4c-960facd127f1\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") "
Sep 11 00:02:10.630059 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.629913    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") pod \"ca0302dc-121f-4eb5-9f4c-960facd127f1\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") "
Sep 11 00:02:10.630059 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.630023    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrzfw\" (UniqueName: \"kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw\") pod \"ca0302dc-121f-4eb5-9f4c-960facd127f1\" (UID: \"ca0302dc-121f-4eb5-9f4c-960facd127f1\") "
Sep 11 00:02:10.630465 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.630429    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca0302dc-121f-4eb5-9f4c-960facd127f1" (UID: "ca0302dc-121f-4eb5-9f4c-960facd127f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:10.632266 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.632233    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca0302dc-121f-4eb5-9f4c-960facd127f1" (UID: "ca0302dc-121f-4eb5-9f4c-960facd127f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:10.632266 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.632251    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca0302dc-121f-4eb5-9f4c-960facd127f1" (UID: "ca0302dc-121f-4eb5-9f4c-960facd127f1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:10.632454 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.632437    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw" (OuterVolumeSpecName: "kube-api-access-xrzfw") pod "ca0302dc-121f-4eb5-9f4c-960facd127f1" (UID: "ca0302dc-121f-4eb5-9f4c-960facd127f1"). InnerVolumeSpecName "kube-api-access-xrzfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:10.731024 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.730993    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:10.731024 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.731022    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrzfw\" (UniqueName: \"kubernetes.io/projected/ca0302dc-121f-4eb5-9f4c-960facd127f1-kube-api-access-xrzfw\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:10.731024 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.731033    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0302dc-121f-4eb5-9f4c-960facd127f1-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:10.731262 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:10.731041    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca0302dc-121f-4eb5-9f4c-960facd127f1-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:11.238230 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.238194    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca0302dc-121f-4eb5-9f4c-960facd127f1" containerID="250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31" exitCode=0
Sep 11 00:02:11.238462 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.238236    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"
Sep 11 00:02:11.238462 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.238242    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" event={"ID":"ca0302dc-121f-4eb5-9f4c-960facd127f1","Type":"ContainerDied","Data":"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"}
Sep 11 00:02:11.238462 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.238321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc" event={"ID":"ca0302dc-121f-4eb5-9f4c-960facd127f1","Type":"ContainerDied","Data":"69e57dfac3f4c1972117ff212340b69d6f8f1031edcb772d34836aba7ced452d"}
Sep 11 00:02:11.238462 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.238358    2566 scope.go:117] "RemoveContainer" containerID="250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"
Sep 11 00:02:11.248257 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.248236    2566 scope.go:117] "RemoveContainer" containerID="250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"
Sep 11 00:02:11.248567 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:11.248543    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31\": container with ID starting with 250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31 not found: ID does not exist" containerID="250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"
Sep 11 00:02:11.248639 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.248576    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31"} err="failed to get container status \"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31\": rpc error: code = NotFound desc = could not find container \"250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31\": container with ID starting with 250a57f113ae2c9a78ae163d30a303d4b7ff5a3d591578ad49c64596a59b6e31 not found: ID does not exist"
Sep 11 00:02:11.262127 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.262099    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 11 00:02:11.265499 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:11.265476    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5453e3-69b56f64fd-mmwhc"]
Sep 11 00:02:12.429967 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:12.429932    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0302dc-121f-4eb5-9f4c-960facd127f1" path="/var/lib/kubelet/pods/ca0302dc-121f-4eb5-9f4c-960facd127f1/volumes"
Sep 11 00:02:27.694730 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.694694    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 11 00:02:27.695268 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.694902    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" podUID="4b8ca6a5-2ded-418b-a710-750de3983fec" containerName="maas-api" containerID="cri-o://65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca" gracePeriod=30
Sep 11 00:02:27.948937 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.948875    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 11 00:02:27.988626 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.988587    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng8vj\" (UniqueName: \"kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj\") pod \"4b8ca6a5-2ded-418b-a710-750de3983fec\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") "
Sep 11 00:02:27.988788 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.988646    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs\") pod \"4b8ca6a5-2ded-418b-a710-750de3983fec\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") "
Sep 11 00:02:27.988788 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.988680    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") pod \"4b8ca6a5-2ded-418b-a710-750de3983fec\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") "
Sep 11 00:02:27.988788 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.988712    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca\") pod \"4b8ca6a5-2ded-418b-a710-750de3983fec\" (UID: \"4b8ca6a5-2ded-418b-a710-750de3983fec\") "
Sep 11 00:02:27.989255 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.989231    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b8ca6a5-2ded-418b-a710-750de3983fec" (UID: "4b8ca6a5-2ded-418b-a710-750de3983fec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:27.990692 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.990668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj" (OuterVolumeSpecName: "kube-api-access-ng8vj") pod "4b8ca6a5-2ded-418b-a710-750de3983fec" (UID: "4b8ca6a5-2ded-418b-a710-750de3983fec"). InnerVolumeSpecName "kube-api-access-ng8vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:27.991185 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.991162    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b8ca6a5-2ded-418b-a710-750de3983fec" (UID: "4b8ca6a5-2ded-418b-a710-750de3983fec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:27.991282 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:27.991191    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b8ca6a5-2ded-418b-a710-750de3983fec" (UID: "4b8ca6a5-2ded-418b-a710-750de3983fec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:28.089924 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.089891    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8ca6a5-2ded-418b-a710-750de3983fec-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:28.089924 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.089918    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng8vj\" (UniqueName: \"kubernetes.io/projected/4b8ca6a5-2ded-418b-a710-750de3983fec-kube-api-access-ng8vj\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:28.089924 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.089928    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:28.090215 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.089936    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b8ca6a5-2ded-418b-a710-750de3983fec-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:28.326604 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.326510    2566 generic.go:356] "Generic (PLEG): container finished" podID="4b8ca6a5-2ded-418b-a710-750de3983fec" containerID="65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca" exitCode=0
Sep 11 00:02:28.326604 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.326563    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"
Sep 11 00:02:28.326822 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.326597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" event={"ID":"4b8ca6a5-2ded-418b-a710-750de3983fec","Type":"ContainerDied","Data":"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"}
Sep 11 00:02:28.326822 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.326649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq" event={"ID":"4b8ca6a5-2ded-418b-a710-750de3983fec","Type":"ContainerDied","Data":"2f7280586cf248ca0ff68c282a6748cdfd5bfec2cd7c2bc0ad49d4d3b3576cc2"}
Sep 11 00:02:28.326822 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.326671    2566 scope.go:117] "RemoveContainer" containerID="65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"
Sep 11 00:02:28.336735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.336719    2566 scope.go:117] "RemoveContainer" containerID="65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"
Sep 11 00:02:28.337023 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:28.337001    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca\": container with ID starting with 65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca not found: ID does not exist" containerID="65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"
Sep 11 00:02:28.337120 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.337029    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca"} err="failed to get container status \"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca\": rpc error: code = NotFound desc = could not find container \"65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca\": container with ID starting with 65405c9e302eac2333db24e222a3bc1eada73d578a923e1c2a5df0b2c797efca not found: ID does not exist"
Sep 11 00:02:28.347896 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.347874    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 11 00:02:28.351351 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.351328    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-0b637b-656c4fd677-66lfq"]
Sep 11 00:02:28.430277 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:28.430252    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8ca6a5-2ded-418b-a710-750de3983fec" path="/var/lib/kubelet/pods/4b8ca6a5-2ded-418b-a710-750de3983fec/volumes"
Sep 11 00:02:45.505416 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.505065    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 11 00:02:45.507455 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.506010    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" podUID="f0529d09-e468-4a2a-b1b1-7289ae552adf" containerName="maas-api" containerID="cri-o://6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733" gracePeriod=30
Sep 11 00:02:45.548871 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.548838    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 11 00:02:45.549155 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.549094    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" podUID="6db438ec-b152-478f-97a3-1106517c8945" containerName="payload-processing" containerID="cri-o://5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1" gracePeriod=30
Sep 11 00:02:45.555715 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.555684    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 11 00:02:45.555956 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.555915    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" podUID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" containerName="payload-pre-processing" containerID="cri-o://4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28" gracePeriod=30
Sep 11 00:02:45.810651 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.810607    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 11 00:02:45.861271 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.861242    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 11 00:02:45.865264 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.865243    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 11 00:02:45.949855 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.949825    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume\") pod \"6db438ec-b152-478f-97a3-1106517c8945\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") "
Sep 11 00:02:45.949855 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.949862    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b45rf\" (UniqueName: \"kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf\") pod \"6db438ec-b152-478f-97a3-1106517c8945\" (UID: \"6db438ec-b152-478f-97a3-1106517c8945\") "
Sep 11 00:02:45.950103 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.949885    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") pod \"f0529d09-e468-4a2a-b1b1-7289ae552adf\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") "
Sep 11 00:02:45.950103 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.949901    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume\") pod \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") "
Sep 11 00:02:45.950103 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.949974    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwv5n\" (UniqueName: \"kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n\") pod \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\" (UID: \"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9\") "
Sep 11 00:02:45.950103 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950046    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlrv9\" (UniqueName: \"kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9\") pod \"f0529d09-e468-4a2a-b1b1-7289ae552adf\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") "
Sep 11 00:02:45.950103 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950078    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca\") pod \"f0529d09-e468-4a2a-b1b1-7289ae552adf\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") "
Sep 11 00:02:45.950383 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950168    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs\") pod \"f0529d09-e468-4a2a-b1b1-7289ae552adf\" (UID: \"f0529d09-e468-4a2a-b1b1-7289ae552adf\") "
Sep 11 00:02:45.950383 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950267    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" (UID: "7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:45.950559 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950533    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6db438ec-b152-478f-97a3-1106517c8945" (UID: "6db438ec-b152-478f-97a3-1106517c8945"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:45.950625 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950554    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:45.950625 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.950609    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0529d09-e468-4a2a-b1b1-7289ae552adf" (UID: "f0529d09-e468-4a2a-b1b1-7289ae552adf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:02:45.952109 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.952083    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf" (OuterVolumeSpecName: "kube-api-access-b45rf") pod "6db438ec-b152-478f-97a3-1106517c8945" (UID: "6db438ec-b152-478f-97a3-1106517c8945"). InnerVolumeSpecName "kube-api-access-b45rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:45.952453 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.952431    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0529d09-e468-4a2a-b1b1-7289ae552adf" (UID: "f0529d09-e468-4a2a-b1b1-7289ae552adf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:45.952683 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.952649    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n" (OuterVolumeSpecName: "kube-api-access-wwv5n") pod "7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" (UID: "7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9"). InnerVolumeSpecName "kube-api-access-wwv5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:45.952786 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.952735    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9" (OuterVolumeSpecName: "kube-api-access-qlrv9") pod "f0529d09-e468-4a2a-b1b1-7289ae552adf" (UID: "f0529d09-e468-4a2a-b1b1-7289ae552adf"). InnerVolumeSpecName "kube-api-access-qlrv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:45.952829 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:45.952795    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0529d09-e468-4a2a-b1b1-7289ae552adf" (UID: "f0529d09-e468-4a2a-b1b1-7289ae552adf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:46.051796 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051719    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db438ec-b152-478f-97a3-1106517c8945-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.051796 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051758    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b45rf\" (UniqueName: \"kubernetes.io/projected/6db438ec-b152-478f-97a3-1106517c8945-kube-api-access-b45rf\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.051796 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051774    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.051796 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051787    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwv5n\" (UniqueName: \"kubernetes.io/projected/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9-kube-api-access-wwv5n\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.052010 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051800    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlrv9\" (UniqueName: \"kubernetes.io/projected/f0529d09-e468-4a2a-b1b1-7289ae552adf-kube-api-access-qlrv9\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.052010 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051813    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0529d09-e468-4a2a-b1b1-7289ae552adf-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.052010 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.051826    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0529d09-e468-4a2a-b1b1-7289ae552adf-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:46.416512 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.416475    2566 generic.go:356] "Generic (PLEG): container finished" podID="6db438ec-b152-478f-97a3-1106517c8945" containerID="5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1" exitCode=0
Sep 11 00:02:46.416682 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.416541    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"
Sep 11 00:02:46.416682 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.416558    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" event={"ID":"6db438ec-b152-478f-97a3-1106517c8945","Type":"ContainerDied","Data":"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"}
Sep 11 00:02:46.416682 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.416619    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52" event={"ID":"6db438ec-b152-478f-97a3-1106517c8945","Type":"ContainerDied","Data":"5e439edef3294b30bf6de9e4f7148c6e68eb925486a0c493fffd683b9a0adc4a"}
Sep 11 00:02:46.416682 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.416651    2566 scope.go:117] "RemoveContainer" containerID="5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"
Sep 11 00:02:46.417974 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.417953    2566 generic.go:356] "Generic (PLEG): container finished" podID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" containerID="4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28" exitCode=0
Sep 11 00:02:46.418066 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.418002    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"
Sep 11 00:02:46.418066 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.418035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" event={"ID":"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9","Type":"ContainerDied","Data":"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"}
Sep 11 00:02:46.418184 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.418076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6" event={"ID":"7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9","Type":"ContainerDied","Data":"b8e4780b62f9f6a1e6e00b0f2a506fbfdea7c09bf70c32bc3dc64984411320f4"}
Sep 11 00:02:46.419556 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.419531    2566 generic.go:356] "Generic (PLEG): container finished" podID="f0529d09-e468-4a2a-b1b1-7289ae552adf" containerID="6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733" exitCode=0
Sep 11 00:02:46.419685 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.419571    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"
Sep 11 00:02:46.419685 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.419600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" event={"ID":"f0529d09-e468-4a2a-b1b1-7289ae552adf","Type":"ContainerDied","Data":"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"}
Sep 11 00:02:46.419685 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.419644    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8" event={"ID":"f0529d09-e468-4a2a-b1b1-7289ae552adf","Type":"ContainerDied","Data":"1ec852ed7329739060662b491eaa72e85db603fd1bf53ef4c6812563e8fccc3f"}
Sep 11 00:02:46.427278 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.427262    2566 scope.go:117] "RemoveContainer" containerID="5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"
Sep 11 00:02:46.427610 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:46.427583    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1\": container with ID starting with 5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1 not found: ID does not exist" containerID="5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"
Sep 11 00:02:46.427709 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.427622    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1"} err="failed to get container status \"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1\": rpc error: code = NotFound desc = could not find container \"5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1\": container with ID starting with 5419be4e2e1f1ce991c1508a7f5220d39b2dcfc56a353c880cc2a9d194256be1 not found: ID does not exist"
Sep 11 00:02:46.427709 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.427644    2566 scope.go:117] "RemoveContainer" containerID="4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"
Sep 11 00:02:46.436450 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.436428    2566 scope.go:117] "RemoveContainer" containerID="4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"
Sep 11 00:02:46.436798 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:46.436772    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28\": container with ID starting with 4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28 not found: ID does not exist" containerID="4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"
Sep 11 00:02:46.436993 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.436834    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28"} err="failed to get container status \"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28\": rpc error: code = NotFound desc = could not find container \"4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28\": container with ID starting with 4e81449747bcd6c9d397065e9323177242dc8cf9c2dcc4ffca062d08e8a21b28 not found: ID does not exist"
Sep 11 00:02:46.436993 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.436860    2566 scope.go:117] "RemoveContainer" containerID="6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"
Sep 11 00:02:46.444488 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.444464    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 11 00:02:46.445157 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.445131    2566 scope.go:117] "RemoveContainer" containerID="6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"
Sep 11 00:02:46.445684 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:46.445655    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733\": container with ID starting with 6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733 not found: ID does not exist" containerID="6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"
Sep 11 00:02:46.445833 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.445693    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733"} err="failed to get container status \"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733\": rpc error: code = NotFound desc = could not find container \"6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733\": container with ID starting with 6f382dd440c5f467d6eb7d9083d1e9e931e1b24d162bd1c03114a97469746733 not found: ID does not exist"
Sep 11 00:02:46.447733 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.447712    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6d2e31-7997456759-v5r52"]
Sep 11 00:02:46.458444 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.458421    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 11 00:02:46.462863 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.462840    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6d2e31-86499c7d55-8qrn8"]
Sep 11 00:02:46.473291 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.473265    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 11 00:02:46.479885 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:46.479865    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6d2e31-7f9c6b6c58-zhdg6"]
Sep 11 00:02:48.429451 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:48.429415    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6db438ec-b152-478f-97a3-1106517c8945" path="/var/lib/kubelet/pods/6db438ec-b152-478f-97a3-1106517c8945/volumes"
Sep 11 00:02:48.429973 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:48.429952    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" path="/var/lib/kubelet/pods/7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9/volumes"
Sep 11 00:02:48.430408 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:48.430387    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0529d09-e468-4a2a-b1b1-7289ae552adf" path="/var/lib/kubelet/pods/f0529d09-e468-4a2a-b1b1-7289ae552adf/volumes"
Sep 11 00:02:54.726064 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:54.726027    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 11 00:02:54.726952 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:54.726253    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" podUID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" containerName="manager" containerID="cri-o://964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973" gracePeriod=30
Sep 11 00:02:54.975655 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:54.975627    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 11 00:02:55.135252 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.135172    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flhcc\" (UniqueName: \"kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc\") pod \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") "
Sep 11 00:02:55.135252 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.135215    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs\") pod \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") "
Sep 11 00:02:55.135522 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.135259    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert\") pod \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\" (UID: \"51f67d45-fa7a-41fb-ad9f-7a94b62d794c\") "
Sep 11 00:02:55.137214 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.137188    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "51f67d45-fa7a-41fb-ad9f-7a94b62d794c" (UID: "51f67d45-fa7a-41fb-ad9f-7a94b62d794c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:55.137214 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.137207    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "51f67d45-fa7a-41fb-ad9f-7a94b62d794c" (UID: "51f67d45-fa7a-41fb-ad9f-7a94b62d794c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:02:55.137381 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.137276    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc" (OuterVolumeSpecName: "kube-api-access-flhcc") pod "51f67d45-fa7a-41fb-ad9f-7a94b62d794c" (UID: "51f67d45-fa7a-41fb-ad9f-7a94b62d794c"). InnerVolumeSpecName "kube-api-access-flhcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:02:55.235935 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.235905    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flhcc\" (UniqueName: \"kubernetes.io/projected/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-kube-api-access-flhcc\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:55.235935 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.235929    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:55.235935 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.235938    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f67d45-fa7a-41fb-ad9f-7a94b62d794c-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:02:55.469906 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.468716    2566 generic.go:356] "Generic (PLEG): container finished" podID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" containerID="964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973" exitCode=0
Sep 11 00:02:55.469906 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.469166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" event={"ID":"51f67d45-fa7a-41fb-ad9f-7a94b62d794c","Type":"ContainerDied","Data":"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"}
Sep 11 00:02:55.469906 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.469264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-rghqk" event={"ID":"51f67d45-fa7a-41fb-ad9f-7a94b62d794c","Type":"ContainerDied","Data":"6b127a323ec2d71772ba3f0db6e1d88562b050f4d113c2be2dbdfdfee687852b"}
Sep 11 00:02:55.469906 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.469283    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-rghqk"
Sep 11 00:02:55.469906 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.469356    2566 scope.go:117] "RemoveContainer" containerID="964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"
Sep 11 00:02:55.486561 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.486537    2566 scope.go:117] "RemoveContainer" containerID="964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"
Sep 11 00:02:55.486922 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:02:55.486884    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973\": container with ID starting with 964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973 not found: ID does not exist" containerID="964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"
Sep 11 00:02:55.487008 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.486921    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973"} err="failed to get container status \"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973\": rpc error: code = NotFound desc = could not find container \"964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973\": container with ID starting with 964e7a0e675317958d95fa945c13878c05544a08abd4e938b1fc65c26d199973 not found: ID does not exist"
Sep 11 00:02:55.496483 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.496436    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 11 00:02:55.498145 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:55.498126    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-rghqk"]
Sep 11 00:02:56.429961 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:02:56.429926    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" path="/var/lib/kubelet/pods/51f67d45-fa7a-41fb-ad9f-7a94b62d794c/volumes"
Sep 11 00:03:56.269869 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.269828    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270365    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" containerName="maas-api"
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270386    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" containerName="maas-api"
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270399    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaa6f75-cc81-4563-9ba6-ac640699481a" containerName="maas-api"
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270408    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaa6f75-cc81-4563-9ba6-ac640699481a" containerName="maas-api"
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270420    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20f01c1-3918-4caf-8126-ab8ad43eff8a" containerName="image-pruner"
Sep 11 00:03:56.270436 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270431    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20f01c1-3918-4caf-8126-ab8ad43eff8a" containerName="image-pruner"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270447    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8ca6a5-2ded-418b-a710-750de3983fec" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270455    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8ca6a5-2ded-418b-a710-750de3983fec" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270471    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" containerName="payload-pre-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270479    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" containerName="payload-pre-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270492    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db438ec-b152-478f-97a3-1106517c8945" containerName="payload-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270501    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db438ec-b152-478f-97a3-1106517c8945" containerName="payload-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270512    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0302dc-121f-4eb5-9f4c-960facd127f1" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270521    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0302dc-121f-4eb5-9f4c-960facd127f1" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270537    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" containerName="payload-pre-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270545    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" containerName="payload-pre-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270560    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0529d09-e468-4a2a-b1b1-7289ae552adf" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270568    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0529d09-e468-4a2a-b1b1-7289ae552adf" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270581    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" containerName="manager"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270589    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" containerName="manager"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270681    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db438ec-b152-478f-97a3-1106517c8945" containerName="payload-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270694    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0302dc-121f-4eb5-9f4c-960facd127f1" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270702    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccaa6f75-cc81-4563-9ba6-ac640699481a" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270713    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b8ca6a5-2ded-418b-a710-750de3983fec" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270722    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c9658f-e4e7-4e5a-99d1-673b0632bb47" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270731    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="664ffc1a-9a84-486a-bafc-00f55ec6dbdc" containerName="payload-pre-processing"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270739    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20f01c1-3918-4caf-8126-ab8ad43eff8a" containerName="image-pruner"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270748    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f67d45-fa7a-41fb-ad9f-7a94b62d794c" containerName="manager"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270756    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0529d09-e468-4a2a-b1b1-7289ae552adf" containerName="maas-api"
Sep 11 00:03:56.270778 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.270763    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f0f8fa5-5677-40e3-ba8a-6b3efb5b01a9" containerName="payload-pre-processing"
Sep 11 00:03:56.274464 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.274444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.277265 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.277244    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dvnwp\""
Sep 11 00:03:56.278190 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.278165    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 00:03:56.278276 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.278204    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 00:03:56.278276 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.278216    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 00:03:56.284934 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.284905    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:03:56.362156 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.362125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.362156 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.362155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.362382 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.362187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg5vp\" (UniqueName: \"kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.463627 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.463594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.463627 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.463623    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.463918 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.463765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg5vp\" (UniqueName: \"kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.466071 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.466030    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.466209 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.466152    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.474542 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.474511    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg5vp\" (UniqueName: \"kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp\") pod \"maas-controller-6978bcbbd5-zs6wp\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") " pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.585643 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.585553    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:56.856648 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.856618    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:03:56.858627 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:03:56.858604    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab151d6_f013_4044_a74e_c2ca55c74175.slice/crio-ebd37e266a10e3dccf1057089e8246337b1929bdd299d178830d12f5996be842 WatchSource:0}: Error finding container ebd37e266a10e3dccf1057089e8246337b1929bdd299d178830d12f5996be842: Status 404 returned error can't find the container with id ebd37e266a10e3dccf1057089e8246337b1929bdd299d178830d12f5996be842
Sep 11 00:03:56.859973 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:56.859952    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:03:57.772813 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:57.772778    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" event={"ID":"aab151d6-f013-4044-a74e-c2ca55c74175","Type":"ContainerStarted","Data":"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"}
Sep 11 00:03:57.773191 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:57.772860    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:03:57.773191 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:57.772879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" event={"ID":"aab151d6-f013-4044-a74e-c2ca55c74175","Type":"ContainerStarted","Data":"ebd37e266a10e3dccf1057089e8246337b1929bdd299d178830d12f5996be842"}
Sep 11 00:03:57.793726 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:03:57.793676    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" podStartSLOduration=1.363018497 podStartE2EDuration="1.793659888s" totalImagesPullingTime="430.641391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:03:57.791501567 +0000 UTC m=+1823.895788361" watchObservedRunningTime="2026-09-11 00:03:57.793659888 +0000 UTC m=+1823.897946681"
Sep 11 00:04:08.780410 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:08.780375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:04:15.965179 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:15.965143    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:04:15.965789 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:15.965361    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" podUID="aab151d6-f013-4044-a74e-c2ca55c74175" containerName="manager" containerID="cri-o://394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489" gracePeriod=30
Sep 11 00:04:16.211513 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.211489    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:04:16.336696 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.336612    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs\") pod \"aab151d6-f013-4044-a74e-c2ca55c74175\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") "
Sep 11 00:04:16.336696 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.336645    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert\") pod \"aab151d6-f013-4044-a74e-c2ca55c74175\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") "
Sep 11 00:04:16.336921 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.336713    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg5vp\" (UniqueName: \"kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp\") pod \"aab151d6-f013-4044-a74e-c2ca55c74175\" (UID: \"aab151d6-f013-4044-a74e-c2ca55c74175\") "
Sep 11 00:04:16.338807 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.338770    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aab151d6-f013-4044-a74e-c2ca55c74175" (UID: "aab151d6-f013-4044-a74e-c2ca55c74175"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:04:16.338923 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.338834    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aab151d6-f013-4044-a74e-c2ca55c74175" (UID: "aab151d6-f013-4044-a74e-c2ca55c74175"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:04:16.338923 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.338871    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp" (OuterVolumeSpecName: "kube-api-access-sg5vp") pod "aab151d6-f013-4044-a74e-c2ca55c74175" (UID: "aab151d6-f013-4044-a74e-c2ca55c74175"). InnerVolumeSpecName "kube-api-access-sg5vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:04:16.437451 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.437424    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg5vp\" (UniqueName: \"kubernetes.io/projected/aab151d6-f013-4044-a74e-c2ca55c74175-kube-api-access-sg5vp\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:04:16.437451 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.437450    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:04:16.437609 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.437463    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aab151d6-f013-4044-a74e-c2ca55c74175-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:04:16.868393 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.868354    2566 generic.go:356] "Generic (PLEG): container finished" podID="aab151d6-f013-4044-a74e-c2ca55c74175" containerID="394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489" exitCode=0
Sep 11 00:04:16.868584 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.868400    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" event={"ID":"aab151d6-f013-4044-a74e-c2ca55c74175","Type":"ContainerDied","Data":"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"}
Sep 11 00:04:16.868584 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.868415    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp"
Sep 11 00:04:16.868584 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.868441    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-zs6wp" event={"ID":"aab151d6-f013-4044-a74e-c2ca55c74175","Type":"ContainerDied","Data":"ebd37e266a10e3dccf1057089e8246337b1929bdd299d178830d12f5996be842"}
Sep 11 00:04:16.868584 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.868465    2566 scope.go:117] "RemoveContainer" containerID="394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"
Sep 11 00:04:16.876918 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.876900    2566 scope.go:117] "RemoveContainer" containerID="394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"
Sep 11 00:04:16.877241 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:04:16.877217    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489\": container with ID starting with 394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489 not found: ID does not exist" containerID="394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"
Sep 11 00:04:16.877325 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.877252    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489"} err="failed to get container status \"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489\": rpc error: code = NotFound desc = could not find container \"394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489\": container with ID starting with 394ad30decde9feb9ac1bc82b63d86b2a118fcf35efc8eab251c54b39b645489 not found: ID does not exist"
Sep 11 00:04:16.887967 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.887943    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:04:16.891454 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:16.891432    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-zs6wp"]
Sep 11 00:04:17.845705 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.845667    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-q2w9g"]
Sep 11 00:04:17.846114 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.846052    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab151d6-f013-4044-a74e-c2ca55c74175" containerName="manager"
Sep 11 00:04:17.846114 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.846064    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab151d6-f013-4044-a74e-c2ca55c74175" containerName="manager"
Sep 11 00:04:17.846198 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.846132    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab151d6-f013-4044-a74e-c2ca55c74175" containerName="manager"
Sep 11 00:04:17.849121 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.849100    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:17.852860 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.852835    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 00:04:17.852971 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.852920    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 00:04:17.853047 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.852970    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 00:04:17.853047 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.852920    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dvnwp\""
Sep 11 00:04:17.858973 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.858951    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-q2w9g"]
Sep 11 00:04:17.950556 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.950524    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-webhook-cert\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:17.950724 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.950638    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp5j2\" (UniqueName: \"kubernetes.io/projected/20e9d9db-4d81-4921-9337-441275f81c72-kube-api-access-bp5j2\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:17.950724 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:17.950674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-metrics-certs\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.051430 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.051392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp5j2\" (UniqueName: \"kubernetes.io/projected/20e9d9db-4d81-4921-9337-441275f81c72-kube-api-access-bp5j2\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.051625 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.051441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-metrics-certs\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.051625 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.051505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-webhook-cert\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.054109 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.054080    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-metrics-certs\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.054223 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.054117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20e9d9db-4d81-4921-9337-441275f81c72-webhook-cert\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.059670 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.059639    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp5j2\" (UniqueName: \"kubernetes.io/projected/20e9d9db-4d81-4921-9337-441275f81c72-kube-api-access-bp5j2\") pod \"maas-controller-6978bcbbd5-q2w9g\" (UID: \"20e9d9db-4d81-4921-9337-441275f81c72\") " pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.161466 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.161432    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:18.428990 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.428913    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aab151d6-f013-4044-a74e-c2ca55c74175" path="/var/lib/kubelet/pods/aab151d6-f013-4044-a74e-c2ca55c74175/volumes"
Sep 11 00:04:18.432457 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.432430    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6978bcbbd5-q2w9g"]
Sep 11 00:04:18.434952 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:04:18.434925    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e9d9db_4d81_4921_9337_441275f81c72.slice/crio-53ada41b949aa7a510321c7632a4c30576d6f80590001cf7b513414772a907fc WatchSource:0}: Error finding container 53ada41b949aa7a510321c7632a4c30576d6f80590001cf7b513414772a907fc: Status 404 returned error can't find the container with id 53ada41b949aa7a510321c7632a4c30576d6f80590001cf7b513414772a907fc
Sep 11 00:04:18.889690 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:18.889654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g" event={"ID":"20e9d9db-4d81-4921-9337-441275f81c72","Type":"ContainerStarted","Data":"53ada41b949aa7a510321c7632a4c30576d6f80590001cf7b513414772a907fc"}
Sep 11 00:04:19.896741 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:19.896696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g" event={"ID":"20e9d9db-4d81-4921-9337-441275f81c72","Type":"ContainerStarted","Data":"a729788ee0408bb0c9fdf4bb5e576da89f474f113066feea97c0a69d15a22de8"}
Sep 11 00:04:19.897225 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:19.896768    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:04:19.915704 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:19.915657    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g" podStartSLOduration=2.463653129 podStartE2EDuration="2.915641761s" totalImagesPullingTime="451.988632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:04:19.91361395 +0000 UTC m=+1846.017900768" watchObservedRunningTime="2026-09-11 00:04:19.915641761 +0000 UTC m=+1846.019928555"
Sep 11 00:04:30.903141 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:04:30.903111    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6978bcbbd5-q2w9g"
Sep 11 00:05:37.744072 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:37.744037    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 11 00:05:37.744674 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:37.744398    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" podUID="5004613e-9b18-4f52-8580-0ad8b1b45be1" containerName="manager" containerID="cri-o://066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a" gracePeriod=10
Sep 11 00:05:37.999236 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:37.999181    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 11 00:05:38.076353 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.076321    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume\") pod \"5004613e-9b18-4f52-8580-0ad8b1b45be1\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") "
Sep 11 00:05:38.076536 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.076445    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfd5j\" (UniqueName: \"kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j\") pod \"5004613e-9b18-4f52-8580-0ad8b1b45be1\" (UID: \"5004613e-9b18-4f52-8580-0ad8b1b45be1\") "
Sep 11 00:05:38.076714 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.076688    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5004613e-9b18-4f52-8580-0ad8b1b45be1" (UID: "5004613e-9b18-4f52-8580-0ad8b1b45be1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:05:38.078531 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.078495    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j" (OuterVolumeSpecName: "kube-api-access-nfd5j") pod "5004613e-9b18-4f52-8580-0ad8b1b45be1" (UID: "5004613e-9b18-4f52-8580-0ad8b1b45be1"). InnerVolumeSpecName "kube-api-access-nfd5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:05:38.177887 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.177848    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfd5j\" (UniqueName: \"kubernetes.io/projected/5004613e-9b18-4f52-8580-0ad8b1b45be1-kube-api-access-nfd5j\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:05:38.177887 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.177877    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5004613e-9b18-4f52-8580-0ad8b1b45be1-extensions-socket-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:05:38.282086 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.282006    2566 generic.go:356] "Generic (PLEG): container finished" podID="5004613e-9b18-4f52-8580-0ad8b1b45be1" containerID="066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a" exitCode=0
Sep 11 00:05:38.282086 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.282055    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"
Sep 11 00:05:38.282324 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.282093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" event={"ID":"5004613e-9b18-4f52-8580-0ad8b1b45be1","Type":"ContainerDied","Data":"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"}
Sep 11 00:05:38.282324 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.282145    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls" event={"ID":"5004613e-9b18-4f52-8580-0ad8b1b45be1","Type":"ContainerDied","Data":"f5c9ae838e5295835d56f62d4a0edfdb6a9aa411a243e390c852fbb53374e274"}
Sep 11 00:05:38.282324 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.282168    2566 scope.go:117] "RemoveContainer" containerID="066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"
Sep 11 00:05:38.292175 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.292155    2566 scope.go:117] "RemoveContainer" containerID="066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"
Sep 11 00:05:38.292495 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:05:38.292473    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a\": container with ID starting with 066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a not found: ID does not exist" containerID="066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"
Sep 11 00:05:38.292599 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.292500    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a"} err="failed to get container status \"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a\": rpc error: code = NotFound desc = could not find container \"066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a\": container with ID starting with 066dafa2c6b4e0b2e6388287f25aa266b9af8fbf12257547677a52f9f081e59a not found: ID does not exist"
Sep 11 00:05:38.304271 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.304245    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 11 00:05:38.308147 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.308126    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nv9ls"]
Sep 11 00:05:38.430421 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:05:38.430391    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5004613e-9b18-4f52-8580-0ad8b1b45be1" path="/var/lib/kubelet/pods/5004613e-9b18-4f52-8580-0ad8b1b45be1/volumes"
Sep 11 00:06:38.454124 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.454090    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"]
Sep 11 00:06:38.454573 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.454546    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5004613e-9b18-4f52-8580-0ad8b1b45be1" containerName="manager"
Sep 11 00:06:38.454573 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.454563    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5004613e-9b18-4f52-8580-0ad8b1b45be1" containerName="manager"
Sep 11 00:06:38.454657 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.454640    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5004613e-9b18-4f52-8580-0ad8b1b45be1" containerName="manager"
Sep 11 00:06:38.457664 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.457646    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.461377 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.461355    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8v52d\""
Sep 11 00:06:38.485215 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.485187    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"]
Sep 11 00:06:38.602966 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.602938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e50db089-63a4-4e4b-93d3-cad92636e9a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.603097 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.602984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg227\" (UniqueName: \"kubernetes.io/projected/e50db089-63a4-4e4b-93d3-cad92636e9a9-kube-api-access-kg227\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.704403 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.704338    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e50db089-63a4-4e4b-93d3-cad92636e9a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.704403 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.704386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg227\" (UniqueName: \"kubernetes.io/projected/e50db089-63a4-4e4b-93d3-cad92636e9a9-kube-api-access-kg227\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.704705 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.704685    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e50db089-63a4-4e4b-93d3-cad92636e9a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.711888 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.711865    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg227\" (UniqueName: \"kubernetes.io/projected/e50db089-63a4-4e4b-93d3-cad92636e9a9-kube-api-access-kg227\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7lqxk\" (UID: \"e50db089-63a4-4e4b-93d3-cad92636e9a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:38.767846 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:38.767822    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:39.043396 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:39.043370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"]
Sep 11 00:06:39.045828 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:06:39.045796    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50db089_63a4_4e4b_93d3_cad92636e9a9.slice/crio-cefe9f2a9c99e5b0a3c51bcfaa41355fcea0934aee84cf17c45bbae6fd43aaf7 WatchSource:0}: Error finding container cefe9f2a9c99e5b0a3c51bcfaa41355fcea0934aee84cf17c45bbae6fd43aaf7: Status 404 returned error can't find the container with id cefe9f2a9c99e5b0a3c51bcfaa41355fcea0934aee84cf17c45bbae6fd43aaf7
Sep 11 00:06:39.578709 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:39.578672    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk" event={"ID":"e50db089-63a4-4e4b-93d3-cad92636e9a9","Type":"ContainerStarted","Data":"cf268a5dd6d796aaca8708b7060b32eb9d1326f578d9f6e01f0fbb0412bb844b"}
Sep 11 00:06:39.579178 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:39.578724    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk" event={"ID":"e50db089-63a4-4e4b-93d3-cad92636e9a9","Type":"ContainerStarted","Data":"cefe9f2a9c99e5b0a3c51bcfaa41355fcea0934aee84cf17c45bbae6fd43aaf7"}
Sep 11 00:06:39.579178 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:39.578783    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:50.585372 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:50.585337    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk"
Sep 11 00:06:50.605706 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:06:50.605659    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7lqxk" podStartSLOduration=12.605643528 podStartE2EDuration="12.605643528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:06:39.600454057 +0000 UTC m=+1985.704740876" watchObservedRunningTime="2026-09-11 00:06:50.605643528 +0000 UTC m=+1996.709930396"
Sep 11 00:08:02.015100 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.015003    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"]
Sep 11 00:08:02.018627 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.018605    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.030595 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.030569    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"]
Sep 11 00:08:02.153082 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.153034    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszq8\" (UniqueName: \"kubernetes.io/projected/63ba96db-c2bd-4d03-92b8-047680c87bb8-kube-api-access-tszq8\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.153271 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.153128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ba96db-c2bd-4d03-92b8-047680c87bb8-openshift-service-ca\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.153271 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.153169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-metrics-certs\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.153271 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.153199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-maas-api-tls\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.254871 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.254824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszq8\" (UniqueName: \"kubernetes.io/projected/63ba96db-c2bd-4d03-92b8-047680c87bb8-kube-api-access-tszq8\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.255244 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.255219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ba96db-c2bd-4d03-92b8-047680c87bb8-openshift-service-ca\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.255438 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.255414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-metrics-certs\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.255573 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.255556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-maas-api-tls\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.256153 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.256127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ba96db-c2bd-4d03-92b8-047680c87bb8-openshift-service-ca\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.258093 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.258062    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-metrics-certs\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.258242 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.258224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ba96db-c2bd-4d03-92b8-047680c87bb8-maas-api-tls\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.262622 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.262601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszq8\" (UniqueName: \"kubernetes.io/projected/63ba96db-c2bd-4d03-92b8-047680c87bb8-kube-api-access-tszq8\") pod \"maas-api-5db99c876b-b8cn7\" (UID: \"63ba96db-c2bd-4d03-92b8-047680c87bb8\") " pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.330382 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.330271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:02.601405 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.601326    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"]
Sep 11 00:08:02.605219 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:08:02.605189    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ba96db_c2bd_4d03_92b8_047680c87bb8.slice/crio-8852b117c284b02eca4890cebe450ac9988d7d1b6ac38d78c25429294d9fb12e WatchSource:0}: Error finding container 8852b117c284b02eca4890cebe450ac9988d7d1b6ac38d78c25429294d9fb12e: Status 404 returned error can't find the container with id 8852b117c284b02eca4890cebe450ac9988d7d1b6ac38d78c25429294d9fb12e
Sep 11 00:08:02.976272 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:02.976235    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7" event={"ID":"63ba96db-c2bd-4d03-92b8-047680c87bb8","Type":"ContainerStarted","Data":"8852b117c284b02eca4890cebe450ac9988d7d1b6ac38d78c25429294d9fb12e"}
Sep 11 00:08:03.982946 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:03.982900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7" event={"ID":"63ba96db-c2bd-4d03-92b8-047680c87bb8","Type":"ContainerStarted","Data":"d2cf7823ccf054ee7326e5f9d3f78e9d31f720b696830531c9317ecdeff8d8c1"}
Sep 11 00:08:03.983397 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:03.982973    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:03.998364 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:03.998319    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7" podStartSLOduration=2.59486062 podStartE2EDuration="2.998279643s" totalImagesPullingTime="403.419023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:08:03.996647102 +0000 UTC m=+2070.100933897" watchObservedRunningTime="2026-09-11 00:08:03.998279643 +0000 UTC m=+2070.102566436"
Sep 11 00:08:09.993233 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:09.993203    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5db99c876b-b8cn7"
Sep 11 00:08:17.444106 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:17.444070    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 11 00:08:17.444620 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:17.444582    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" podUID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" containerName="maas-api" containerID="cri-o://9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142" gracePeriod=30
Sep 11 00:08:18.689783 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.689752    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 11 00:08:18.712532 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.712283    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5977s\" (UniqueName: \"kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s\") pod \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") "
Sep 11 00:08:18.712532 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.712402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca\") pod \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") "
Sep 11 00:08:18.712532 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.712432    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls\") pod \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") "
Sep 11 00:08:18.712532 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.712462    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") pod \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\" (UID: \"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa\") "
Sep 11 00:08:18.712911 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.712796    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" (UID: "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:08:18.714733 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.714705    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" (UID: "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:08:18.714923 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.714907    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s" (OuterVolumeSpecName: "kube-api-access-5977s") pod "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" (UID: "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa"). InnerVolumeSpecName "kube-api-access-5977s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:08:18.715042 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.715026    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" (UID: "d5aa8eaa-08b3-4a87-bc65-5193bb5401aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:08:18.813634 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.813552    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5977s\" (UniqueName: \"kubernetes.io/projected/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-kube-api-access-5977s\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:08:18.813634 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.813585    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:08:18.813634 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.813595    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:08:18.813634 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:18.813604    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 11 00:08:19.060731 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.060692    2566 generic.go:356] "Generic (PLEG): container finished" podID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" containerID="9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142" exitCode=0
Sep 11 00:08:19.060932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.060742    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"
Sep 11 00:08:19.060932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.060768    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" event={"ID":"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa","Type":"ContainerDied","Data":"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"}
Sep 11 00:08:19.060932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.060830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs" event={"ID":"d5aa8eaa-08b3-4a87-bc65-5193bb5401aa","Type":"ContainerDied","Data":"3d10f9bdffbe6f76ffeb1d2d42e1d7db6232c694597c8b70b9d91bb45367a42e"}
Sep 11 00:08:19.060932 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.060865    2566 scope.go:117] "RemoveContainer" containerID="9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"
Sep 11 00:08:19.070909 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.070895    2566 scope.go:117] "RemoveContainer" containerID="9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"
Sep 11 00:08:19.071199 ip-10-0-143-95 kubenswrapper[2566]: E0911 00:08:19.071179    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142\": container with ID starting with 9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142 not found: ID does not exist" containerID="9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"
Sep 11 00:08:19.071278 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.071204    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142"} err="failed to get container status \"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142\": rpc error: code = NotFound desc = could not find container \"9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142\": container with ID starting with 9079c26d1345deea8e1ef49949ac14266c2f8895a42e266581ddbaf185c2d142 not found: ID does not exist"
Sep 11 00:08:19.082041 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.082013    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 11 00:08:19.083773 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:19.083747    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6545cd6846-8mbgs"]
Sep 11 00:08:20.430432 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:20.430395    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" path="/var/lib/kubelet/pods/d5aa8eaa-08b3-4a87-bc65-5193bb5401aa/volumes"
Sep 11 00:08:36.908700 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:36.908669    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6978bcbbd5-q2w9g_20e9d9db-4d81-4921-9337-441275f81c72/manager/0.log"
Sep 11 00:08:37.365885 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:37.365807    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-5mjj6_0f84faa1-ab22-4346-b437-113436e6177a/copy-manifests/0.log"
Sep 11 00:08:37.372377 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:37.372285    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-5mjj6_0f84faa1-ab22-4346-b437-113436e6177a/manager/0.log"
Sep 11 00:08:37.815516 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:37.815483    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5db99c876b-b8cn7_63ba96db-c2bd-4d03-92b8-047680c87bb8/maas-api/0.log"
Sep 11 00:08:38.251863 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:38.251834    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8j6bz_169f4af2-c429-4b89-8129-6be19ff6f258/postgres/0.log"
Sep 11 00:08:39.120341 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:39.120289    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-pf2ds_7eb9ede8-1b94-4cec-b2b5-63335be78eac/manager/0.log"
Sep 11 00:08:39.227912 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:39.227886    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-s7pbp_404943aa-8fd9-4319-ad0c-5941d5bb2227/manager/0.log"
Sep 11 00:08:39.448377 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:39.448314    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7lqxk_e50db089-63a4-4e4b-93d3-cad92636e9a9/manager/0.log"
Sep 11 00:08:39.668460 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:39.668429    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-szt28_0f0d01c7-7b88-460c-ae8d-efde59ca589d/manager/0.log"
Sep 11 00:08:40.113246 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:40.113214    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfgtk_287e5d87-77ca-4752-b57b-7b91c8c79583/discovery/0.log"
Sep 11 00:08:40.222267 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:40.222238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-49kn7_31c93a61-a65c-428c-be64-3da2c527f2a8/kube-auth-proxy/0.log"
Sep 11 00:08:40.666576 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:40.666546    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 11 00:08:41.218995 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:41.218960    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-lpjk5_06669687-7377-463a-8c6f-9230f4281612/main/0.log"
Sep 11 00:08:50.321063 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:50.321031    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxhws_6ba092d9-9f97-4e55-96bf-2b84fd488f12/global-pull-secret-syncer/0.log"
Sep 11 00:08:50.498800 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:50.498768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qx7q4_14721e57-7de2-43da-9bb2-f55002226968/konnectivity-agent/0.log"
Sep 11 00:08:50.558415 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:50.558390    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-95.ec2.internal_182c03c78ab71663e42db8a5ead7b76b/haproxy/0.log"
Sep 11 00:08:55.126610 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:55.126522    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-pf2ds_7eb9ede8-1b94-4cec-b2b5-63335be78eac/manager/0.log"
Sep 11 00:08:55.185497 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:55.185451    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-s7pbp_404943aa-8fd9-4319-ad0c-5941d5bb2227/manager/0.log"
Sep 11 00:08:55.248873 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:55.248842    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7lqxk_e50db089-63a4-4e4b-93d3-cad92636e9a9/manager/0.log"
Sep 11 00:08:55.356767 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:55.356737    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-szt28_0f0d01c7-7b88-460c-ae8d-efde59ca589d/manager/0.log"
Sep 11 00:08:56.812554 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.812526    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/alertmanager/0.log"
Sep 11 00:08:56.836616 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.836589    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/config-reloader/0.log"
Sep 11 00:08:56.857195 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.857173    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/kube-rbac-proxy-web/0.log"
Sep 11 00:08:56.879886 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.879867    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/kube-rbac-proxy/0.log"
Sep 11 00:08:56.902430 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.902408    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/kube-rbac-proxy-metric/0.log"
Sep 11 00:08:56.923890 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.923868    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/prom-label-proxy/0.log"
Sep 11 00:08:56.944176 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:56.944158    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2365e82a-2bac-40e8-8aa1-e47f91eda640/init-config-reloader/0.log"
Sep 11 00:08:57.007528 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.007509    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8sn4j_d1d9423f-2229-48b6-a7fd-b1d8fa512476/kube-state-metrics/0.log"
Sep 11 00:08:57.027209 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.027185    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8sn4j_d1d9423f-2229-48b6-a7fd-b1d8fa512476/kube-rbac-proxy-main/0.log"
Sep 11 00:08:57.047106 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.047089    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8sn4j_d1d9423f-2229-48b6-a7fd-b1d8fa512476/kube-rbac-proxy-self/0.log"
Sep 11 00:08:57.081541 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.081475    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b76596d97-x8ndv_96ebed4d-92a6-465c-9d3f-fa0773328339/metrics-server/0.log"
Sep 11 00:08:57.108916 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.108899    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-kpnzs_9334f8b6-435a-44eb-a66c-4c4b1a78780b/monitoring-plugin/0.log"
Sep 11 00:08:57.144794 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.144773    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59z7j_e445e088-de11-41e7-bb3e-d004f4e9e6a2/node-exporter/0.log"
Sep 11 00:08:57.165234 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.165208    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59z7j_e445e088-de11-41e7-bb3e-d004f4e9e6a2/kube-rbac-proxy/0.log"
Sep 11 00:08:57.183874 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.183856    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59z7j_e445e088-de11-41e7-bb3e-d004f4e9e6a2/init-textfile/0.log"
Sep 11 00:08:57.495042 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.495008    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/prometheus/0.log"
Sep 11 00:08:57.542519 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.542492    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/config-reloader/0.log"
Sep 11 00:08:57.564075 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.564050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/thanos-sidecar/0.log"
Sep 11 00:08:57.583860 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.583826    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/kube-rbac-proxy-web/0.log"
Sep 11 00:08:57.606019 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.605997    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/kube-rbac-proxy/0.log"
Sep 11 00:08:57.629830 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.629806    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/kube-rbac-proxy-thanos/0.log"
Sep 11 00:08:57.653107 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.653073    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c9922bc4-fc5d-4601-9311-2f4dc12580ed/init-config-reloader/0.log"
Sep 11 00:08:57.685354 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.685323    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pnpnp_8160215e-c1b2-4554-acf9-a3d758540242/prometheus-operator/0.log"
Sep 11 00:08:57.710522 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:08:57.710502    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pnpnp_8160215e-c1b2-4554-acf9-a3d758540242/kube-rbac-proxy/0.log"
Sep 11 00:09:00.629495 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.629456    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"]
Sep 11 00:09:00.630008 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.629982    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" containerName="maas-api"
Sep 11 00:09:00.630008 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.630003    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" containerName="maas-api"
Sep 11 00:09:00.630225 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.630087    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5aa8eaa-08b3-4a87-bc65-5193bb5401aa" containerName="maas-api"
Sep 11 00:09:00.633429 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.633410    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.635775 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.635754    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzltk\"/\"kube-root-ca.crt\""
Sep 11 00:09:00.635872 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.635753    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzltk\"/\"openshift-service-ca.crt\""
Sep 11 00:09:00.636611 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.636595    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzltk\"/\"default-dockercfg-cvh2v\""
Sep 11 00:09:00.641511 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.641487    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"]
Sep 11 00:09:00.786245 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.786206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-sys\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.786478 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.786269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-podres\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.786478 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.786342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-lib-modules\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.786478 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.786408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-proc\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.786478 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.786445    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6px\" (UniqueName: \"kubernetes.io/projected/ff28c016-8625-4c01-85d8-d480be2f7812-kube-api-access-gr6px\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887562 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887483    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-proc\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887562 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6px\" (UniqueName: \"kubernetes.io/projected/ff28c016-8625-4c01-85d8-d480be2f7812-kube-api-access-gr6px\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887600    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-sys\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887608    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-proc\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-podres\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887735 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-lib-modules\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887875 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887802    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-lib-modules\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887875 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887802    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-podres\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.887875 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.887840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff28c016-8625-4c01-85d8-d480be2f7812-sys\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.894564 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.894544    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6px\" (UniqueName: \"kubernetes.io/projected/ff28c016-8625-4c01-85d8-d480be2f7812-kube-api-access-gr6px\") pod \"perf-node-gather-daemonset-xccdg\" (UID: \"ff28c016-8625-4c01-85d8-d480be2f7812\") " pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:00.945439 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:00.945401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:01.214859 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:01.214831    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"]
Sep 11 00:09:01.216318 ip-10-0-143-95 kubenswrapper[2566]: W0911 00:09:01.216275    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff28c016_8625_4c01_85d8_d480be2f7812.slice/crio-e898db11fb1dbf5f1cdfb227360278bb4448c7a7615e9e2a95231094a84a3101 WatchSource:0}: Error finding container e898db11fb1dbf5f1cdfb227360278bb4448c7a7615e9e2a95231094a84a3101: Status 404 returned error can't find the container with id e898db11fb1dbf5f1cdfb227360278bb4448c7a7615e9e2a95231094a84a3101
Sep 11 00:09:01.262232 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:01.262197    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg" event={"ID":"ff28c016-8625-4c01-85d8-d480be2f7812","Type":"ContainerStarted","Data":"e898db11fb1dbf5f1cdfb227360278bb4448c7a7615e9e2a95231094a84a3101"}
Sep 11 00:09:02.268549 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.268515    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg" event={"ID":"ff28c016-8625-4c01-85d8-d480be2f7812","Type":"ContainerStarted","Data":"fec366e32999c26dd02a3069f70589bdb46a81e47cbd6722a3c133835291ac40"}
Sep 11 00:09:02.269041 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.268622    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:02.283692 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.283645    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg" podStartSLOduration=2.283628709 podStartE2EDuration="2.283628709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:09:02.282429061 +0000 UTC m=+2128.386715877" watchObservedRunningTime="2026-09-11 00:09:02.283628709 +0000 UTC m=+2128.387915502"
Sep 11 00:09:02.446207 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.446176    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mh26h_a112a57d-1f21-4858-8d96-24ed8f500307/dns/0.log"
Sep 11 00:09:02.465430 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.465404    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mh26h_a112a57d-1f21-4858-8d96-24ed8f500307/kube-rbac-proxy/0.log"
Sep 11 00:09:02.552467 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:02.552396    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bgsfj_b96907f5-8a0e-430d-9109-0967c52d0143/dns-node-resolver/0.log"
Sep 11 00:09:03.076091 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:03.076061    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29818080-c999f_f20f01c1-3918-4caf-8126-ab8ad43eff8a/image-pruner/0.log"
Sep 11 00:09:03.133507 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:03.133481    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-58rvz_26098ab1-eedb-4f96-b854-19f27d7c41b9/node-ca/0.log"
Sep 11 00:09:04.319607 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:04.319574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfgtk_287e5d87-77ca-4752-b57b-7b91c8c79583/discovery/0.log"
Sep 11 00:09:04.338406 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:04.338382    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-49kn7_31c93a61-a65c-428c-be64-3da2c527f2a8/kube-auth-proxy/0.log"
Sep 11 00:09:04.461554 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:04.461525    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 11 00:09:05.303339 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:05.303311    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2c67f_64a20dd9-e072-4450-9ea7-8de06f761ee3/serve-healthcheck-canary/0.log"
Sep 11 00:09:05.808163 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:05.808137    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9hdtx_b076b972-5a0a-4d99-bba4-6e0c4f765e51/kube-rbac-proxy/0.log"
Sep 11 00:09:05.835258 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:05.835236    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9hdtx_b076b972-5a0a-4d99-bba4-6e0c4f765e51/exporter/0.log"
Sep 11 00:09:05.858215 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:05.858195    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9hdtx_b076b972-5a0a-4d99-bba4-6e0c4f765e51/extractor/0.log"
Sep 11 00:09:08.206705 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:08.206663    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6978bcbbd5-q2w9g_20e9d9db-4d81-4921-9337-441275f81c72/manager/0.log"
Sep 11 00:09:08.283794 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:08.283768    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzltk/perf-node-gather-daemonset-xccdg"
Sep 11 00:09:08.436909 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:08.436869    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-5mjj6_0f84faa1-ab22-4346-b437-113436e6177a/manager/0.log"
Sep 11 00:09:08.454744 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:08.454718    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc8465fcf-5mjj6_0f84faa1-ab22-4346-b437-113436e6177a/copy-manifests/0.log"
Sep 11 00:09:09.862355 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:09.862257    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tq976_7f727fd6-2b32-4b79-a074-87184575d6eb/openshift-lws-operator/0.log"
Sep 11 00:09:11.047877 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:11.047792    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfgtk_287e5d87-77ca-4752-b57b-7b91c8c79583/discovery/0.log"
Sep 11 00:09:11.058597 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:11.058574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-49kn7_31c93a61-a65c-428c-be64-3da2c527f2a8/kube-auth-proxy/0.log"
Sep 11 00:09:11.151884 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:11.151856    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 11 00:09:12.880500 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:12.880394    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfgtk_287e5d87-77ca-4752-b57b-7b91c8c79583/discovery/0.log"
Sep 11 00:09:12.895311 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:12.895282    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb577d9c6-49kn7_31c93a61-a65c-428c-be64-3da2c527f2a8/kube-auth-proxy/0.log"
Sep 11 00:09:12.995419 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:12.995385    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tnhb_9e0b83cf-839e-4383-b0d9-4209a82fb10c/payload-processing/0.log"
Sep 11 00:09:16.382768 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.382741    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/kube-multus-additional-cni-plugins/0.log"
Sep 11 00:09:16.401080 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.401058    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/egress-router-binary-copy/0.log"
Sep 11 00:09:16.419510 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.419490    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/cni-plugins/0.log"
Sep 11 00:09:16.438424 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.438406    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/bond-cni-plugin/0.log"
Sep 11 00:09:16.459756 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.459727    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/routeoverride-cni/0.log"
Sep 11 00:09:16.478059 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.478042    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/whereabouts-cni-bincopy/0.log"
Sep 11 00:09:16.496084 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.496064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qnst_13977e3f-e7d6-408a-a440-fde856dba0f6/whereabouts-cni/0.log"
Sep 11 00:09:16.815876 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.815847    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bkwkz_7d59a859-f908-4316-9b22-6992f0f09c15/kube-multus/0.log"
Sep 11 00:09:16.913098 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.913073    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j296r_2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d/network-metrics-daemon/0.log"
Sep 11 00:09:16.929132 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:16.929108    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j296r_2f6604e1-2bb7-43d3-8f8d-1cbd0a9a762d/kube-rbac-proxy/0.log"
Sep 11 00:09:17.730544 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.730514    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/ovn-controller/0.log"
Sep 11 00:09:17.744772 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.744747    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/ovn-acl-logging/0.log"
Sep 11 00:09:17.764259 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.764238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/kube-rbac-proxy-node/0.log"
Sep 11 00:09:17.785370 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.785351    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/kube-rbac-proxy-ovn-metrics/0.log"
Sep 11 00:09:17.807602 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.807585    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/northd/0.log"
Sep 11 00:09:17.827728 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.827712    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/nbdb/0.log"
Sep 11 00:09:17.846419 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.846399    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/sbdb/0.log"
Sep 11 00:09:17.897064 ip-10-0-143-95 kubenswrapper[2566]: I0911 00:09:17.897041    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46qtp_ec1a9277-b46c-4afd-82d8-6211cea76a75/ovnkube-controller/0.log"