Sep 12 00:29:06.834062 ip-10-0-131-144 systemd[1]: Starting Kubernetes Kubelet...
Sep 12 00:29:07.222303 ip-10-0-131-144 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:29:07.222303 ip-10-0-131-144 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 12 00:29:07.222303 ip-10-0-131-144 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:29:07.222303 ip-10-0-131-144 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 12 00:29:07.222303 ip-10-0-131-144 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:29:07.223049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.222967    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 12 00:29:07.226481 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226467    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.226481 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226481    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226485    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226489    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226492    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226495    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226497    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226500    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226505    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226509    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226512    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226520    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226523    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226525    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226528    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226530    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226533    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226535    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226538    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226540    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226543    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.226542 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226546    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226548    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226551    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226556    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226559    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226562    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226565    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226567    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226570    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226573    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226575    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226578    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226580    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226583    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226585    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226588    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226591    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226594    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226596    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226598    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.227017 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226602    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226604    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226607    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226609    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226611    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226614    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226616    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226619    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226621    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226624    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226626    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226629    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226631    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226634    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226637    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226640    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226642    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226645    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226649    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226651    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.227510 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226654    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226657    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226659    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226662    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226664    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226667    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226669    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226672    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226674    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226677    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226680    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226682    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226685    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226687    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226690    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226692    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226695    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226697    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226699    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.227997 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226702    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226704    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226707    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226709    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226711    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226714    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226716    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226719    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226722    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226725    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226727    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226729    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226732    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226736    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226739    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226742    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226745    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226748    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.226751    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227419    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.228460 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227425    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227427    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227430    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227433    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227436    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227439    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227442    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227445    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227448    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227450    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227453    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227455    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227458    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227461    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227464    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227466    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227469    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227472    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227474    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227478    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.228946 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227480    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227483    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227486    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227488    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227491    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227493    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227496    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227500    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227504    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227506    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227509    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227512    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227515    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227517    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227520    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227522    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227525    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227528    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227532    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227534    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.229422 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227537    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227539    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227541    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227544    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227546    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227548    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227551    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227553    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227556    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227558    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227561    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227564    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227566    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227569    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227572    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227574    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227577    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227579    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227581    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227584    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.229948 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227586    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227589    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227591    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227594    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227596    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227599    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227601    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227603    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227606    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227609    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227614    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227617    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227620    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227622    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227625    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227627    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227630    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227633    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227635    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227638    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.230420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227641    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227645    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227648    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227651    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227654    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227656    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227659    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227661    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227664    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227666    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227669    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227671    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227674    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227676    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227679    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227681    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227684    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.227686    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228056    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.230899 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228061    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228064    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228067    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228071    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228075    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228078    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228080    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228083    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228086    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228089    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228092    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228096    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228099    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228102    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228105    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228108    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228111    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228114    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228117    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.231353 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228119    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228122    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228125    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228128    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228130    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228133    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228136    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228138    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228141    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228143    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228146    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228150    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228153    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228156    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228159    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228162    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228164    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228168    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228170    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.231822 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228172    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228175    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228178    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228180    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228182    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228185    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228187    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228190    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228192    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228195    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228198    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228200    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228203    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228205    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228208    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228210    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228213    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228215    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228217    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.232263 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228220    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228222    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228224    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228227    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228229    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228231    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228234    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228237    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228240    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228242    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228244    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228247    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228250    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228252    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228255    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228257    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228259    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228262    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228264    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228267    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.232800 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228270    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228272    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228274    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228277    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228279    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228281    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228284    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228286    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228288    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228291    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228293    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228296    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228298    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228301    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228303    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228305    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228308    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228310    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228313    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228316    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.228319    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.233274 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228384    2556 flags.go:64] FLAG: --address="0.0.0.0"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228419    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228425    2556 flags.go:64] FLAG: --anonymous-auth="true"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228429    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228438    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228441    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228446    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228450    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228454    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228457    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228461    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228464    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228467    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228470    2556 flags.go:64] FLAG: --cgroup-root=""
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228473    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228476    2556 flags.go:64] FLAG: --client-ca-file=""
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228479    2556 flags.go:64] FLAG: --cloud-provider="external"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228482    2556 flags.go:64] FLAG: --cluster-dns="[]"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228485    2556 flags.go:64] FLAG: --cluster-domain=""
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228488    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228491    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228494    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228497    2556 flags.go:64] FLAG: --container-log-max-files="5"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228501    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 12 00:29:07.233798 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228503    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228506    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228510    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228512    2556 flags.go:64] FLAG: --contention-profiling="false"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228515    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228518    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228522    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228525    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228529    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228533    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228536    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228539    2556 flags.go:64] FLAG: --enable-load-reader="false"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228542    2556 flags.go:64] FLAG: --enable-server="true"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228545    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228549    2556 flags.go:64] FLAG: --event-burst="100"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228552    2556 flags.go:64] FLAG: --event-qps="50"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228556    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228558    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228561    2556 flags.go:64] FLAG: --eviction-hard=""
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228565    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228567    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228570    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228573    2556 flags.go:64] FLAG: --eviction-soft=""
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228576    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228579    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 12 00:29:07.234344 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228582    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228585    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228588    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228590    2556 flags.go:64] FLAG: --fail-swap-on="true"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228593    2556 flags.go:64] FLAG: --feature-gates=""
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228597    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228599    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228602    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228605    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228608    2556 flags.go:64] FLAG: --healthz-port="10248"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228611    2556 flags.go:64] FLAG: --help="false"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228616    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228619    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228624    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228627    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228630    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228633    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228636    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228639    2556 flags.go:64] FLAG: --image-service-endpoint=""
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228641    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228644    2556 flags.go:64] FLAG: --kube-api-burst="100"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228648    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228651    2556 flags.go:64] FLAG: --kube-api-qps="50"
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228654    2556 flags.go:64] FLAG: --kube-reserved=""
Sep 12 00:29:07.234986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228657    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228659    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228662    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228665    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228668    2556 flags.go:64] FLAG: --lock-file=""
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228671    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228673    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228676    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228681    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228684    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228687    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228689    2556 flags.go:64] FLAG: --logging-format="text"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228692    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228695    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228698    2556 flags.go:64] FLAG: --manifest-url=""
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228700    2556 flags.go:64] FLAG: --manifest-url-header=""
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228704    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228707    2556 flags.go:64] FLAG: --max-open-files="1000000"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228710    2556 flags.go:64] FLAG: --max-pods="110"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228715    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228718    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228722    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228725    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228728    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228731    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 12 00:29:07.235615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228734    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228741    2556 flags.go:64] FLAG: --node-status-max-images="50"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228744    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228747    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228750    2556 flags.go:64] FLAG: --pod-cidr=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228765    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228770    2556 flags.go:64] FLAG: --pod-manifest-path=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228773    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228776    2556 flags.go:64] FLAG: --pods-per-core="0"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228779    2556 flags.go:64] FLAG: --port="10250"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228782    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228785    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-097bb3ca18535339a"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228788    2556 flags.go:64] FLAG: --qos-reserved=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228791    2556 flags.go:64] FLAG: --read-only-port="10255"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228793    2556 flags.go:64] FLAG: --register-node="true"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228796    2556 flags.go:64] FLAG: --register-with-taints=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228800    2556 flags.go:64] FLAG: --registry-burst="10"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228802    2556 flags.go:64] FLAG: --registry-qps="5"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228805    2556 flags.go:64] FLAG: --reserved-cpus=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228808    2556 flags.go:64] FLAG: --reserved-memory=""
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228811    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228814    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228817    2556 flags.go:64] FLAG: --rotate-certificates="false"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228820    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228823    2556 flags.go:64] FLAG: --runonce="false"
Sep 12 00:29:07.236573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228826    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228830    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228833    2556 flags.go:64] FLAG: --seccomp-default="false"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228836    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228841    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228844    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228847    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228850    2556 flags.go:64] FLAG: --storage-driver-password="root"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228852    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228855    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228858    2556 flags.go:64] FLAG: --storage-driver-user="root"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228861    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228864    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228868    2556 flags.go:64] FLAG: --system-cgroups=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228870    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228876    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228879    2556 flags.go:64] FLAG: --tls-cert-file=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228882    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228885    2556 flags.go:64] FLAG: --tls-min-version=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228888    2556 flags.go:64] FLAG: --tls-private-key-file=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228890    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228893    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228896    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228899    2556 flags.go:64] FLAG: --v="2"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228903    2556 flags.go:64] FLAG: --version="false"
Sep 12 00:29:07.237194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228907    2556 flags.go:64] FLAG: --vmodule=""
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228910    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.228913    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229019    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229023    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229026    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229029    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229031    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229035    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229038    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229040    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229044    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229047    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229049    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229052    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229054    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229057    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229059    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229062    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229065    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.237809 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229067    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229070    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229073    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229075    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229078    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229080    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229083    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229085    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229088    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229091    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229093    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229095    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229098    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229100    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229103    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229107    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229110    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229113    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229116    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229119    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.238294 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229123    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229125    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229128    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229132    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229134    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229137    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229139    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229142    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229144    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229147    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229149    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229151    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229154    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229156    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229159    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229162    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229164    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229167    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229171    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.238780 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229174    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229177    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229181    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229185    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229189    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229191    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229194    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229196    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229199    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229201    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229203    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229206    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229208    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229212    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229215    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229217    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229221    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229223    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229226    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229229    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.239268 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229231    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229234    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229236    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229238    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229241    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229243    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229246    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229248    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229575    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229579    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229581    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229584    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229587    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229591    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229594    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229597    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229600    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229603    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229606    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229609    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.239741 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229611    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229613    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.229616    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.229624    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.238315    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.238330    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.238344    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.238350    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238404    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238408    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238411    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238414    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238418    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238423    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.240230 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238426    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238429    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238432    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238435    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238437    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238439    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238442    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238444    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238447    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238449    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238451    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238454    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238456    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238459    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238461    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238464    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238466    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238469    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238471    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238474    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.240569 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238476    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238483    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238486    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238489    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238491    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238494    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238496    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238500    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238504    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238507    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238509    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238512    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238515    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238517    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238520    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238522    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238525    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238527    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238530    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238532    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.241054 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238535    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238537    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238539    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238542    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238544    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238547    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238549    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238552    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238555    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238558    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238560    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238562    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238565    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238567    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238569    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238572    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238575    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238577    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238580    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238582    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.241525 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238585    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238587    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238590    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238592    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238594    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238597    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238599    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238602    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238604    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238607    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238609    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238612    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238614    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238617    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238620    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238622    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238625    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238627    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238630    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238632    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.242023 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238635    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238637    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238641    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238644    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238647    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238650    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238652    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238655    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238659    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238661    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238665    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238667    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238670    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.238675    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:29:07.242523 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238802    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238808    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238811    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238814    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238817    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238820    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238822    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238825    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238828    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238831    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238833    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238836    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238839    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238841    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238844    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238846    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238849    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238851    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238854    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238856    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:29:07.242872 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238858    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238861    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238863    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238866    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238868    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238871    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238874    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238879    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238882    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238885    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238888    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238891    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238894    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238896    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238899    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238902    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238905    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238907    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238910    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:29:07.243332 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238912    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238915    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238917    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238920    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238922    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238925    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238938    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238942    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238945    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238948    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238952    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238955    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238958    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238961    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238964    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238967    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238969    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238972    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238975    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238978    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:29:07.243879 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238981    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238984    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238986    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238989    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238991    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238994    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238996    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.238999    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239001    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239004    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239006    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239009    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239011    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239013    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239016    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239018    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239021    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239023    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239025    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:29:07.244355 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239029    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239032    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239034    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239037    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239039    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239042    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239044    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239047    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239049    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239051    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239054    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239056    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239059    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239061    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239064    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239067    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239069    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239071    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239074    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239076    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:29:07.244823 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:07.239079    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.239084    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.239183    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.241025    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.241981    2556 server.go:1019] "Starting client certificate rotation"
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.242083    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.242898    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 00:29:07.245279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.244325    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 00:29:07.245513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.245399    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 00:29:07.255325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.255308    2556 log.go:25] "Validated CRI v1 runtime API"
Sep 12 00:29:07.258518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.258505    2556 log.go:25] "Validated CRI v1 image API"
Sep 12 00:29:07.259337 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.259313    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 12 00:29:07.264007 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.263990    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7e9d5be1-b6c7-43f2-ad55-1146cba58f18:/dev/nvme0n1p4 8632ab3b-dbe7-4902-bd93-2517955642b5:/dev/nvme0n1p3]
Sep 12 00:29:07.264068 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.264006    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 12 00:29:07.270346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.270238    2556 manager.go:216] Machine: {Timestamp:2026-09-12 00:29:07.268976473 +0000 UTC m=+0.319562071 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3196790 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2731aa1e3b154290d7a92bb8194743 SystemUUID:ec2731aa-1e3b-1542-90d7-a92bb8194743 BootID:61eec7f1-a55a-4515-bc57-8771c7115fea Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:47:1d:99:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:47:1d:99:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:e5:3b:f0:0d:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 12 00:29:07.270346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.270338    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 12 00:29:07.270475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.270412    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 12 00:29:07.273346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.273319    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 12 00:29:07.273518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.273348    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 12 00:29:07.274105 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.274093    2556 topology_manager.go:138] "Creating topology manager with none policy"
Sep 12 00:29:07.274159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.274110    2556 container_manager_linux.go:309] "Creating device plugin manager"
Sep 12 00:29:07.274159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.274120    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 00:29:07.274380 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.274364    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 00:29:07.274684 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.274670    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 00:29:07.275403 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.275391    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 12 00:29:07.277838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.277824    2556 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 00:29:07.277964 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.277953    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 12 00:29:07.278029 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.277990    2556 kubelet.go:486] "Attempting to sync node with API server"
Sep 12 00:29:07.278029 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278003    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 12 00:29:07.278029 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278021    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 12 00:29:07.278145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278033    2556 kubelet.go:398] "Adding apiserver pod source"
Sep 12 00:29:07.278145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278046    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 12 00:29:07.278405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278392    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 00:29:07.278464 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.278414    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 00:29:07.281254 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.281238    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 12 00:29:07.283401 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.283388    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 12 00:29:07.283455 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.283416    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 12 00:29:07.285427 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285414    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 12 00:29:07.285473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285436    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 12 00:29:07.285473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285446    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 12 00:29:07.285473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285454    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 12 00:29:07.285473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285466    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285475    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285493    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285501    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285513    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285521    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285539    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 12 00:29:07.285593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.285547    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 12 00:29:07.286334 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.286322    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 12 00:29:07.286373 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.286335    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 12 00:29:07.287618 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.287558    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 12 00:29:07.287688 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.287666    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 12 00:29:07.290298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.290285    2556 server.go:1268] "Started kubelet"
Sep 12 00:29:07.290413 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.290357    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 12 00:29:07.290413 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.290376    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 12 00:29:07.290541 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.290434    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 12 00:29:07.291131 ip-10-0-131-144 systemd[1]: Started Kubernetes Kubelet.
Sep 12 00:29:07.291875 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.291851    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 12 00:29:07.292349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.292334    2556 server.go:310] "Adding debug handlers to kubelet server"
Sep 12 00:29:07.296226 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.296209    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 12 00:29:07.296226 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.296220    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 12 00:29:07.297540 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.297505    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.297722 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.297704    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 12 00:29:07.298089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298054    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 12 00:29:07.298089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298081    2556 factory.go:55] Registering systemd factory
Sep 12 00:29:07.298220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298097    2556 factory.go:223] Registration of the systemd container factory successfully
Sep 12 00:29:07.298220 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.298080    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 12 00:29:07.298334 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298322    2556 factory.go:153] Registering CRI-O factory
Sep 12 00:29:07.298389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298336    2556 factory.go:223] Registration of the crio container factory successfully
Sep 12 00:29:07.298389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298352    2556 factory.go:103] Registering Raw factory
Sep 12 00:29:07.298389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298364    2556 manager.go:1196] Started watching for new ooms in manager
Sep 12 00:29:07.298837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298817    2556 manager.go:349] Starting recovery of all containers
Sep 12 00:29:07.298887 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298841    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 12 00:29:07.298887 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298860    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 12 00:29:07.298991 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298980    2556 reconstruct.go:97] "Volume reconstruction finished"
Sep 12 00:29:07.298991 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.298991    2556 reconciler.go:29] "Reconciler: start to sync state"
Sep 12 00:29:07.299408 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.298250    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-144.ec2.internal.18d46b50ecf981be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-144.ec2.internal,UID:ip-10-0-131-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-144.ec2.internal,},FirstTimestamp:2026-09-12 00:29:07.290259902 +0000 UTC m=+0.340845500,LastTimestamp:2026-09-12 00:29:07.290259902 +0000 UTC m=+0.340845500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-144.ec2.internal,}"
Sep 12 00:29:07.299489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.299467    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 12 00:29:07.304125 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.304096    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 12 00:29:07.304355 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.304328    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 12 00:29:07.310966 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.310942    2556 manager.go:354] Recovery completed
Sep 12 00:29:07.313650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.313495    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gn5j5"
Sep 12 00:29:07.315076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.315065    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.316902 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.316882    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.316973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.316915    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.316973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.316929    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.317488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.317461    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 12 00:29:07.317488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.317473    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 12 00:29:07.317488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.317476    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.317488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.317489    2556 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 00:29:07.318130 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318117    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.318203 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318140    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.318203 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318156    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.318748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318736    2556 policy_none.go:49] "None policy: Start"
Sep 12 00:29:07.318838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318803    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 12 00:29:07.318838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.318818    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 12 00:29:07.319024 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.318942    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-144.ec2.internal.18d46b50ee8ffe85  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-144.ec2.internal,UID:ip-10-0-131-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-144.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-144.ec2.internal,},FirstTimestamp:2026-09-12 00:29:07.316899461 +0000 UTC m=+0.367485063,LastTimestamp:2026-09-12 00:29:07.316899461 +0000 UTC m=+0.367485063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-144.ec2.internal,}"
Sep 12 00:29:07.319783 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.319769    2556 policy_none.go:47] "Start"
Sep 12 00:29:07.320586 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.320568    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gn5j5"
Sep 12 00:29:07.341406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341393    2556 manager.go:337] "Starting Device Plugin manager"
Sep 12 00:29:07.341479 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.341428    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 12 00:29:07.341479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341438    2556 server.go:87] "Starting device plugin registration server"
Sep 12 00:29:07.341737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341724    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 12 00:29:07.341825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341738    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 12 00:29:07.342070 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341915    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 12 00:29:07.342070 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.341991    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 12 00:29:07.342070 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.342000    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 12 00:29:07.342433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.342415    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 12 00:29:07.342511 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.342461    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.442097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.442076    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.442983 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.442969    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.443050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.443001    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.443050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.443014    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.443050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.443043    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.445766 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.445736    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 12 00:29:07.446895 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.446879    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 12 00:29:07.446968 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.446929    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 12 00:29:07.446968 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.446950    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 12 00:29:07.447062 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.447035    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 12 00:29:07.448681 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.448665    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:07.450632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.450618    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.450695 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.450640    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-144.ec2.internal\": node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.494541 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.494480    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.547111 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.547082    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"]
Sep 12 00:29:07.547195 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.547158    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.548489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.548475    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.548559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.548508    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.548559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.548523    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.549709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.549696    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.550144 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.550123    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.550271 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.550181    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551242    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551278    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551294    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551949    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551977    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.552053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.551991    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.552578 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.552562    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.552627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.552595    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:29:07.553245 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.553230    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:29:07.553305 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.553257    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:29:07.553305 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.553266    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:29:07.590273 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.590251    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-144.ec2.internal\" not found" node="ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.594467 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.594450    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-144.ec2.internal\" not found" node="ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.595430 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.595415    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.601562 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.601546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a47f42f55d416d8df95854740c396787-config\") pod \"kube-apiserver-proxy-ip-10-0-131-144.ec2.internal\" (UID: \"a47f42f55d416d8df95854740c396787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.601626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.601569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.601626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.601586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.696493 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.696464    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.701823 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a47f42f55d416d8df95854740c396787-config\") pod \"kube-apiserver-proxy-ip-10-0-131-144.ec2.internal\" (UID: \"a47f42f55d416d8df95854740c396787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.701871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.701871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.701965 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.701965 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701901    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a47f42f55d416d8df95854740c396787-config\") pod \"kube-apiserver-proxy-ip-10-0-131-144.ec2.internal\" (UID: \"a47f42f55d416d8df95854740c396787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.701965 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.701924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/605b64550792509caef01900e8b69f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal\" (UID: \"605b64550792509caef01900e8b69f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.797272 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.797201    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.892640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.892615    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.897361 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.897326    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:07.897439 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:07.897368    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:07.998111 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:07.998086    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:08.098424 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.098366    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:08.199979 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.199939    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-144.ec2.internal\" not found"
Sep 12 00:29:08.208381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.208349    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:08.242167 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.242143    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 12 00:29:08.242559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.242240    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 12 00:29:08.242559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.242294    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 12 00:29:08.278793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.278771    2556 apiserver.go:52] "Watching apiserver"
Sep 12 00:29:08.298170 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.298150    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 12 00:29:08.298278 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.298152    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:08.301250 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.301231    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 12 00:29:08.301675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.301651    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lds77","openshift-ovn-kubernetes/ovnkube-node-tsh5t","kube-system/global-pull-secret-syncer-dnht5","kube-system/konnectivity-agent-xx6lg","openshift-cluster-node-tuning-operator/tuned-zzlpv","openshift-multus/multus-additional-cni-plugins-mr8k2","openshift-multus/multus-cz2vp","openshift-network-diagnostics/network-check-target-44llg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4","openshift-dns/node-resolver-hxhkp","openshift-image-registry/node-ca-rhh8h","openshift-multus/network-metrics-daemon-wgkv5"]
Sep 12 00:29:08.303280 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.303258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.304458 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.304440    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.305475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.305432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.305711 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.305684    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mf2s8\""
Sep 12 00:29:08.305790 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.305760    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.305961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.305948    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.306009 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.305949    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 12 00:29:08.306162 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.306150    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 12 00:29:08.306418 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.306403    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 12 00:29:08.306669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.306653    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.307649 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.307626    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 12 00:29:08.307649 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.307641    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.307888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.307643    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.307888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.307643    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9rdj\""
Sep 12 00:29:08.308009 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.307960    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.308070 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.308032    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:08.308298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.308283    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.308995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.308974    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 12 00:29:08.309083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.309002    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t7zbh\""
Sep 12 00:29:08.309083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.309002    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.309083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.309078    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.309246 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.309225    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 12 00:29:08.310006 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.309719    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.310792 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.310772    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 12 00:29:08.311143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311126    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 12 00:29:08.311368 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311351    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.311426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311413    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 12 00:29:08.311770 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311730    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rkjms\""
Sep 12 00:29:08.311770 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311744    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 00:29:08.311917 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.311851    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.312753 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.312495    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 12 00:29:08.312753 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.312536    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 12 00:29:08.312929 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.312816    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-65822\""
Sep 12 00:29:08.313327 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.313312    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 00:29:08.313411 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.313401    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"
Sep 12 00:29:08.313472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.313437    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.314602 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.314585    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bw57\""
Sep 12 00:29:08.315062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.314840    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:08.315062 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.314915    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:08.315062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.314847    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.315062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.314999    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.315962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.315945    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xgzzl\""
Sep 12 00:29:08.316037 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.315945    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 12 00:29:08.316135 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.316118    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.317486 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.317465    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.318501 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.318483    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.318567 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.318484    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.318567 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.318524    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hpjr4\""
Sep 12 00:29:08.318817 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.318790    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal"]
Sep 12 00:29:08.318939 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.318884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.319006 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.318943    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:08.319911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.319881    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 12 00:29:08.320035 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.319957    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6mc6h\""
Sep 12 00:29:08.320266 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.320244    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 12 00:29:08.320343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.320316    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 12 00:29:08.322693 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.322676    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal"]
Sep 12 00:29:08.322767 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.322732    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 00:29:08.323870 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.323827    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-11 00:24:07 +0000 UTC" deadline="2028-03-05 14:01:05.675909434 +0000 UTC"
Sep 12 00:29:08.323921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.323870    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12973h31m57.352041665s"
Sep 12 00:29:08.339292 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.339264    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjbt6"
Sep 12 00:29:08.347011 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.346994    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjbt6"
Sep 12 00:29:08.398726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.398707    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 12 00:29:08.404738 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwk5c\" (UniqueName: \"kubernetes.io/projected/5a652405-5720-44ba-ac4a-54eee89eda70-kube-api-access-hwk5c\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.404825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.404825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-kubernetes\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.404825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-tmp\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.404825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-conf-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.404825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908b6f7e-9883-454c-bebc-b886a46c0390-tmp-dir\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-device-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-netns\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnkk\" (UniqueName: \"kubernetes.io/projected/908b6f7e-9883-454c-bebc-b886a46c0390-kube-api-access-dpnkk\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56f9274-d259-4961-98bc-cd25c221822c-host\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.404984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-registration-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-cni-binary-copy\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a56f9274-d259-4961-98bc-cd25c221822c-serviceca\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-system-cni-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-sys-fs\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwmt\" (UniqueName: \"kubernetes.io/projected/c0135688-7017-46bd-9895-a007d9d819e0-kube-api-access-7bwmt\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-systemd-units\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-slash\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-systemd\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.405230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-multus\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-etc-kubernetes\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908b6f7e-9883-454c-bebc-b886a46c0390-hosts-file\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxlg\" (UniqueName: \"kubernetes.io/projected/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-kube-api-access-9dxlg\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405308    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-cnibin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-multus-certs\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-cnibin\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-socket-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-netns\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtdh\" (UniqueName: \"kubernetes.io/projected/e11cdba7-2abc-483e-a9ae-4dc720e0130c-kube-api-access-lwtdh\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-kubelet\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-node-log\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-modprobe-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.405573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405596    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-iptables-alerter-script\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-kubelet-config\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-etc-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-log-socket\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-agent-certs\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-run\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-hostroot\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405857    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-bin\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-script-lib\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405905    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysconfig\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405935    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-tuned\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-system-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-k8s-cni-cncf-io\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.405991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-bin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-sys\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406058    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-lib-modules\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-kubelet\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5zj\" (UniqueName: \"kubernetes.io/projected/57660686-acb5-4fe5-bd3d-3fb3de116862-kube-api-access-sh5zj\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-ovn\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-config\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-env-overrides\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-conf\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406231    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-daemon-config\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvl9\" (UniqueName: \"kubernetes.io/projected/a56f9274-d259-4961-98bc-cd25c221822c-kube-api-access-6kvl9\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-var-lib-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406361    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-netd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-konnectivity-ca\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-binary-copy\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.406863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-socket-dir-parent\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-systemd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406508    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-var-lib-kubelet\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-host\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm892\" (UniqueName: \"kubernetes.io/projected/ea6f46b4-3508-4353-9bc0-e492ba52115c-kube-api-access-wm892\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-host-slash\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406580    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406614    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-dbus\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.407350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.406684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf5k\" (UniqueName: \"kubernetes.io/projected/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-kube-api-access-sqf5k\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.465485 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.465454    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605b64550792509caef01900e8b69f03.slice/crio-2908b52bb6b4424bf4c2fdc53230b108316d8590287f4c1d6e08ebd28d646a0b WatchSource:0}: Error finding container 2908b52bb6b4424bf4c2fdc53230b108316d8590287f4c1d6e08ebd28d646a0b: Status 404 returned error can't find the container with id 2908b52bb6b4424bf4c2fdc53230b108316d8590287f4c1d6e08ebd28d646a0b
Sep 12 00:29:08.465820 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.465798    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47f42f55d416d8df95854740c396787.slice/crio-f31eb797eccd54cd7e05a287330b267dbe21c44f435a6fe7ef05faedc6473abd WatchSource:0}: Error finding container f31eb797eccd54cd7e05a287330b267dbe21c44f435a6fe7ef05faedc6473abd: Status 404 returned error can't find the container with id f31eb797eccd54cd7e05a287330b267dbe21c44f435a6fe7ef05faedc6473abd
Sep 12 00:29:08.470574 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.470554    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:29:08.506948 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.506917    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-kubelet-config\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.506950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-etc-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.506974    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-log-socket\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.506997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-agent-certs\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-kubelet-config\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-run\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507041    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-etc-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-run\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-log-socket\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-hostroot\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507118    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-hostroot\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507144    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-bin\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-script-lib\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507258    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysconfig\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-tuned\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-system-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-k8s-cni-cncf-io\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-bin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-sys\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-lib-modules\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-kubelet\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5zj\" (UniqueName: \"kubernetes.io/projected/57660686-acb5-4fe5-bd3d-3fb3de116862-kube-api-access-sh5zj\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-k8s-cni-cncf-io\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507564    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-bin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507561    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-sys\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507662    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-kubelet\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507700    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507724    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-lib-modules\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507757    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-ovn\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-config\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507825    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-env-overrides\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-conf\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-daemon-config\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.507919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-system-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvl9\" (UniqueName: \"kubernetes.io/projected/a56f9274-d259-4961-98bc-cd25c221822c-kube-api-access-6kvl9\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-var-lib-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507958    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-ovn\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508005    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-netd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-konnectivity-ca\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.507230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-bin\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508055    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-binary-copy\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-conf\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-socket-dir-parent\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-systemd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-var-lib-kubelet\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-host\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.508898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-var-lib-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508300    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-host\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm892\" (UniqueName: \"kubernetes.io/projected/ea6f46b4-3508-4353-9bc0-e492ba52115c-kube-api-access-wm892\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508344    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-host-slash\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508349    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508394    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-socket-dir-parent\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508400    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508428    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-config\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508455    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-systemd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508485    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-env-overrides\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508499    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-var-lib-kubelet\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508505    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-cni-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508538    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-host-slash\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508554    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysconfig\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-cni-binary-copy\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508633    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-cni-netd\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.509809 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.508691    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.508746    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:09.00872539 +0000 UTC m=+2.059310992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-dbus\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.508986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf5k\" (UniqueName: \"kubernetes.io/projected/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-kube-api-access-sqf5k\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509011    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-daemon-config\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-dbus\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwk5c\" (UniqueName: \"kubernetes.io/projected/5a652405-5720-44ba-ac4a-54eee89eda70-kube-api-access-hwk5c\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509060    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.509098    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-kubernetes\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-tmp\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-conf-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-multus-conf-dir\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.509232    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:09.009150909 +0000 UTC m=+2.059736513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-kubernetes\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.510749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509309    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908b6f7e-9883-454c-bebc-b886a46c0390-tmp-dir\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-device-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509465    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-device-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509542    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-netns\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509569    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnkk\" (UniqueName: \"kubernetes.io/projected/908b6f7e-9883-454c-bebc-b886a46c0390-kube-api-access-dpnkk\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56f9274-d259-4961-98bc-cd25c221822c-host\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509620    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-registration-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509646    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-cni-binary-copy\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a56f9274-d259-4961-98bc-cd25c221822c-serviceca\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509675    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-netns\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-system-cni-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.509984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a652405-5720-44ba-ac4a-54eee89eda70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510253    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a56f9274-d259-4961-98bc-cd25c221822c-serviceca\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510301    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-sys-fs\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510329    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwmt\" (UniqueName: \"kubernetes.io/projected/c0135688-7017-46bd-9895-a007d9d819e0-kube-api-access-7bwmt\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510355    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-systemd-units\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.511733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-slash\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510432    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57660686-acb5-4fe5-bd3d-3fb3de116862-cni-binary-copy\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56f9274-d259-4961-98bc-cd25c221822c-host\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510553    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-slash\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-systemd-units\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-systemd\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510635    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-system-cni-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-systemd\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-run-openvswitch\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-multus\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-sys-fs\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-etc-kubernetes\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908b6f7e-9883-454c-bebc-b886a46c0390-hosts-file\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-var-lib-cni-multus\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxlg\" (UniqueName: \"kubernetes.io/projected/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-kube-api-access-9dxlg\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510792    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-etc-kubernetes\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.512777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-cnibin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-multus-certs\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-cnibin\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-socket-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510934    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-netns\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.510982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtdh\" (UniqueName: \"kubernetes.io/projected/e11cdba7-2abc-483e-a9ae-4dc720e0130c-kube-api-access-lwtdh\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511039    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908b6f7e-9883-454c-bebc-b886a46c0390-hosts-file\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-kubelet\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-node-log\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-host-run-multus-certs\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-modprobe-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-run-netns\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-iptables-alerter-script\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-cnibin\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.513709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511311    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-host-kubelet\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511320    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-socket-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57660686-acb5-4fe5-bd3d-3fb3de116862-cnibin\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511349    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e11cdba7-2abc-483e-a9ae-4dc720e0130c-node-log\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-modprobe-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511452    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-sysctl-d\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511473    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0135688-7017-46bd-9895-a007d9d819e0-registration-dir\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-iptables-alerter-script\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-etc-tuned\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6f46b4-3508-4353-9bc0-e492ba52115c-tmp\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.511999    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a652405-5720-44ba-ac4a-54eee89eda70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.512043    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovnkube-script-lib\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.512044    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-konnectivity-ca\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.512048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e11cdba7-2abc-483e-a9ae-4dc720e0130c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.512167    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7-agent-certs\") pod \"konnectivity-agent-xx6lg\" (UID: \"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7\") " pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.514617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.512203    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908b6f7e-9883-454c-bebc-b886a46c0390-tmp-dir\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.516148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.516128    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5zj\" (UniqueName: \"kubernetes.io/projected/57660686-acb5-4fe5-bd3d-3fb3de116862-kube-api-access-sh5zj\") pod \"multus-cz2vp\" (UID: \"57660686-acb5-4fe5-bd3d-3fb3de116862\") " pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.516234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.516198    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvl9\" (UniqueName: \"kubernetes.io/projected/a56f9274-d259-4961-98bc-cd25c221822c-kube-api-access-6kvl9\") pod \"node-ca-rhh8h\" (UID: \"a56f9274-d259-4961-98bc-cd25c221822c\") " pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.518133 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.518109    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:08.518133 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.518135    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:08.518298 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.518146    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:08.518298 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:08.518198    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:09.018185966 +0000 UTC m=+2.068771554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:08.519263 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.519242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwk5c\" (UniqueName: \"kubernetes.io/projected/5a652405-5720-44ba-ac4a-54eee89eda70-kube-api-access-hwk5c\") pod \"multus-additional-cni-plugins-mr8k2\" (UID: \"5a652405-5720-44ba-ac4a-54eee89eda70\") " pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.519519 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.519496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm892\" (UniqueName: \"kubernetes.io/projected/ea6f46b4-3508-4353-9bc0-e492ba52115c-kube-api-access-wm892\") pod \"tuned-zzlpv\" (UID: \"ea6f46b4-3508-4353-9bc0-e492ba52115c\") " pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.519997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.519978    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf5k\" (UniqueName: \"kubernetes.io/projected/408f1afe-f906-4c6e-b127-0f6e46dfcbe1-kube-api-access-sqf5k\") pod \"iptables-alerter-lds77\" (UID: \"408f1afe-f906-4c6e-b127-0f6e46dfcbe1\") " pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.521720 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.521696    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxlg\" (UniqueName: \"kubernetes.io/projected/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-kube-api-access-9dxlg\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:08.521802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.521741    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwmt\" (UniqueName: \"kubernetes.io/projected/c0135688-7017-46bd-9895-a007d9d819e0-kube-api-access-7bwmt\") pod \"aws-ebs-csi-driver-node-ms8s4\" (UID: \"c0135688-7017-46bd-9895-a007d9d819e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.521802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.521788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtdh\" (UniqueName: \"kubernetes.io/projected/e11cdba7-2abc-483e-a9ae-4dc720e0130c-kube-api-access-lwtdh\") pod \"ovnkube-node-tsh5t\" (UID: \"e11cdba7-2abc-483e-a9ae-4dc720e0130c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.521892 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.521831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnkk\" (UniqueName: \"kubernetes.io/projected/908b6f7e-9883-454c-bebc-b886a46c0390-kube-api-access-dpnkk\") pod \"node-resolver-hxhkp\" (UID: \"908b6f7e-9883-454c-bebc-b886a46c0390\") " pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.639234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.639148    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mr8k2"
Sep 12 00:29:08.648307 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.648282    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a652405_5720_44ba_ac4a_54eee89eda70.slice/crio-738c6009458b009952b89cdae667174daeda20b320f7a1430f213aff496e00b2 WatchSource:0}: Error finding container 738c6009458b009952b89cdae667174daeda20b320f7a1430f213aff496e00b2: Status 404 returned error can't find the container with id 738c6009458b009952b89cdae667174daeda20b320f7a1430f213aff496e00b2
Sep 12 00:29:08.655017 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.654995    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4"
Sep 12 00:29:08.671264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.671246    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lds77"
Sep 12 00:29:08.676462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.676432    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:08.676462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.676457    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:08.678252 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.678226    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408f1afe_f906_4c6e_b127_0f6e46dfcbe1.slice/crio-aa01262e495f772c56e2dd91f4aecf26d9b4c66b6d91b129a5f06f82a6ac1fc2 WatchSource:0}: Error finding container aa01262e495f772c56e2dd91f4aecf26d9b4c66b6d91b129a5f06f82a6ac1fc2: Status 404 returned error can't find the container with id aa01262e495f772c56e2dd91f4aecf26d9b4c66b6d91b129a5f06f82a6ac1fc2
Sep 12 00:29:08.679936 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.679915    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:08.686296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.686278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:08.688526 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.688506    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11cdba7_2abc_483e_a9ae_4dc720e0130c.slice/crio-0b7fbde781dd6f8bf0b8debc1555c42e9e5caf06f77c49dc77fe14e365f3c710 WatchSource:0}: Error finding container 0b7fbde781dd6f8bf0b8debc1555c42e9e5caf06f77c49dc77fe14e365f3c710: Status 404 returned error can't find the container with id 0b7fbde781dd6f8bf0b8debc1555c42e9e5caf06f77c49dc77fe14e365f3c710
Sep 12 00:29:08.693153 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.693136    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c4bb38_69e6_4a6d_ae60_4ed1006a88d7.slice/crio-fbc8da3f8ef4c57e03730706497212fedc441bcbdee41480c19576f4fd742991 WatchSource:0}: Error finding container fbc8da3f8ef4c57e03730706497212fedc441bcbdee41480c19576f4fd742991: Status 404 returned error can't find the container with id fbc8da3f8ef4c57e03730706497212fedc441bcbdee41480c19576f4fd742991
Sep 12 00:29:08.707695 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.707675    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zzlpv"
Sep 12 00:29:08.714377 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.714359    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6f46b4_3508_4353_9bc0_e492ba52115c.slice/crio-035974d603bee9cdf42cd9421ed2069d6502c8c7ee8713c292ae7ca49d3d6e75 WatchSource:0}: Error finding container 035974d603bee9cdf42cd9421ed2069d6502c8c7ee8713c292ae7ca49d3d6e75: Status 404 returned error can't find the container with id 035974d603bee9cdf42cd9421ed2069d6502c8c7ee8713c292ae7ca49d3d6e75
Sep 12 00:29:08.714489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.714434    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz2vp"
Sep 12 00:29:08.720974 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.720949    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57660686_acb5_4fe5_bd3d_3fb3de116862.slice/crio-9b40b517c7afb446e3e5c7569d78a097c0944b9540fb93fb75be63720e06008c WatchSource:0}: Error finding container 9b40b517c7afb446e3e5c7569d78a097c0944b9540fb93fb75be63720e06008c: Status 404 returned error can't find the container with id 9b40b517c7afb446e3e5c7569d78a097c0944b9540fb93fb75be63720e06008c
Sep 12 00:29:08.738436 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.738419    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxhkp"
Sep 12 00:29:08.743062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:08.742915    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhh8h"
Sep 12 00:29:08.745420 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.745404    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908b6f7e_9883_454c_bebc_b886a46c0390.slice/crio-52a4bc4c6e27830f1cadb2a2e76638ea066eafba91984b7454bf49cb28df9c6c WatchSource:0}: Error finding container 52a4bc4c6e27830f1cadb2a2e76638ea066eafba91984b7454bf49cb28df9c6c: Status 404 returned error can't find the container with id 52a4bc4c6e27830f1cadb2a2e76638ea066eafba91984b7454bf49cb28df9c6c
Sep 12 00:29:08.749441 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:08.749422    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56f9274_d259_4961_98bc_cd25c221822c.slice/crio-9ad4d95d56f050398d648de8ddcedd84f2f67394992790f3c873c60a2ed5455b WatchSource:0}: Error finding container 9ad4d95d56f050398d648de8ddcedd84f2f67394992790f3c873c60a2ed5455b: Status 404 returned error can't find the container with id 9ad4d95d56f050398d648de8ddcedd84f2f67394992790f3c873c60a2ed5455b
Sep 12 00:29:09.016263 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.015560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:09.016263 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.015610    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:09.016263 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.015757    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:09.016263 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.015832    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:10.015811534 +0000 UTC m=+3.066397122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:09.016263 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.016230    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:09.016557 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.016280    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:10.016265935 +0000 UTC m=+3.066851540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:09.109534 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.109504    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:09.115985 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.115955    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:09.116166 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.116108    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:09.116166 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.116130    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:09.116166 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.116141    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:09.116350 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:09.116195    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:10.116178107 +0000 UTC m=+3.166763713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:09.349556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.349447    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 00:24:08 +0000 UTC" deadline="2028-03-01 13:58:34.037953178 +0000 UTC"
Sep 12 00:29:09.349556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.349508    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12877h29m24.688449483s"
Sep 12 00:29:09.466150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.466090    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhh8h" event={"ID":"a56f9274-d259-4961-98bc-cd25c221822c","Type":"ContainerStarted","Data":"9ad4d95d56f050398d648de8ddcedd84f2f67394992790f3c873c60a2ed5455b"}
Sep 12 00:29:09.476975 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.476936    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz2vp" event={"ID":"57660686-acb5-4fe5-bd3d-3fb3de116862","Type":"ContainerStarted","Data":"9b40b517c7afb446e3e5c7569d78a097c0944b9540fb93fb75be63720e06008c"}
Sep 12 00:29:09.482780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.482725    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zzlpv" event={"ID":"ea6f46b4-3508-4353-9bc0-e492ba52115c","Type":"ContainerStarted","Data":"035974d603bee9cdf42cd9421ed2069d6502c8c7ee8713c292ae7ca49d3d6e75"}
Sep 12 00:29:09.490740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.490713    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xx6lg" event={"ID":"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7","Type":"ContainerStarted","Data":"fbc8da3f8ef4c57e03730706497212fedc441bcbdee41480c19576f4fd742991"}
Sep 12 00:29:09.501627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.501599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"0b7fbde781dd6f8bf0b8debc1555c42e9e5caf06f77c49dc77fe14e365f3c710"}
Sep 12 00:29:09.510491 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.510462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4" event={"ID":"c0135688-7017-46bd-9895-a007d9d819e0","Type":"ContainerStarted","Data":"10eece6fa8c35d2ee5886bad3e02a13542a63cf0d0e9c9f153dcb536a2fd4cbc"}
Sep 12 00:29:09.516958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.516930    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerStarted","Data":"738c6009458b009952b89cdae667174daeda20b320f7a1430f213aff496e00b2"}
Sep 12 00:29:09.520629 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.520603    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal" event={"ID":"a47f42f55d416d8df95854740c396787","Type":"ContainerStarted","Data":"f31eb797eccd54cd7e05a287330b267dbe21c44f435a6fe7ef05faedc6473abd"}
Sep 12 00:29:09.528019 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.527994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxhkp" event={"ID":"908b6f7e-9883-454c-bebc-b886a46c0390","Type":"ContainerStarted","Data":"52a4bc4c6e27830f1cadb2a2e76638ea066eafba91984b7454bf49cb28df9c6c"}
Sep 12 00:29:09.531652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.531604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lds77" event={"ID":"408f1afe-f906-4c6e-b127-0f6e46dfcbe1","Type":"ContainerStarted","Data":"aa01262e495f772c56e2dd91f4aecf26d9b4c66b6d91b129a5f06f82a6ac1fc2"}
Sep 12 00:29:09.536138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:09.536114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal" event={"ID":"605b64550792509caef01900e8b69f03","Type":"ContainerStarted","Data":"2908b52bb6b4424bf4c2fdc53230b108316d8590287f4c1d6e08ebd28d646a0b"}
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.025397    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.025455    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.025608    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.025671    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:12.025653259 +0000 UTC m=+5.076238859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.026167    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:10.026260 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.026222    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:12.026206171 +0000 UTC m=+5.076791770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:10.126136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.126095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:10.126321 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.126302    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:10.126386 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.126322    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:10.126386 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.126335    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:10.126488 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.126396    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:12.126376109 +0000 UTC m=+5.176961711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:10.350708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.350521    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 00:24:08 +0000 UTC" deadline="2028-03-10 16:43:27.538365844 +0000 UTC"
Sep 12 00:29:10.350708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.350564    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13096h14m17.187807311s"
Sep 12 00:29:10.447881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.447844    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:10.448055 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.448003    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:10.448462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.448413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:10.448573 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.448551    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:10.448633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.448614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:10.448729 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:10.448683    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:10.701015 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:10.700757    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:29:12.040858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.040817    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:12.041329 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.040919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:12.041329 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.041044    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:12.041329 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.041109    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:16.041090364 +0000 UTC m=+9.091675956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:12.041584 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.041566    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:12.041642 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.041625    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:16.041608211 +0000 UTC m=+9.092193804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:12.142033 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.141992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:12.142202 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.142173    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:12.142271 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.142201    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:12.142271 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.142218    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:12.142376 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.142292    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:16.142272252 +0000 UTC m=+9.192857854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:12.448082 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.447998    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:12.448253 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.448154    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:12.448580 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.448560    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:12.448691 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.448670    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:12.448761 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:12.448739    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:12.448821 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:12.448808    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:14.447847 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:14.447815    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:14.447847 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:14.447844    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:14.448372 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:14.447812    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:14.448372 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:14.447949    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:14.448372 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:14.448021    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:14.448372 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:14.448088    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:16.074386 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.074350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:16.074843 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.074403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:16.074843 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.074513    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:16.074843 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.074513    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:16.074843 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.074590    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:24.074570256 +0000 UTC m=+17.125155861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:16.074843 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.074608    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:24.074598261 +0000 UTC m=+17.125183846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:16.175378 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.174746    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:16.175378 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.174943    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:16.175378 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.174964    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:16.175378 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.174975    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:16.175378 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.175036    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:24.175017135 +0000 UTC m=+17.225602721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:16.447521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.447399    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:16.447521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.447429    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:16.447521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:16.447443    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:16.447789 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.447543    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:16.447789 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.447625    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:16.448463 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:16.448412    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:18.447606 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:18.447573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:18.447606 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:18.447603    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:18.448213 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:18.447573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:18.448213 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:18.447718    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:18.448213 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:18.447736    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:18.448213 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:18.447820    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:20.447863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:20.447827    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:20.447863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:20.447862    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:20.448381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:20.447862    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:20.448381 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:20.447965    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:20.448381 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:20.448037    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:20.448381 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:20.448129    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:22.447835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:22.447804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:22.447835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:22.447824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:22.448294 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:22.447824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:22.448294 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:22.447915    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:22.448294 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:22.448011    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:22.448294 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:22.448097    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:24.127579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.127542    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:24.127579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.127583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:24.128121 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.127690    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:24.128121 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.127750    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.12773617 +0000 UTC m=+33.178321755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:24.128121 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.127690    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:24.128121 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.127870    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.127845543 +0000 UTC m=+33.178431132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:24.228954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.228912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:24.229114 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.229066    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:29:24.229114 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.229086    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:29:24.229114 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.229096    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zxc5s for pod openshift-network-diagnostics/network-check-target-44llg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:24.229245 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.229151    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s podName:87408c1b-d0be-4409-957a-dd6a204a19cb nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.229138558 +0000 UTC m=+33.279724143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxc5s" (UniqueName: "kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s") pod "network-check-target-44llg" (UID: "87408c1b-d0be-4409-957a-dd6a204a19cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:29:24.448139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.448060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:24.448290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.448060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:24.448290 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.448195    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:24.448290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:24.448060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:24.448290 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.448282    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:24.448516 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:24.448371    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:26.447816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:26.447776    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:26.447816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:26.447818    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:26.448349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:26.447787    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:26.448349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:26.447910    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:26.448349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:26.447993    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:26.448349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:26.448074    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:27.580945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.580598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz2vp" event={"ID":"57660686-acb5-4fe5-bd3d-3fb3de116862","Type":"ContainerStarted","Data":"dba04844c6ee22cac4fa8f3a09492c6dbacbefc0856fc50fa693c20aaf22529b"}
Sep 12 00:29:27.582363 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.582313    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zzlpv" event={"ID":"ea6f46b4-3508-4353-9bc0-e492ba52115c","Type":"ContainerStarted","Data":"caf964d01bf324f4c99d4e778d8b37f00925826cf51bf548ac5e0935d71a87e3"}
Sep 12 00:29:27.583942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.583917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xx6lg" event={"ID":"b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7","Type":"ContainerStarted","Data":"67f62e28096e0a80d4a08e8519b9ffd45da843f8537ebe13f88f2e878174d354"}
Sep 12 00:29:27.587045 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.587020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"a9145ce765d7977bd5999414667544e3aaafd5c547dae30b40724205ee6d4497"}
Sep 12 00:29:27.587138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.587098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"f74ccf76cb1b4b948909c0a114f13833c1ef5553d0314e475d0961db3bd8ae6b"}
Sep 12 00:29:27.587182 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.587167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"d0077eac04deec8eeddf713cb2e06c23ffa9902b12937b27286f7d1cd6c12411"}
Sep 12 00:29:27.587233 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.587212    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"8d989c0593998c88a53480117b06698accdaf35cfae3b5e607774ac6ab0fa7f4"}
Sep 12 00:29:27.587273 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.587259    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"19881fb07cd7fd413279fcd5af70fdf0af13d6c2ca1349efff8f2b4908aeff03"}
Sep 12 00:29:27.588601 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.588575    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4" event={"ID":"c0135688-7017-46bd-9895-a007d9d819e0","Type":"ContainerStarted","Data":"e9487eaa9fe97344b15b4c8fd517d3816fa482ddc3e7a0e8811751d46ca328c1"}
Sep 12 00:29:27.590233 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.590212    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="a9c3002edd484a5c574916c62fcea92702602b1f2f6a69b7d53274725669fdc7" exitCode=0
Sep 12 00:29:27.590308 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.590275    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"a9c3002edd484a5c574916c62fcea92702602b1f2f6a69b7d53274725669fdc7"}
Sep 12 00:29:27.591899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.591877    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal" event={"ID":"a47f42f55d416d8df95854740c396787","Type":"ContainerStarted","Data":"3ba5d26d36e7548cf2e81bbae24282a8cdb97b03f30e3568a2477264b3dc2a17"}
Sep 12 00:29:27.593288 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.593265    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxhkp" event={"ID":"908b6f7e-9883-454c-bebc-b886a46c0390","Type":"ContainerStarted","Data":"d8f3cf8a4716b148098e6a2160967bbc9f148075b374db7ed7f6cf219f5fa8b1"}
Sep 12 00:29:27.594970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.594948    2556 generic.go:356] "Generic (PLEG): container finished" podID="605b64550792509caef01900e8b69f03" containerID="ac0462fb5a6ee8048154566c18b02809aa11f1eb0c6ce2cdcced64a4f6bec32d" exitCode=0
Sep 12 00:29:27.595054 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.595027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal" event={"ID":"605b64550792509caef01900e8b69f03","Type":"ContainerDied","Data":"ac0462fb5a6ee8048154566c18b02809aa11f1eb0c6ce2cdcced64a4f6bec32d"}
Sep 12 00:29:27.596318 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.596280    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cz2vp" podStartSLOduration=1.35446994 podStartE2EDuration="19.596268314s" totalImagesPullingTime="18.241798374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.595876196 +0000 UTC m=+20.646461804" watchObservedRunningTime="2026-09-12 00:29:27.596268314 +0000 UTC m=+20.646853922"
Sep 12 00:29:27.596662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.596619    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhh8h" event={"ID":"a56f9274-d259-4961-98bc-cd25c221822c","Type":"ContainerStarted","Data":"1c937acff93615a421fb55a745c7e6a4cd9123429100f9b325cf375a902259ba"}
Sep 12 00:29:27.623744 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.623708    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xx6lg" podStartSLOduration=1.428932701 podStartE2EDuration="19.623689966s" totalImagesPullingTime="18.194757265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.609107548 +0000 UTC m=+20.659693155" watchObservedRunningTime="2026-09-12 00:29:27.623689966 +0000 UTC m=+20.674275574"
Sep 12 00:29:27.623858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.623809    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zzlpv" podStartSLOduration=1.407295637 podStartE2EDuration="19.623802628s" totalImagesPullingTime="18.216506991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.623578775 +0000 UTC m=+20.674164383" watchObservedRunningTime="2026-09-12 00:29:27.623802628 +0000 UTC m=+20.674388235"
Sep 12 00:29:27.638096 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.638052    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hxhkp" podStartSLOduration=1.453793053 podStartE2EDuration="19.63803973s" totalImagesPullingTime="18.184246677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.637808083 +0000 UTC m=+20.688393692" watchObservedRunningTime="2026-09-12 00:29:27.63803973 +0000 UTC m=+20.688625335"
Sep 12 00:29:27.682442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.682394    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-144.ec2.internal" podStartSLOduration=19.682376548 podStartE2EDuration="19.682376548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.682193946 +0000 UTC m=+20.732779555" watchObservedRunningTime="2026-09-12 00:29:27.682376548 +0000 UTC m=+20.732962154"
Sep 12 00:29:27.718636 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:27.718594    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rhh8h" podStartSLOduration=1.539409324 podStartE2EDuration="19.718581061s" totalImagesPullingTime="18.179171737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:27.718345651 +0000 UTC m=+20.768931257" watchObservedRunningTime="2026-09-12 00:29:27.718581061 +0000 UTC m=+20.769166667"
Sep 12 00:29:28.448250 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.448199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:28.448250 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.448220    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:28.448416 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:28.448322    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:28.448416 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.448361    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:28.448525 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:28.448503    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:28.448624 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:28.448599    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:28.528593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.528435    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 12 00:29:28.600996 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.600963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4" event={"ID":"c0135688-7017-46bd-9895-a007d9d819e0","Type":"ContainerStarted","Data":"c4c2831f2141e0d1e6df46beb18ddb9f6a40760e7750d5f4b2439729a63b70c1"}
Sep 12 00:29:28.602644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.602617    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lds77" event={"ID":"408f1afe-f906-4c6e-b127-0f6e46dfcbe1","Type":"ContainerStarted","Data":"de08670dc8ce8ee14588e1031ace4e83905a73cfd2e72af494dca82a4a4f4fab"}
Sep 12 00:29:28.604747 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.604703    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal" event={"ID":"605b64550792509caef01900e8b69f03","Type":"ContainerStarted","Data":"1cdf566f4d420223ac98f04a209ecf978d649d615fdc8d8b51837148839a84d3"}
Sep 12 00:29:28.608312 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.608234    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"e5b4a66443d3a3f2490f040ee4118bad24bb8ac74f818ed77856a2bd60ccb70d"}
Sep 12 00:29:28.618915 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.618872    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lds77" podStartSLOduration=2.763113873 podStartE2EDuration="20.618857311s" totalImagesPullingTime="17.855743438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:28.618504853 +0000 UTC m=+21.669090460" watchObservedRunningTime="2026-09-12 00:29:28.618857311 +0000 UTC m=+21.669442917"
Sep 12 00:29:28.634483 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:28.634404    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-144.ec2.internal" podStartSLOduration=20.634389388 podStartE2EDuration="20.634389388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:28.633105527 +0000 UTC m=+21.683691136" watchObservedRunningTime="2026-09-12 00:29:28.634389388 +0000 UTC m=+21.684974995"
Sep 12 00:29:29.354400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:29.354326    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-12T00:29:28.528589698Z","UUID":"7e84597a-4a38-4bad-a9c3-39abae19efaf","Handler":null,"Name":"","Endpoint":""}
Sep 12 00:29:29.356236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:29.356221    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 12 00:29:29.356328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:29.356247    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 12 00:29:29.613606 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:29.613494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4" event={"ID":"c0135688-7017-46bd-9895-a007d9d819e0","Type":"ContainerStarted","Data":"0c04e4953b2f419b40e38546c9824c8289c9ed7d0026186db7bc77a94413b703"}
Sep 12 00:29:29.629432 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:29.629351    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms8s4" podStartSLOduration=2.532958194 podStartE2EDuration="22.629337041s" totalImagesPullingTime="20.096378847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:29.629319776 +0000 UTC m=+22.679905384" watchObservedRunningTime="2026-09-12 00:29:29.629337041 +0000 UTC m=+22.679922648"
Sep 12 00:29:30.447690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:30.447653    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:30.447919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:30.447653    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:30.447919 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:30.447794    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:30.447919 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:30.447888    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:30.448050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:30.447915    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:30.448050 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:30.448013    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:30.517449 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:30.517410    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:30.619840 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:30.619800    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"b21dee21a718b03e862b8f39776172cdf911b1f3fa690ffc820bcf262a84d960"}
Sep 12 00:29:31.059652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:31.059617    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:31.060245 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:31.060213    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:31.622687 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:31.622663    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xx6lg"
Sep 12 00:29:32.447588 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.447432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:32.447688 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.447472    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:32.447688 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:32.447665    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:32.447774 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.447473    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:32.447774 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:32.447743    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:32.447838 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:32.447813    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:32.627089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.626997    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" event={"ID":"e11cdba7-2abc-483e-a9ae-4dc720e0130c","Type":"ContainerStarted","Data":"1c63ec4b2f7a04808783475e0ee72769579160c08661fc1328b246930c8e46d0"}
Sep 12 00:29:32.627549 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.627226    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:32.628958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.628935    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="5a123187696298766bdb9f8938bfcbaaedcfb3489bac01ac1c4dbd3a20226e3a" exitCode=0
Sep 12 00:29:32.629092 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.629004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"5a123187696298766bdb9f8938bfcbaaedcfb3489bac01ac1c4dbd3a20226e3a"}
Sep 12 00:29:32.641963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.641935    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:32.652206 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:32.652169    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t" podStartSLOduration=6.316447396 podStartE2EDuration="24.652158167s" totalImagesPullingTime="18.335710771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:32.650678742 +0000 UTC m=+25.701264359" watchObservedRunningTime="2026-09-12 00:29:32.652158167 +0000 UTC m=+25.702743773"
Sep 12 00:29:33.631976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.631953    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:33.632627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.632039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:33.646482 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.646459    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:29:33.966531 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.966505    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dnht5"]
Sep 12 00:29:33.966709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.966630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:33.966800 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:33.966736    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:33.969497 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.969472    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-44llg"]
Sep 12 00:29:33.969624 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.969572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:33.969686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:33.969659    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:33.972510 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.972489    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgkv5"]
Sep 12 00:29:33.972611 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:33.972591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:33.972688 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:33.972667    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:34.635614 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:34.635583    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="fc73a24f3c1e5e7e8ec14e43960e96e52f87b1b8871e40323c31cc268806e3cd" exitCode=0
Sep 12 00:29:34.636084 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:34.635660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"fc73a24f3c1e5e7e8ec14e43960e96e52f87b1b8871e40323c31cc268806e3cd"}
Sep 12 00:29:35.447575 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:35.447545    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:35.447728 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:35.447545    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:35.447728 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:35.447545    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:35.447728 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:35.447651    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:35.447867 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:35.447742    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:35.447912 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:35.447864    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:35.639719 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:35.639687    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="0a88246a578b5d0107e5b41a17226a1b7cfbe7c97afbaf90efce2b38e4879fe9" exitCode=0
Sep 12 00:29:35.640122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:35.639783    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"0a88246a578b5d0107e5b41a17226a1b7cfbe7c97afbaf90efce2b38e4879fe9"}
Sep 12 00:29:37.448788 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:37.448530    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:37.449275 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:37.448606    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:37.449275 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:37.448642    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:37.449275 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:37.448928    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:37.449275 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:37.449069    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:37.449275 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:37.449188    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:39.447502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.447469    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:39.447502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.447488    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:39.448007 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.447470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:39.448007 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.447584    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44llg" podUID="87408c1b-d0be-4409-957a-dd6a204a19cb"
Sep 12 00:29:39.448007 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.447690    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:29:39.448007 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.447800    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnht5" podUID="ca0297dd-65be-4b61-a9b0-00440e3b3c7e"
Sep 12 00:29:39.697475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.697446    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-144.ec2.internal" event="NodeReady"
Sep 12 00:29:39.697652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.697611    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 12 00:29:39.729828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.729800    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:29:39.749803 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.749774    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"]
Sep 12 00:29:39.749961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.749856    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.752921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.752694    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 12 00:29:39.752921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.752702    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cg9mt\""
Sep 12 00:29:39.752921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.752705    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 12 00:29:39.752921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.752703    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 12 00:29:39.759170 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.758593    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 12 00:29:39.762178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.761895    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:29:39.762178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.761955    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fpfxg"]
Sep 12 00:29:39.762328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.762270    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.764915 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.764893    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 12 00:29:39.765016 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.764913    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nqbvs\""
Sep 12 00:29:39.765172 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.765156    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 12 00:29:39.775347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.775331    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"]
Sep 12 00:29:39.775487 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.775472    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.777862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.777844    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 12 00:29:39.778079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.778063    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7jvg\""
Sep 12 00:29:39.778079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.778077    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 12 00:29:39.791417 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.791398    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8vhjf"]
Sep 12 00:29:39.791521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.791506    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"
Sep 12 00:29:39.794057 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.794028    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 12 00:29:39.794149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.794120    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v8g89\""
Sep 12 00:29:39.794402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.794386    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 12 00:29:39.813559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.813537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"]
Sep 12 00:29:39.813668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.813573    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"]
Sep 12 00:29:39.813668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.813593    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fpfxg"]
Sep 12 00:29:39.813668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.813628    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vhjf"]
Sep 12 00:29:39.813833 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.813697    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:39.816063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.816043    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 12 00:29:39.816063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.816052    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 12 00:29:39.816211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.816053    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbz7v\""
Sep 12 00:29:39.816315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.816296    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 12 00:29:39.846494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhjc\" (UniqueName: \"kubernetes.io/projected/dd0cfe3d-ceaa-4f9c-b095-72c78c268113-kube-api-access-qfhjc\") pod \"network-check-source-6f8b768455-zs2sx\" (UID: \"dd0cfe3d-ceaa-4f9c-b095-72c78c268113\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"
Sep 12 00:29:39.846616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846516    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.846616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846535    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.846616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/302a6863-e7f2-402f-bc90-b760c2a65e64-config-volume\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.846837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54gv\" (UniqueName: \"kubernetes.io/projected/302a6863-e7f2-402f-bc90-b760c2a65e64-kube-api-access-g54gv\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.846837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6d612af-d795-4448-857d-b3e4701fa822-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.846837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.846837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846706    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.846837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f5nx\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/302a6863-e7f2-402f-bc90-b760c2a65e64-tmp-dir\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846976    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.847034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.846990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.920584 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.920548    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:39.948038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.947975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f5nx\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948042    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/107cd56e-3c34-48ba-a37b-354d080ad04a-cert\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:39.948198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948144    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948397 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948267    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:39.948397 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948285    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:39.948397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/302a6863-e7f2-402f-bc90-b760c2a65e64-tmp-dir\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.948397 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948372    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.448353366 +0000 UTC m=+33.498938954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948404    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhjc\" (UniqueName: \"kubernetes.io/projected/dd0cfe3d-ceaa-4f9c-b095-72c78c268113-kube-api-access-qfhjc\") pod \"network-check-source-6f8b768455-zs2sx\" (UID: \"dd0cfe3d-ceaa-4f9c-b095-72c78c268113\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948484    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948532    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.44851823 +0000 UTC m=+33.499103815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948488    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948553    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/302a6863-e7f2-402f-bc90-b760c2a65e64-tmp-dir\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.948571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/302a6863-e7f2-402f-bc90-b760c2a65e64-config-volume\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948621    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54gv\" (UniqueName: \"kubernetes.io/projected/302a6863-e7f2-402f-bc90-b760c2a65e64-kube-api-access-g54gv\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948631    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6d612af-d795-4448-857d-b3e4701fa822-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792r6\" (UniqueName: \"kubernetes.io/projected/107cd56e-3c34-48ba-a37b-354d080ad04a-kube-api-access-792r6\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:39.948685    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:40.448670236 +0000 UTC m=+33.499255822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.948954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.948734    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.949323 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.949213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.949433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.949412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/302a6863-e7f2-402f-bc90-b760c2a65e64-config-volume\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.949491 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.949437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6d612af-d795-4448-857d-b3e4701fa822-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:39.949549 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.949532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.952676 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.952654    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.952676 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.952668    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.957594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.957573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f5nx\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.957702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.957648    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhjc\" (UniqueName: \"kubernetes.io/projected/dd0cfe3d-ceaa-4f9c-b095-72c78c268113-kube-api-access-qfhjc\") pod \"network-check-source-6f8b768455-zs2sx\" (UID: \"dd0cfe3d-ceaa-4f9c-b095-72c78c268113\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"
Sep 12 00:29:39.957784 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.957742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:39.958337 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.958316    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54gv\" (UniqueName: \"kubernetes.io/projected/302a6863-e7f2-402f-bc90-b760c2a65e64-kube-api-access-g54gv\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:39.998033 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:39.998002    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:40.050039 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.050010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-792r6\" (UniqueName: \"kubernetes.io/projected/107cd56e-3c34-48ba-a37b-354d080ad04a-kube-api-access-792r6\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:40.050039 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.050044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/107cd56e-3c34-48ba-a37b-354d080ad04a-cert\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:40.052583 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.052561    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/107cd56e-3c34-48ba-a37b-354d080ad04a-cert\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:40.058260 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.058240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-792r6\" (UniqueName: \"kubernetes.io/projected/107cd56e-3c34-48ba-a37b-354d080ad04a-kube-api-access-792r6\") pod \"ingress-canary-8vhjf\" (UID: \"107cd56e-3c34-48ba-a37b-354d080ad04a\") " pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:40.101125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.101096    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"
Sep 12 00:29:40.123272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.123248    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vhjf"
Sep 12 00:29:40.150721 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.150699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:40.150833 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.150731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:40.150877 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.150849    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:40.150877 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.150854    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:40.150940 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.150895    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:12.150882759 +0000 UTC m=+65.201468345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:29:40.150940 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.150909    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret podName:ca0297dd-65be-4b61-a9b0-00440e3b3c7e nodeName:}" failed. No retries permitted until 2026-09-12 00:30:12.150901527 +0000 UTC m=+65.201487112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret") pod "global-pull-secret-syncer-dnht5" (UID: "ca0297dd-65be-4b61-a9b0-00440e3b3c7e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:29:40.251498 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.251230    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:40.254039 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.254016    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxc5s\" (UniqueName: \"kubernetes.io/projected/87408c1b-d0be-4409-957a-dd6a204a19cb-kube-api-access-zxc5s\") pod \"network-check-target-44llg\" (UID: \"87408c1b-d0be-4409-957a-dd6a204a19cb\") " pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:40.453042 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.452860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.453062    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.453084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453008    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453128    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453182    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453199    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:41.453179995 +0000 UTC m=+34.503765594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453225    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:41.453214718 +0000 UTC m=+34.503800303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453182    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:40.453433 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:40.453252    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:41.453241423 +0000 UTC m=+34.503827008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:40.506960 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.506542    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vhjf"]
Sep 12 00:29:40.509202 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.509181    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx"]
Sep 12 00:29:40.546668 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:40.546642    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107cd56e_3c34_48ba_a37b_354d080ad04a.slice/crio-4a72fb2d9962668c8de4be9c8c6d3b1acb4013783dd0124b9d8d3d69b7aa05b8 WatchSource:0}: Error finding container 4a72fb2d9962668c8de4be9c8c6d3b1acb4013783dd0124b9d8d3d69b7aa05b8: Status 404 returned error can't find the container with id 4a72fb2d9962668c8de4be9c8c6d3b1acb4013783dd0124b9d8d3d69b7aa05b8
Sep 12 00:29:40.546920 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:40.546899    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0cfe3d_ceaa_4f9c_b095_72c78c268113.slice/crio-7d31b4dfe402f0f29d2458cee0a085f39835dd930625222bb54d888e26e90e2f WatchSource:0}: Error finding container 7d31b4dfe402f0f29d2458cee0a085f39835dd930625222bb54d888e26e90e2f: Status 404 returned error can't find the container with id 7d31b4dfe402f0f29d2458cee0a085f39835dd930625222bb54d888e26e90e2f
Sep 12 00:29:40.657027 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.657000    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx" event={"ID":"dd0cfe3d-ceaa-4f9c-b095-72c78c268113","Type":"ContainerStarted","Data":"7d31b4dfe402f0f29d2458cee0a085f39835dd930625222bb54d888e26e90e2f"}
Sep 12 00:29:40.658213 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:40.658182    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vhjf" event={"ID":"107cd56e-3c34-48ba-a37b-354d080ad04a","Type":"ContainerStarted","Data":"4a72fb2d9962668c8de4be9c8c6d3b1acb4013783dd0124b9d8d3d69b7aa05b8"}
Sep 12 00:29:41.447594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.447440    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:41.447594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.447440    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:29:41.448742 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.448448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:29:41.451396 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.451245    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 00:29:41.451396 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.451262    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g5b8\""
Sep 12 00:29:41.451396 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.451276    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 00:29:41.451396 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.451298    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bjlg\""
Sep 12 00:29:41.459228 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.459207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:41.459665 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.459244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:41.459665 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.459320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:41.459665 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459436    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:41.459665 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459457    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:41.459665 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459512    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:43.459493632 +0000 UTC m=+36.510079224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:41.459949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459822    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:41.459949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459870    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:41.459949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459880    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:43.459861208 +0000 UTC m=+36.510446813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:29:41.459949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:41.459903    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:43.459893397 +0000 UTC m=+36.510478982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:41.461210 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.461192    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:41.664816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.664778    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="0fb810eec63081aa86ce1bf51affd95af9af01a6cb17da5c6308447b5eee00be" exitCode=0
Sep 12 00:29:41.664986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.664848    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"0fb810eec63081aa86ce1bf51affd95af9af01a6cb17da5c6308447b5eee00be"}
Sep 12 00:29:41.759085 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:41.759054    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-44llg"]
Sep 12 00:29:41.762972 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:29:41.762945    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87408c1b_d0be_4409_957a_dd6a204a19cb.slice/crio-7e04621f66d513a93e6125a0b64ba76020d27c374c751b1c242e886bc2f2ef57 WatchSource:0}: Error finding container 7e04621f66d513a93e6125a0b64ba76020d27c374c751b1c242e886bc2f2ef57: Status 404 returned error can't find the container with id 7e04621f66d513a93e6125a0b64ba76020d27c374c751b1c242e886bc2f2ef57
Sep 12 00:29:42.669651 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:42.669612    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-44llg" event={"ID":"87408c1b-d0be-4409-957a-dd6a204a19cb","Type":"ContainerStarted","Data":"7e04621f66d513a93e6125a0b64ba76020d27c374c751b1c242e886bc2f2ef57"}
Sep 12 00:29:42.674493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:42.674464    2556 generic.go:356] "Generic (PLEG): container finished" podID="5a652405-5720-44ba-ac4a-54eee89eda70" containerID="92b59488e8e6fbfec69038a9c36577872da5438f9bcece1f075652fee776efde" exitCode=0
Sep 12 00:29:42.674596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:42.674508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerDied","Data":"92b59488e8e6fbfec69038a9c36577872da5438f9bcece1f075652fee776efde"}
Sep 12 00:29:43.475702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:43.475666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:43.475868 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:43.475744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:43.475868 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:43.475790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:43.475977 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475892    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:43.475977 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475907    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:43.475977 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475962    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:47.475941023 +0000 UTC m=+40.526526630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:43.476210 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475979    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:43.476210 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475992    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:43.476210 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.475982    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:47.475972954 +0000 UTC m=+40.526558547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:29:43.476210 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:43.476047    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:47.476031282 +0000 UTC m=+40.526616881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:45.083073 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.082854    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:45.183691 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.183651    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:45.685529 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.685495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" event={"ID":"5a652405-5720-44ba-ac4a-54eee89eda70","Type":"ContainerStarted","Data":"e472cff2bb36824283dd43db1df84b52bf42ec4cf83ae694af255204a55a3cda"}
Sep 12 00:29:45.686978 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.686950    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx" event={"ID":"dd0cfe3d-ceaa-4f9c-b095-72c78c268113","Type":"ContainerStarted","Data":"dadbabe064b02c706d93f59a51114c504a8a639b0e3d3a14bf626dad5b005277"}
Sep 12 00:29:45.688346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.688294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vhjf" event={"ID":"107cd56e-3c34-48ba-a37b-354d080ad04a","Type":"ContainerStarted","Data":"e27f48233c8d0c2ff2fe7550fcd6b0b3e026f1787e3c6335c7d0925c518c244d"}
Sep 12 00:29:45.689975 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.689952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-44llg" event={"ID":"87408c1b-d0be-4409-957a-dd6a204a19cb","Type":"ContainerStarted","Data":"52d39cafb36fb3247c13f4b14557e41e4e47f701f879ccdafd8a589d02a85699"}
Sep 12 00:29:45.690112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.690094    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:29:45.705800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.705749    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mr8k2" podStartSLOduration=16.30428035 podStartE2EDuration="38.705737697s" totalImagesPullingTime="22.401457347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:45.70509431 +0000 UTC m=+38.755679931" watchObservedRunningTime="2026-09-12 00:29:45.705737697 +0000 UTC m=+38.756323303"
Sep 12 00:29:45.719441 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.719403    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8vhjf" podStartSLOduration=2.403497192 podStartE2EDuration="6.719390754s" totalImagesPullingTime="4.315893562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:45.718829455 +0000 UTC m=+38.769415073" watchObservedRunningTime="2026-09-12 00:29:45.719390754 +0000 UTC m=+38.769976358"
Sep 12 00:29:45.732925 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.732882    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-zs2sx" podStartSLOduration=32.416486463 podStartE2EDuration="36.732870614s" totalImagesPullingTime="4.316384151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:45.732541605 +0000 UTC m=+38.783127211" watchObservedRunningTime="2026-09-12 00:29:45.732870614 +0000 UTC m=+38.783456220"
Sep 12 00:29:45.761280 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.761238    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-44llg" podStartSLOduration=34.626242397 podStartE2EDuration="37.761226007s" totalImagesPullingTime="3.13498361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:29:45.760201796 +0000 UTC m=+38.810787403" watchObservedRunningTime="2026-09-12 00:29:45.761226007 +0000 UTC m=+38.811811661"
Sep 12 00:29:45.831493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.831458    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:45.889153 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:45.889125    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log" limit=1024
Sep 12 00:29:47.503346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:47.503315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:47.503355    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:47.503376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503454    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503455    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503474    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503458    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503496    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:55.503483329 +0000 UTC m=+48.554068927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503528    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:55.503506191 +0000 UTC m=+48.554091776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:47.503686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:47.503542    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:29:55.503535796 +0000 UTC m=+48.554121392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:55.568047 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:55.568018    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:29:55.568047 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:55.568051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:29:55.568104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568168    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568200    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568213    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568237    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:11.568219719 +0000 UTC m=+64.618805310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568258    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:11.5682437 +0000 UTC m=+64.618829285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568261    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:29:55.568453 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:29:55.568309    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:11.568296589 +0000 UTC m=+64.618882187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:30:05.649853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:05.649825    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsh5t"
Sep 12 00:30:11.584708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:11.584664    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:11.584725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:11.584747    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584871    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584925    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:43.584913204 +0000 UTC m=+96.635498789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584924    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584875    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584962    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.584988    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:43.584969169 +0000 UTC m=+96.635554767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:30:11.585234 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:11.585009    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:30:43.584998878 +0000 UTC m=+96.635584466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:30:12.188156 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.188114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:30:12.188156 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.188158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:30:12.190598 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.190578    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 00:30:12.190648 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.190599    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 00:30:12.198537 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:12.198517    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 00:30:12.198582 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:12.198573    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:31:16.198557332 +0000 UTC m=+129.249142917 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : secret "metrics-daemon-secret" not found
Sep 12 00:30:12.201992 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.201971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca0297dd-65be-4b61-a9b0-00440e3b3c7e-original-pull-secret\") pod \"global-pull-secret-syncer-dnht5\" (UID: \"ca0297dd-65be-4b61-a9b0-00440e3b3c7e\") " pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:30:12.377384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.377353    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnht5"
Sep 12 00:30:12.645632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.645554    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dnht5"]
Sep 12 00:30:12.648391 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:30:12.648363    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0297dd_65be_4b61_a9b0_00440e3b3c7e.slice/crio-e40291e156353cbcdb21a8c1ecf821ed0372254e83cfb452af04a390795fb5f6 WatchSource:0}: Error finding container e40291e156353cbcdb21a8c1ecf821ed0372254e83cfb452af04a390795fb5f6: Status 404 returned error can't find the container with id e40291e156353cbcdb21a8c1ecf821ed0372254e83cfb452af04a390795fb5f6
Sep 12 00:30:12.754695 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:12.754664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dnht5" event={"ID":"ca0297dd-65be-4b61-a9b0-00440e3b3c7e","Type":"ContainerStarted","Data":"e40291e156353cbcdb21a8c1ecf821ed0372254e83cfb452af04a390795fb5f6"}
Sep 12 00:30:16.695395 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:16.695362    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-44llg"
Sep 12 00:30:17.769190 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:17.769149    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dnht5" event={"ID":"ca0297dd-65be-4b61-a9b0-00440e3b3c7e","Type":"ContainerStarted","Data":"4867b31f3152a6ffd83c59150946cbd11355911ea30aa1011945f01315a49f1e"}
Sep 12 00:30:17.783750 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:17.783702    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dnht5" podStartSLOduration=65.472352667 podStartE2EDuration="1m9.783688545s" totalImagesPullingTime="4.311335878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:30:17.782977685 +0000 UTC m=+70.833563293" watchObservedRunningTime="2026-09-12 00:30:17.783688545 +0000 UTC m=+70.834274152"
Sep 12 00:30:43.607425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:43.607388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:30:43.607425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:43.607427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:30:43.607470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607549    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607590    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607561    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607640    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:31:47.607617064 +0000 UTC m=+160.658202734 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607641    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607658    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:31:47.607648381 +0000 UTC m=+160.658233966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:30:43.607823 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:30:43.607675    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:31:47.607665524 +0000 UTC m=+160.658251121 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:31:16.232585 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:16.232536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:31:16.233154 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:16.232708    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 00:31:16.233154 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:16.232817    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:18.232796325 +0000 UTC m=+251.283381926 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : secret "metrics-daemon-secret" not found
Sep 12 00:31:42.761867 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:42.761826    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2"
Sep 12 00:31:42.771966 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:42.771939    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8" podUID="c6d612af-d795-4448-857d-b3e4701fa822"
Sep 12 00:31:42.786228 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:42.786210    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fpfxg" podUID="302a6863-e7f2-402f-bc90-b760c2a65e64"
Sep 12 00:31:42.966627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:42.966601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:31:42.966737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:42.966602    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:31:42.966799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:42.966601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:31:44.470465 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:44.470433    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:31:47.655801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:47.655751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:31:47.655801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:47.655800    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:47.655841    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655862    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655932    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls podName:302a6863-e7f2-402f-bc90-b760c2a65e64 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:49.655916996 +0000 UTC m=+282.706502585 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls") pod "dns-default-fpfxg" (UID: "302a6863-e7f2-402f-bc90-b760c2a65e64") : secret "dns-default-metrics-tls" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655934    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655936    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655945    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845f7c77c9-mt9w2: secret "image-registry-tls" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.655982    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert podName:c6d612af-d795-4448-857d-b3e4701fa822 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:49.655968862 +0000 UTC m=+282.706554447 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-58gb8" (UID: "c6d612af-d795-4448-857d-b3e4701fa822") : secret "networking-console-plugin-cert" not found
Sep 12 00:31:47.656349 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:31:47.656000    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls podName:d28072f5-9734-4ebd-ad99-3b9e171a55c2 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:49.655990895 +0000 UTC m=+282.706576484 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls") pod "image-registry-845f7c77c9-mt9w2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2") : secret "image-registry-tls" not found
Sep 12 00:31:59.448103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:31:59.448067    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:33:18.257438 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:18.257404    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:33:18.257916 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:18.257528    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 00:33:18.257916 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:18.257581    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs podName:5bf28e6c-de87-48c8-9fd8-77a6cb2a8782 nodeName:}" failed. No retries permitted until 2026-09-12 00:35:20.257564537 +0000 UTC m=+373.308150127 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs") pod "network-metrics-daemon-wgkv5" (UID: "5bf28e6c-de87-48c8-9fd8-77a6cb2a8782") : secret "metrics-daemon-secret" not found
Sep 12 00:33:28.978722 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.978689    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"]
Sep 12 00:33:28.980400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.980385    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:28.982713 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.982691    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 12 00:33:28.984164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.984144    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 12 00:33:28.985444 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.985420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 12 00:33:28.985706 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.985680    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 12 00:33:28.985914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.985898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gwcxh\""
Sep 12 00:33:28.986976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.986957    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"]
Sep 12 00:33:28.988967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.988952    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"]
Sep 12 00:33:28.989060 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.989046    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:28.990669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.990652    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"
Sep 12 00:33:28.990995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.990978    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"]
Sep 12 00:33:28.991483 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.991460    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j2g48\""
Sep 12 00:33:28.991581 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.991523    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 12 00:33:28.991638 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.991599    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:33:28.991859 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.991843    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 12 00:33:28.993202 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.993166    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 12 00:33:28.993355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.993337    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:33:28.993401 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.993346    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-d6fbr\""
Sep 12 00:33:28.998973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:28.998954    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"]
Sep 12 00:33:29.011138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.011112    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"]
Sep 12 00:33:29.079626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.079592    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"]
Sep 12 00:33:29.081479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.081465    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.084521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.084488    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 12 00:33:29.084521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.084503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 12 00:33:29.084521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.084511    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ws4nw\""
Sep 12 00:33:29.084715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.084503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:33:29.084715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.084531    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 12 00:33:29.095686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.095645    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"]
Sep 12 00:33:29.130398 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.130530 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130402    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlgm\" (UniqueName: \"kubernetes.io/projected/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-kube-api-access-4wlgm\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.130530 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4086172f-a0c3-4b51-a235-1d849583afe4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.130530 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130435    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z85wh\" (UniqueName: \"kubernetes.io/projected/fa33384c-a120-4b9c-9070-d1651f399f38-kube-api-access-z85wh\") pod \"volume-data-source-validator-86695b7cc7-t9fxl\" (UID: \"fa33384c-a120-4b9c-9070-d1651f399f38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"
Sep 12 00:33:29.130656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130530    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.130656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.130560    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxkf\" (UniqueName: \"kubernetes.io/projected/4086172f-a0c3-4b51-a235-1d849583afe4-kube-api-access-7cxkf\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.231685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231612    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.231685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54d620f0-ebb1-4b2a-8548-410971d1bcad-config\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.231685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlgm\" (UniqueName: \"kubernetes.io/projected/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-kube-api-access-4wlgm\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.231685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4086172f-a0c3-4b51-a235-1d849583afe4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54d620f0-ebb1-4b2a-8548-410971d1bcad-serving-cert\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kjkk\" (UniqueName: \"kubernetes.io/projected/54d620f0-ebb1-4b2a-8548-410971d1bcad-kube-api-access-2kjkk\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.231778    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231799    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z85wh\" (UniqueName: \"kubernetes.io/projected/fa33384c-a120-4b9c-9070-d1651f399f38-kube-api-access-z85wh\") pod \"volume-data-source-validator-86695b7cc7-t9fxl\" (UID: \"fa33384c-a120-4b9c-9070-d1651f399f38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.231836    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls podName:4086172f-a0c3-4b51-a235-1d849583afe4 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:29.731821738 +0000 UTC m=+262.782407323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w9x96" (UID: "4086172f-a0c3-4b51-a235-1d849583afe4") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.231967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.231901    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxkf\" (UniqueName: \"kubernetes.io/projected/4086172f-a0c3-4b51-a235-1d849583afe4-kube-api-access-7cxkf\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.232194 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.231974    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 00:33:29.232194 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.232031    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls podName:a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca nodeName:}" failed. No retries permitted until 2026-09-12 00:33:29.732016899 +0000 UTC m=+262.782602492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pbsl9" (UID: "a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca") : secret "samples-operator-tls" not found
Sep 12 00:33:29.232381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.232365    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4086172f-a0c3-4b51-a235-1d849583afe4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.240063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.240042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlgm\" (UniqueName: \"kubernetes.io/projected/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-kube-api-access-4wlgm\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.240153 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.240069    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z85wh\" (UniqueName: \"kubernetes.io/projected/fa33384c-a120-4b9c-9070-d1651f399f38-kube-api-access-z85wh\") pod \"volume-data-source-validator-86695b7cc7-t9fxl\" (UID: \"fa33384c-a120-4b9c-9070-d1651f399f38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"
Sep 12 00:33:29.240153 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.240142    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxkf\" (UniqueName: \"kubernetes.io/projected/4086172f-a0c3-4b51-a235-1d849583afe4-kube-api-access-7cxkf\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.304007 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.303989    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"
Sep 12 00:33:29.332926 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.332889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54d620f0-ebb1-4b2a-8548-410971d1bcad-config\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.333062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.332933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54d620f0-ebb1-4b2a-8548-410971d1bcad-serving-cert\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.333062 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.332980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kjkk\" (UniqueName: \"kubernetes.io/projected/54d620f0-ebb1-4b2a-8548-410971d1bcad-kube-api-access-2kjkk\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.333525 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.333503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54d620f0-ebb1-4b2a-8548-410971d1bcad-config\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.335082 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.335060    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54d620f0-ebb1-4b2a-8548-410971d1bcad-serving-cert\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.340812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.340786    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kjkk\" (UniqueName: \"kubernetes.io/projected/54d620f0-ebb1-4b2a-8548-410971d1bcad-kube-api-access-2kjkk\") pod \"service-ca-operator-cf7c776b7-jgns5\" (UID: \"54d620f0-ebb1-4b2a-8548-410971d1bcad\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.389871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.389845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"
Sep 12 00:33:29.566538 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.566453    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl"]
Sep 12 00:33:29.570567 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:29.570541    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa33384c_a120_4b9c_9070_d1651f399f38.slice/crio-4a7f0856291b32df0b192614b06a81cb4f1350b92ce27072bb5f2a9528b48892 WatchSource:0}: Error finding container 4a7f0856291b32df0b192614b06a81cb4f1350b92ce27072bb5f2a9528b48892: Status 404 returned error can't find the container with id 4a7f0856291b32df0b192614b06a81cb4f1350b92ce27072bb5f2a9528b48892
Sep 12 00:33:29.649846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.649713    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5"]
Sep 12 00:33:29.651889 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:29.651867    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d620f0_ebb1_4b2a_8548_410971d1bcad.slice/crio-af1b1f048f5d5a3caea9bbfb110e6a90f92ee00582ff9e847ec9dd43e782331c WatchSource:0}: Error finding container af1b1f048f5d5a3caea9bbfb110e6a90f92ee00582ff9e847ec9dd43e782331c: Status 404 returned error can't find the container with id af1b1f048f5d5a3caea9bbfb110e6a90f92ee00582ff9e847ec9dd43e782331c
Sep 12 00:33:29.735299 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.735273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:29.735406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:29.735370    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:29.735467 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.735410    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 00:33:29.735467 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.735465    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls podName:a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca nodeName:}" failed. No retries permitted until 2026-09-12 00:33:30.735451521 +0000 UTC m=+263.786037110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pbsl9" (UID: "a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca") : secret "samples-operator-tls" not found
Sep 12 00:33:29.735577 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.735475    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:29.735577 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:29.735525    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls podName:4086172f-a0c3-4b51-a235-1d849583afe4 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:30.735510533 +0000 UTC m=+263.786096138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w9x96" (UID: "4086172f-a0c3-4b51-a235-1d849583afe4") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:30.213630 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:30.213537    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5" event={"ID":"54d620f0-ebb1-4b2a-8548-410971d1bcad","Type":"ContainerStarted","Data":"af1b1f048f5d5a3caea9bbfb110e6a90f92ee00582ff9e847ec9dd43e782331c"}
Sep 12 00:33:30.215005 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:30.214974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl" event={"ID":"fa33384c-a120-4b9c-9070-d1651f399f38","Type":"ContainerStarted","Data":"4a7f0856291b32df0b192614b06a81cb4f1350b92ce27072bb5f2a9528b48892"}
Sep 12 00:33:30.743665 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:30.743629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:30.743829 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:30.743699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:30.743829 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:30.743799    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:30.743829 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:30.743804    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 00:33:30.743949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:30.743859    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls podName:4086172f-a0c3-4b51-a235-1d849583afe4 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:32.743844007 +0000 UTC m=+265.794429592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w9x96" (UID: "4086172f-a0c3-4b51-a235-1d849583afe4") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:30.743949 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:30.743871    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls podName:a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca nodeName:}" failed. No retries permitted until 2026-09-12 00:33:32.743865586 +0000 UTC m=+265.794451172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pbsl9" (UID: "a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca") : secret "samples-operator-tls" not found
Sep 12 00:33:31.219738 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:31.219698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl" event={"ID":"fa33384c-a120-4b9c-9070-d1651f399f38","Type":"ContainerStarted","Data":"a5a38fb0b99d4f7ab765cee6a8faffdfe90928ce7c0057598cb2913a443fcf94"}
Sep 12 00:33:31.236803 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:31.236744    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-t9fxl" podStartSLOduration=2.2155007859999998 podStartE2EDuration="3.23672913s" totalImagesPullingTime="1.021228344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:31.235767041 +0000 UTC m=+264.286352671" watchObservedRunningTime="2026-09-12 00:33:31.23672913 +0000 UTC m=+264.287314737"
Sep 12 00:33:32.224043 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:32.224013    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5" event={"ID":"54d620f0-ebb1-4b2a-8548-410971d1bcad","Type":"ContainerStarted","Data":"5fab60c78f00993c8ce88e82cdf189827fe935f63fc42f1ea32b154c01d7f33b"}
Sep 12 00:33:32.239080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:32.239039    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5" podStartSLOduration=1.206787522 podStartE2EDuration="3.239024842s" totalImagesPullingTime="2.03223732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:32.237511218 +0000 UTC m=+265.288096827" watchObservedRunningTime="2026-09-12 00:33:32.239024842 +0000 UTC m=+265.289610447"
Sep 12 00:33:32.762407 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:32.762327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:32.762576 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:32.762440    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:32.762640 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:32.762576    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:32.762687 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:32.762643    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 00:33:32.762687 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:32.762672    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls podName:4086172f-a0c3-4b51-a235-1d849583afe4 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:36.762647495 +0000 UTC m=+269.813233094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w9x96" (UID: "4086172f-a0c3-4b51-a235-1d849583afe4") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:32.762813 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:32.762786    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls podName:a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca nodeName:}" failed. No retries permitted until 2026-09-12 00:33:36.762752036 +0000 UTC m=+269.813337625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pbsl9" (UID: "a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca") : secret "samples-operator-tls" not found
Sep 12 00:33:33.786973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.786943    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"]
Sep 12 00:33:33.790003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.789986    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"
Sep 12 00:33:33.792537 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.792519    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 12 00:33:33.792647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.792538    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 12 00:33:33.793578 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.793560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9cmh7\""
Sep 12 00:33:33.799125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.799105    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"]
Sep 12 00:33:33.870242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.870212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmtt7\" (UniqueName: \"kubernetes.io/projected/d5e9314c-ed71-491b-9d2e-e133466e580c-kube-api-access-kmtt7\") pod \"migrator-8b4d697c5-n8rfb\" (UID: \"d5e9314c-ed71-491b-9d2e-e133466e580c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"
Sep 12 00:33:33.970745 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.970716    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmtt7\" (UniqueName: \"kubernetes.io/projected/d5e9314c-ed71-491b-9d2e-e133466e580c-kube-api-access-kmtt7\") pod \"migrator-8b4d697c5-n8rfb\" (UID: \"d5e9314c-ed71-491b-9d2e-e133466e580c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"
Sep 12 00:33:33.977888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:33.977868    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmtt7\" (UniqueName: \"kubernetes.io/projected/d5e9314c-ed71-491b-9d2e-e133466e580c-kube-api-access-kmtt7\") pod \"migrator-8b4d697c5-n8rfb\" (UID: \"d5e9314c-ed71-491b-9d2e-e133466e580c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"
Sep 12 00:33:34.098677 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.098613    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"
Sep 12 00:33:34.360426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.360358    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb"]
Sep 12 00:33:34.364199 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:34.364173    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e9314c_ed71_491b_9d2e_e133466e580c.slice/crio-5c44bd07d3ccc2cd7f65f46a9ed7b057c98c347753c312d7f25f2295ca056c22 WatchSource:0}: Error finding container 5c44bd07d3ccc2cd7f65f46a9ed7b057c98c347753c312d7f25f2295ca056c22: Status 404 returned error can't find the container with id 5c44bd07d3ccc2cd7f65f46a9ed7b057c98c347753c312d7f25f2295ca056c22
Sep 12 00:33:34.665213 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.665184    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r44pq"]
Sep 12 00:33:34.669554 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.669539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.672641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.672618    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 12 00:33:34.673008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.672993    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 12 00:33:34.673616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.673601    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hwlcm\""
Sep 12 00:33:34.673662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.673610    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 12 00:33:34.679204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.679188    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 12 00:33:34.690640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.690617    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r44pq"]
Sep 12 00:33:34.776201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.776171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grcz\" (UniqueName: \"kubernetes.io/projected/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-api-access-4grcz\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.776201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.776206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-crio-socket\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.776419 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.776246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.776419 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.776372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.776419 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.776404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-data-volume\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877492    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877526    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-data-volume\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grcz\" (UniqueName: \"kubernetes.io/projected/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-api-access-4grcz\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-crio-socket\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:34.877634    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877636    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:34.877711    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-crio-socket\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:34.877716    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:35.377694527 +0000 UTC m=+268.428280124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : configmap "kube-rbac-proxy" not found
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:34.877809    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:35.377792668 +0000 UTC m=+268.428378254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:34.877989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.877888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-data-volume\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:34.885083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:34.885065    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grcz\" (UniqueName: \"kubernetes.io/projected/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-api-access-4grcz\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:35.207581 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.207540    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-nnzgr"]
Sep 12 00:33:35.210473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.210456    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.213061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.212952    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-787hw\""
Sep 12 00:33:35.213061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.212992    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 12 00:33:35.213061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.212952    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 12 00:33:35.213291 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.212958    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 12 00:33:35.213291 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.213225    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 12 00:33:35.217151 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.217046    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-nnzgr"]
Sep 12 00:33:35.235400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.235370    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb" event={"ID":"d5e9314c-ed71-491b-9d2e-e133466e580c","Type":"ContainerStarted","Data":"5c44bd07d3ccc2cd7f65f46a9ed7b057c98c347753c312d7f25f2295ca056c22"}
Sep 12 00:33:35.381588 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.381540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:35.381792 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.381611    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbj6\" (UniqueName: \"kubernetes.io/projected/331046bd-dabb-4586-b5e5-ed7d1e6780b5-kube-api-access-fwbj6\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.381792 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:35.381665    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:33:35.381792 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:35.381740    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:36.381719704 +0000 UTC m=+269.432305289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : configmap "kube-rbac-proxy" not found
Sep 12 00:33:35.381792 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.381675    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-cabundle\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.382008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.381833    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:35.382008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.381878    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-key\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.382008 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:35.381982    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:35.382157 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:35.382036    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:36.382025128 +0000 UTC m=+269.432610718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:35.482739 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.482718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbj6\" (UniqueName: \"kubernetes.io/projected/331046bd-dabb-4586-b5e5-ed7d1e6780b5-kube-api-access-fwbj6\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.482845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.482785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-cabundle\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.482845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.482818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-key\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.483381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.483354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-cabundle\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.484835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.484817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331046bd-dabb-4586-b5e5-ed7d1e6780b5-signing-key\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.492910 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.492891    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbj6\" (UniqueName: \"kubernetes.io/projected/331046bd-dabb-4586-b5e5-ed7d1e6780b5-kube-api-access-fwbj6\") pod \"service-ca-568869fdc5-nnzgr\" (UID: \"331046bd-dabb-4586-b5e5-ed7d1e6780b5\") " pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.520225 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.520200    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-nnzgr"
Sep 12 00:33:35.788198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:35.788132    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-nnzgr"]
Sep 12 00:33:35.790862 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:35.790837    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331046bd_dabb_4586_b5e5_ed7d1e6780b5.slice/crio-ad8de412a11e1ea8feb5d49efa6030d5f185e1cd79490759363cfb81e2e46324 WatchSource:0}: Error finding container ad8de412a11e1ea8feb5d49efa6030d5f185e1cd79490759363cfb81e2e46324: Status 404 returned error can't find the container with id ad8de412a11e1ea8feb5d49efa6030d5f185e1cd79490759363cfb81e2e46324
Sep 12 00:33:36.240669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.240631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-nnzgr" event={"ID":"331046bd-dabb-4586-b5e5-ed7d1e6780b5","Type":"ContainerStarted","Data":"f2a2cea713787227e1968fb1b0695735342c97f3ea9cdd8c5843d32801b100e8"}
Sep 12 00:33:36.241124 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.240683    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-nnzgr" event={"ID":"331046bd-dabb-4586-b5e5-ed7d1e6780b5","Type":"ContainerStarted","Data":"ad8de412a11e1ea8feb5d49efa6030d5f185e1cd79490759363cfb81e2e46324"}
Sep 12 00:33:36.242309 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.242286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb" event={"ID":"d5e9314c-ed71-491b-9d2e-e133466e580c","Type":"ContainerStarted","Data":"7e9066310120ca37cbaf751fdca323a2203e5e2cadf4e572f2b799e108469b07"}
Sep 12 00:33:36.242408 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.242325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb" event={"ID":"d5e9314c-ed71-491b-9d2e-e133466e580c","Type":"ContainerStarted","Data":"b28daff71e6e174a34337073cd64484fc5b4bf6c2110ebffecc0440fe976935d"}
Sep 12 00:33:36.258646 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.258610    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-nnzgr" podStartSLOduration=1.258596998 podStartE2EDuration="1.258596998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:36.258406982 +0000 UTC m=+269.308992591" watchObservedRunningTime="2026-09-12 00:33:36.258596998 +0000 UTC m=+269.309182604"
Sep 12 00:33:36.273036 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.272994    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n8rfb" podStartSLOduration=2.196554307 podStartE2EDuration="3.272979252s" totalImagesPullingTime="1.076424945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:36.272781435 +0000 UTC m=+269.323367043" watchObservedRunningTime="2026-09-12 00:33:36.272979252 +0000 UTC m=+269.323564862"
Sep 12 00:33:36.391374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.391338    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:36.391558 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.391437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:36.391558 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.391511    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:33:36.391675 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.391592    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:38.391571908 +0000 UTC m=+271.442157508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : configmap "kube-rbac-proxy" not found
Sep 12 00:33:36.391675 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.391613    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:36.391675 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.391669    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:38.391654216 +0000 UTC m=+271.442239823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:36.794929 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.794890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:36.795107 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:36.795032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:36.795107 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.795050    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:36.795205 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.795126    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls podName:4086172f-a0c3-4b51-a235-1d849583afe4 nodeName:}" failed. No retries permitted until 2026-09-12 00:33:44.795104144 +0000 UTC m=+277.845689732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w9x96" (UID: "4086172f-a0c3-4b51-a235-1d849583afe4") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:33:36.795205 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.795194    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 00:33:36.795281 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:36.795257    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls podName:a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca nodeName:}" failed. No retries permitted until 2026-09-12 00:33:44.795230026 +0000 UTC m=+277.845815626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pbsl9" (UID: "a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca") : secret "samples-operator-tls" not found
Sep 12 00:33:37.609319 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:37.609287    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxhkp_908b6f7e-9883-454c-bebc-b886a46c0390/dns-node-resolver/0.log"
Sep 12 00:33:38.409833 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:38.409802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:38.409994 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:38.409878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:38.409994 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:38.409942    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:33:38.410056 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:38.409998    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:38.410056 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:38.410021    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:42.410000667 +0000 UTC m=+275.460586263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : configmap "kube-rbac-proxy" not found
Sep 12 00:33:38.410056 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:38.410041    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:42.410028487 +0000 UTC m=+275.460614089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:38.608540 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:38.608511    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhh8h_a56f9274-d259-4961-98bc-cd25c221822c/node-ca/0.log"
Sep 12 00:33:39.008120 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:39.008095    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vhjf_107cd56e-3c34-48ba-a37b-354d080ad04a/serve-healthcheck-canary/0.log"
Sep 12 00:33:39.608467 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:39.608440    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-n8rfb_d5e9314c-ed71-491b-9d2e-e133466e580c/migrator/0.log"
Sep 12 00:33:39.807712 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:39.807685    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-n8rfb_d5e9314c-ed71-491b-9d2e-e133466e580c/graceful-termination/0.log"
Sep 12 00:33:42.447010 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:42.446983    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:42.447384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:42.447058    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:42.447384 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:42.447100    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:42.447384 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:42.447124    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:33:42.447384 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:42.447178    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:50.447161332 +0000 UTC m=+283.497746918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : configmap "kube-rbac-proxy" not found
Sep 12 00:33:42.447384 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:42.447194    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls podName:d0a24344-9f40-4b7a-a3cc-56bae20bf25b nodeName:}" failed. No retries permitted until 2026-09-12 00:33:50.447186904 +0000 UTC m=+283.497772489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r44pq" (UID: "d0a24344-9f40-4b7a-a3cc-56bae20bf25b") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:33:44.863315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.863275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:44.863803 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.863357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:44.866131 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.866099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4086172f-a0c3-4b51-a235-1d849583afe4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w9x96\" (UID: \"4086172f-a0c3-4b51-a235-1d849583afe4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:44.866222 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.866130    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pbsl9\" (UID: \"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:44.890012 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.889990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"
Sep 12 00:33:44.898956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:44.898935    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"
Sep 12 00:33:45.170375 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:45.170341    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96"]
Sep 12 00:33:45.172026 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:45.172007    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9"]
Sep 12 00:33:45.173576 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:45.173556    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4086172f_a0c3_4b51_a235_1d849583afe4.slice/crio-f1ab1c2933688a32455c06564d756813bd1625d6197f8982ed29d9624334e9a2 WatchSource:0}: Error finding container f1ab1c2933688a32455c06564d756813bd1625d6197f8982ed29d9624334e9a2: Status 404 returned error can't find the container with id f1ab1c2933688a32455c06564d756813bd1625d6197f8982ed29d9624334e9a2
Sep 12 00:33:45.270117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:45.270081    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9" event={"ID":"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca","Type":"ContainerStarted","Data":"1156a1be9e4c68c165355a4174fce62bb0ae84c6b348bc59927f7fda14c83011"}
Sep 12 00:33:45.271258 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:45.271234    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96" event={"ID":"4086172f-a0c3-4b51-a235-1d849583afe4","Type":"ContainerStarted","Data":"f1ab1c2933688a32455c06564d756813bd1625d6197f8982ed29d9624334e9a2"}
Sep 12 00:33:45.967699 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:45.967656    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8" podUID="c6d612af-d795-4448-857d-b3e4701fa822"
Sep 12 00:33:45.968110 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:45.967665    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fpfxg" podUID="302a6863-e7f2-402f-bc90-b760c2a65e64"
Sep 12 00:33:45.968110 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:33:45.967672    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2"
Sep 12 00:33:46.273885 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:46.273817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:33:46.274030 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:46.273817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:33:46.274030 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:46.273817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:33:47.278151 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:47.278120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9" event={"ID":"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca","Type":"ContainerStarted","Data":"db1e33768532e07f4607c0fb65d23cb51a397156f1c14023f65a0e0e275758bd"}
Sep 12 00:33:47.279908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:47.279880    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96" event={"ID":"4086172f-a0c3-4b51-a235-1d849583afe4","Type":"ContainerStarted","Data":"0269594a94f403307913243096bee7a40297b53179a2c2c2a55e4991f8dc585a"}
Sep 12 00:33:48.287210 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:48.287168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9" event={"ID":"a7a01eb2-6a2f-4a14-b0b6-a79e0252f4ca","Type":"ContainerStarted","Data":"9d38b0fc273906578b412e4f7dab5f30db1b063211c2a5a6a1cd1540b4279dd2"}
Sep 12 00:33:48.302883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:48.302833    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w9x96" podStartSLOduration=18.268937714 podStartE2EDuration="20.302818106s" totalImagesPullingTime="2.033880392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:47.297835467 +0000 UTC m=+280.348421074" watchObservedRunningTime="2026-09-12 00:33:48.302818106 +0000 UTC m=+281.353403749"
Sep 12 00:33:48.303021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:48.302926    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pbsl9" podStartSLOduration=18.305756748 podStartE2EDuration="20.302921224s" totalImagesPullingTime="1.997164476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:48.301864992 +0000 UTC m=+281.352450598" watchObservedRunningTime="2026-09-12 00:33:48.302921224 +0000 UTC m=+281.353506832"
Sep 12 00:33:49.701406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.701362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:33:49.701793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.701449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:33:49.701793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.701510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:33:49.703832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.703808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/302a6863-e7f2-402f-bc90-b760c2a65e64-metrics-tls\") pod \"dns-default-fpfxg\" (UID: \"302a6863-e7f2-402f-bc90-b760c2a65e64\") " pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:33:49.703999 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.703982    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"image-registry-845f7c77c9-mt9w2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") " pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:33:49.704069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.704000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6d612af-d795-4448-857d-b3e4701fa822-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-58gb8\" (UID: \"c6d612af-d795-4448-857d-b3e4701fa822\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:33:49.878200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.878174    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7jvg\""
Sep 12 00:33:49.878200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.878189    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cg9mt\""
Sep 12 00:33:49.878200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.878177    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nqbvs\""
Sep 12 00:33:49.885558 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.885538    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"
Sep 12 00:33:49.885638 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.885567    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:33:49.885638 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:49.885605    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:33:50.164503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.164468    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8"]
Sep 12 00:33:50.168209 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.168188    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fpfxg"]
Sep 12 00:33:50.168305 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:50.168280    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d612af_d795_4448_857d_b3e4701fa822.slice/crio-7344cd429d714de2b90fdcb87da321bbd579dbc23d19ef840f23c03b613155be WatchSource:0}: Error finding container 7344cd429d714de2b90fdcb87da321bbd579dbc23d19ef840f23c03b613155be: Status 404 returned error can't find the container with id 7344cd429d714de2b90fdcb87da321bbd579dbc23d19ef840f23c03b613155be
Sep 12 00:33:50.169303 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.169279    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:33:50.170356 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:50.170335    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28072f5_9734_4ebd_ad99_3b9e171a55c2.slice/crio-cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959 WatchSource:0}: Error finding container cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959: Status 404 returned error can't find the container with id cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959
Sep 12 00:33:50.171087 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:50.171062    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302a6863_e7f2_402f_bc90_b760c2a65e64.slice/crio-5747b6bf8291d4c3ff87450a13fcac76cdb0291ca9aa0a69a18791de54bd070c WatchSource:0}: Error finding container 5747b6bf8291d4c3ff87450a13fcac76cdb0291ca9aa0a69a18791de54bd070c: Status 404 returned error can't find the container with id 5747b6bf8291d4c3ff87450a13fcac76cdb0291ca9aa0a69a18791de54bd070c
Sep 12 00:33:50.293801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.293749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpfxg" event={"ID":"302a6863-e7f2-402f-bc90-b760c2a65e64","Type":"ContainerStarted","Data":"5747b6bf8291d4c3ff87450a13fcac76cdb0291ca9aa0a69a18791de54bd070c"}
Sep 12 00:33:50.295132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.295108    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" event={"ID":"d28072f5-9734-4ebd-ad99-3b9e171a55c2","Type":"ContainerStarted","Data":"301cb14b2538094436903ef258860a202b018eadba07314b0f6146b5dec279e5"}
Sep 12 00:33:50.295248 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.295153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" event={"ID":"d28072f5-9734-4ebd-ad99-3b9e171a55c2","Type":"ContainerStarted","Data":"cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959"}
Sep 12 00:33:50.295248 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.295212    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:33:50.296298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.296271    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8" event={"ID":"c6d612af-d795-4448-857d-b3e4701fa822","Type":"ContainerStarted","Data":"7344cd429d714de2b90fdcb87da321bbd579dbc23d19ef840f23c03b613155be"}
Sep 12 00:33:50.313423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.313380    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" podStartSLOduration=282.31336459 podStartE2EDuration="4m42.31336459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:50.312254339 +0000 UTC m=+283.362839947" watchObservedRunningTime="2026-09-12 00:33:50.31336459 +0000 UTC m=+283.363950198"
Sep 12 00:33:50.508389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.508309    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:50.508389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.508366    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:50.508841 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.508821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:50.510463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.510439    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a24344-9f40-4b7a-a3cc-56bae20bf25b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r44pq\" (UID: \"d0a24344-9f40-4b7a-a3cc-56bae20bf25b\") " pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:50.577589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.577559    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r44pq"
Sep 12 00:33:50.848002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:50.847920    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r44pq"]
Sep 12 00:33:50.850808 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:33:50.850751    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a24344_9f40_4b7a_a3cc_56bae20bf25b.slice/crio-e84d3b76ae439e2227bb65b91e3da4ec1d9568ba287bdb3fdcf435600cfba2aa WatchSource:0}: Error finding container e84d3b76ae439e2227bb65b91e3da4ec1d9568ba287bdb3fdcf435600cfba2aa: Status 404 returned error can't find the container with id e84d3b76ae439e2227bb65b91e3da4ec1d9568ba287bdb3fdcf435600cfba2aa
Sep 12 00:33:51.301792 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:51.301742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r44pq" event={"ID":"d0a24344-9f40-4b7a-a3cc-56bae20bf25b","Type":"ContainerStarted","Data":"9ed8b7d8d5964314e11efa962b49cf3905699a1ddfa9e70424ddcf5c18b12cd1"}
Sep 12 00:33:51.301907 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:51.301818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r44pq" event={"ID":"d0a24344-9f40-4b7a-a3cc-56bae20bf25b","Type":"ContainerStarted","Data":"e84d3b76ae439e2227bb65b91e3da4ec1d9568ba287bdb3fdcf435600cfba2aa"}
Sep 12 00:33:52.306133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.306062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8" event={"ID":"c6d612af-d795-4448-857d-b3e4701fa822","Type":"ContainerStarted","Data":"5b579b413bd371fe6efe1dcf9b9b2317bace3e217b199b4d76a4e4607ea088bd"}
Sep 12 00:33:52.307870 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.307847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r44pq" event={"ID":"d0a24344-9f40-4b7a-a3cc-56bae20bf25b","Type":"ContainerStarted","Data":"13fe8ae32f80ecd547223c54fedbce3b71e21ebbfa802a47ccb0bfe762e273b0"}
Sep 12 00:33:52.309439 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.309421    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpfxg" event={"ID":"302a6863-e7f2-402f-bc90-b760c2a65e64","Type":"ContainerStarted","Data":"3b756d8fbb9f4a3d656fe0ada91143b533a10e00dc7970e7fed812203083cd73"}
Sep 12 00:33:52.309518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.309455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpfxg" event={"ID":"302a6863-e7f2-402f-bc90-b760c2a65e64","Type":"ContainerStarted","Data":"194339d09762e7cea9f383b4ff592c06554ea5d881daba2b808d39914d2abdd8"}
Sep 12 00:33:52.309518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.309485    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:33:52.320117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.320079    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-58gb8" podStartSLOduration=255.22547635 podStartE2EDuration="4m16.320066922s" totalImagesPullingTime="1.094590572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:52.319704669 +0000 UTC m=+285.370290278" watchObservedRunningTime="2026-09-12 00:33:52.320066922 +0000 UTC m=+285.370652532"
Sep 12 00:33:52.334832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:52.334796    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fpfxg" podStartSLOduration=251.468325544 podStartE2EDuration="4m13.334784109s" totalImagesPullingTime="1.866458565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:52.334464666 +0000 UTC m=+285.385050273" watchObservedRunningTime="2026-09-12 00:33:52.334784109 +0000 UTC m=+285.385369710"
Sep 12 00:33:54.318058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:54.318024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r44pq" event={"ID":"d0a24344-9f40-4b7a-a3cc-56bae20bf25b","Type":"ContainerStarted","Data":"7827c5187a6a8ef6811c5db2af90fa62beed9a44b897c11b22b22b952a0069e0"}
Sep 12 00:33:54.335240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:33:54.335191    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r44pq" podStartSLOduration=17.897149106 podStartE2EDuration="20.335177998s" totalImagesPullingTime="2.438028892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:33:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:33:54.333716404 +0000 UTC m=+287.384302011" watchObservedRunningTime="2026-09-12 00:33:54.335177998 +0000 UTC m=+287.385763604"
Sep 12 00:34:02.315513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:02.315483    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fpfxg"
Sep 12 00:34:02.449536 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:02.449491    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wgkv5" podUID="5bf28e6c-de87-48c8-9fd8-77a6cb2a8782"
Sep 12 00:34:05.075265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.075234    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"]
Sep 12 00:34:05.077707 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.077689    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.080242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.080214    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 12 00:34:05.080370 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.080213    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 12 00:34:05.080454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.080356    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nr7pt\""
Sep 12 00:34:05.081238 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.081220    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 12 00:34:05.090412 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.090392    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"]
Sep 12 00:34:05.093113 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.093094    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xchll"]
Sep 12 00:34:05.095610 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.095592    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.099584 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.099559    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 12 00:34:05.100490 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.100472    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 12 00:34:05.101200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.101183    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rm5ll\""
Sep 12 00:34:05.102434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.102419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 12 00:34:05.115640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.114148    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"]
Sep 12 00:34:05.116060 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.116024    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a960586-0337-4040-b0df-80e6d69136f1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.116150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.116081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.116150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.116109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5tr\" (UniqueName: \"kubernetes.io/projected/0a960586-0337-4040-b0df-80e6d69136f1-kube-api-access-rc5tr\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.116247 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.116177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.117656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.117639    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.118430 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.118408    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"]
Sep 12 00:34:05.120328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.120309    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 12 00:34:05.120510 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.120490    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-76gtf\""
Sep 12 00:34:05.120668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.120655    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 12 00:34:05.120733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.120689    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 12 00:34:05.217365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217335    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-textfile\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-sys\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217394    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrjg\" (UniqueName: \"kubernetes.io/projected/1936775f-3d01-41b2-a888-ffeff3f631f2-kube-api-access-ccrjg\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217528    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-wtmp\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217594    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a960586-0337-4040-b0df-80e6d69136f1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgllh\" (UniqueName: \"kubernetes.io/projected/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-api-access-lgllh\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217687    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-tls\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-root\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217780    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5tr\" (UniqueName: \"kubernetes.io/projected/0a960586-0337-4040-b0df-80e6d69136f1-kube-api-access-rc5tr\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.217854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-metrics-client-ca\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.217955 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:05.217919    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 12 00:34:05.218493 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:05.217972    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls podName:0a960586-0337-4040-b0df-80e6d69136f1 nodeName:}" failed. No retries permitted until 2026-09-12 00:34:05.717955377 +0000 UTC m=+298.768540971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-tz7vx" (UID: "0a960586-0337-4040-b0df-80e6d69136f1") : secret "openshift-state-metrics-tls" not found
Sep 12 00:34:05.218493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.218366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a960586-0337-4040-b0df-80e6d69136f1-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.220338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.220312    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.227472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.227432    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5tr\" (UniqueName: \"kubernetes.io/projected/0a960586-0337-4040-b0df-80e6d69136f1-kube-api-access-rc5tr\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.318816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.318779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.318816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.318817    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.318922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgllh\" (UniqueName: \"kubernetes.io/projected/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-api-access-lgllh\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.318947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-tls\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319154 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319108    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319207 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319165    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319256 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-root\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319283    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-root\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319356 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319302    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319356 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319339    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-metrics-client-ca\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319370    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-textfile\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-sys\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-sys\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319517    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319699 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrjg\" (UniqueName: \"kubernetes.io/projected/1936775f-3d01-41b2-a888-ffeff3f631f2-kube-api-access-ccrjg\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319773 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319714    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-textfile\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319773 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.319883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-wtmp\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.319883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.319828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.320422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.320023    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.320422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.320160    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-wtmp\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.320422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.320327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-metrics-client-ca\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.320422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.320388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.320837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.320806    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.321793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.321749    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-tls\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.321912 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.321848    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.321981 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.321971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.322215 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.322190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1936775f-3d01-41b2-a888-ffeff3f631f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.325862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.325822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgllh\" (UniqueName: \"kubernetes.io/projected/5783b4cc-d9c2-46f0-a0f5-ca1870fc811e-kube-api-access-lgllh\") pod \"kube-state-metrics-59fbdd77d-wfhsv\" (UID: \"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.326440 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.326418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrjg\" (UniqueName: \"kubernetes.io/projected/1936775f-3d01-41b2-a888-ffeff3f631f2-kube-api-access-ccrjg\") pod \"node-exporter-xchll\" (UID: \"1936775f-3d01-41b2-a888-ffeff3f631f2\") " pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.417289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.417262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xchll"
Sep 12 00:34:05.429410 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.429385    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"
Sep 12 00:34:05.431008 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:05.430982    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1936775f_3d01_41b2_a888_ffeff3f631f2.slice/crio-1e96c7c53647d61e410d6011d129bbe01dc9f344d38d0ed4efd31cb2c579a7c6 WatchSource:0}: Error finding container 1e96c7c53647d61e410d6011d129bbe01dc9f344d38d0ed4efd31cb2c579a7c6: Status 404 returned error can't find the container with id 1e96c7c53647d61e410d6011d129bbe01dc9f344d38d0ed4efd31cb2c579a7c6
Sep 12 00:34:05.701287 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.701145    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv"]
Sep 12 00:34:05.703497 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:05.703472    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5783b4cc_d9c2_46f0_a0f5_ca1870fc811e.slice/crio-9926e859935c5d63a7f3d0006adc0639ca618c255cd03a9431d582f181776214 WatchSource:0}: Error finding container 9926e859935c5d63a7f3d0006adc0639ca618c255cd03a9431d582f181776214: Status 404 returned error can't find the container with id 9926e859935c5d63a7f3d0006adc0639ca618c255cd03a9431d582f181776214
Sep 12 00:34:05.722827 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.722806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.725066 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.725047    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a960586-0337-4040-b0df-80e6d69136f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tz7vx\" (UID: \"0a960586-0337-4040-b0df-80e6d69136f1\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:05.988416 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:05.988342    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"
Sep 12 00:34:06.142319 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.142289    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:34:06.160892 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.160822    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:34:06.161039 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.160988    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.163728 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.163678    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 12 00:34:06.164298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164117    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 12 00:34:06.164407 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164309    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 12 00:34:06.164504 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164487    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 12 00:34:06.165149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 12 00:34:06.165149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164683    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 12 00:34:06.165149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164845    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 12 00:34:06.165149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.164885    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 12 00:34:06.165149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.165025    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 12 00:34:06.165437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.165151    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kpqs2\""
Sep 12 00:34:06.227137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.226981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227028    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8dr6\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227057    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227435 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.227846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.227449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.305197 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.305101    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx"]
Sep 12 00:34:06.309897 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:06.309866    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a960586_0337_4040_b0df_80e6d69136f1.slice/crio-c39bb78069c771eb1122e0f40f6965621e45fc94c0fccefde3142b8314c47c06 WatchSource:0}: Error finding container c39bb78069c771eb1122e0f40f6965621e45fc94c0fccefde3142b8314c47c06: Status 404 returned error can't find the container with id c39bb78069c771eb1122e0f40f6965621e45fc94c0fccefde3142b8314c47c06
Sep 12 00:34:06.328857 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.328828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8dr6\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.328961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.328890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.328961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.328940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329081 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.328980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329081 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329008    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329081 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329081 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:06.329132    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:06.329187    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls podName:763139ee-3eb4-4259-8999-f9ccbcbac56a nodeName:}" failed. No retries permitted until 2026-09-12 00:34:06.829169132 +0000 UTC m=+299.879754721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a") : secret "alertmanager-main-tls" not found
Sep 12 00:34:06.329270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329566 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329566 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.329941 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.329831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.330828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.330467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.331187 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:06.331135    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle podName:763139ee-3eb4-4259-8999-f9ccbcbac56a nodeName:}" failed. No retries permitted until 2026-09-12 00:34:06.831116409 +0000 UTC m=+299.881701998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a") : configmap references non-existent config key: ca-bundle.crt
Sep 12 00:34:06.334612 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.334572    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.335977 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.335937    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.336549 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.336505    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.337346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.337306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.339737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.339696    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8dr6\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.341971 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.341923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.342246 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.342222    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.342444 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.342421    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.345250 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.345231    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.358829 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.358086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xchll" event={"ID":"1936775f-3d01-41b2-a888-ffeff3f631f2","Type":"ContainerStarted","Data":"1e96c7c53647d61e410d6011d129bbe01dc9f344d38d0ed4efd31cb2c579a7c6"}
Sep 12 00:34:06.364313 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.364272    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx" event={"ID":"0a960586-0337-4040-b0df-80e6d69136f1","Type":"ContainerStarted","Data":"c39bb78069c771eb1122e0f40f6965621e45fc94c0fccefde3142b8314c47c06"}
Sep 12 00:34:06.366919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.366887    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv" event={"ID":"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e","Type":"ContainerStarted","Data":"9926e859935c5d63a7f3d0006adc0639ca618c255cd03a9431d582f181776214"}
Sep 12 00:34:06.835077 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.835046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.835235 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.835095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:06.835235 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:06.835220    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 12 00:34:06.835355 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:34:06.835296    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls podName:763139ee-3eb4-4259-8999-f9ccbcbac56a nodeName:}" failed. No retries permitted until 2026-09-12 00:34:07.835277985 +0000 UTC m=+300.885863586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a") : secret "alertmanager-main-tls" not found
Sep 12 00:34:06.836015 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:06.835995    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:07.370954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.370916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx" event={"ID":"0a960586-0337-4040-b0df-80e6d69136f1","Type":"ContainerStarted","Data":"a53331fc5b6da2c3039851f2f6e75f7f268dee4d26be51eb19476153bd9f1293"}
Sep 12 00:34:07.838954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.513528    2556 kubelet.go:1648] "Image garbage collection succeeded"
Sep 12 00:34:07.845223 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.845193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:07.848052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.848024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:07.974911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.974884    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kpqs2\""
Sep 12 00:34:07.982749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:07.982721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:34:08.280220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.280196    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:34:08.282151 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:08.282118    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763139ee_3eb4_4259_8999_f9ccbcbac56a.slice/crio-0df08db25bffae61cc3a9de91d2e1c6f06b2f57bd7f8fa4839ead5ce639a9266 WatchSource:0}: Error finding container 0df08db25bffae61cc3a9de91d2e1c6f06b2f57bd7f8fa4839ead5ce639a9266: Status 404 returned error can't find the container with id 0df08db25bffae61cc3a9de91d2e1c6f06b2f57bd7f8fa4839ead5ce639a9266
Sep 12 00:34:08.377165 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.377131    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx" event={"ID":"0a960586-0337-4040-b0df-80e6d69136f1","Type":"ContainerStarted","Data":"56cd3208ad9cdcf26293e9f2b6437b8fc3684479a02e5570cef08ef76675e7fd"}
Sep 12 00:34:08.378999 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.378965    2556 generic.go:356] "Generic (PLEG): container finished" podID="1936775f-3d01-41b2-a888-ffeff3f631f2" containerID="fbc41e534ba8a0996215cd0a6fd0b2be15804031af167d35c9060d85f71cd90b" exitCode=0
Sep 12 00:34:08.379131 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.379005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xchll" event={"ID":"1936775f-3d01-41b2-a888-ffeff3f631f2","Type":"ContainerDied","Data":"fbc41e534ba8a0996215cd0a6fd0b2be15804031af167d35c9060d85f71cd90b"}
Sep 12 00:34:08.380416 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.380391    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"0df08db25bffae61cc3a9de91d2e1c6f06b2f57bd7f8fa4839ead5ce639a9266"}
Sep 12 00:34:08.382815 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.382792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv" event={"ID":"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e","Type":"ContainerStarted","Data":"990b476dc5989fa54218d7398ecab866b070ef80877872453e8cc045c05a76e8"}
Sep 12 00:34:08.382898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.382847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv" event={"ID":"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e","Type":"ContainerStarted","Data":"3ddd01d280d79eb937d88e4b16cc4c15c665f7fb407b2a6a749ce0d61855da06"}
Sep 12 00:34:08.382898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.382877    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv" event={"ID":"5783b4cc-d9c2-46f0-a0f5-ca1870fc811e","Type":"ContainerStarted","Data":"14aba0fee0995ca5a6d1c6a62730863180ede0f51431952db5a3c699d510cfce"}
Sep 12 00:34:08.411192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:08.411155    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wfhsv" podStartSLOduration=1.632225133 podStartE2EDuration="3.411140982s" totalImagesPullingTime="1.778915849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:08.4093714 +0000 UTC m=+301.459957022" watchObservedRunningTime="2026-09-12 00:34:08.411140982 +0000 UTC m=+301.461726588"
Sep 12 00:34:09.392743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.392660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx" event={"ID":"0a960586-0337-4040-b0df-80e6d69136f1","Type":"ContainerStarted","Data":"3a353f10e640c41e95f6950db610b5bc4a45fea1290b16b328c577afd85b3258"}
Sep 12 00:34:09.395146 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.395083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xchll" event={"ID":"1936775f-3d01-41b2-a888-ffeff3f631f2","Type":"ContainerStarted","Data":"cfa3d1650152db01224a155c87259167e22c18f206712d2ec4f39142ffd9f170"}
Sep 12 00:34:09.395146 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.395136    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xchll" event={"ID":"1936775f-3d01-41b2-a888-ffeff3f631f2","Type":"ContainerStarted","Data":"45c4f93aa472941bc0919f688f4aa00d6c6dbaa4eacd80a3f9ba49f969ee51eb"}
Sep 12 00:34:09.408813 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.408751    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tz7vx" podStartSLOduration=2.986347124 podStartE2EDuration="4.40873716s" totalImagesPullingTime="1.422390036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:09.40780495 +0000 UTC m=+302.458390560" watchObservedRunningTime="2026-09-12 00:34:09.40873716 +0000 UTC m=+302.459322785"
Sep 12 00:34:09.423693 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.423643    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xchll" podStartSLOduration=2.284389178 podStartE2EDuration="4.423626638s" totalImagesPullingTime="2.049974233s" totalInitContainerRuntime="89.263227ms" isStatefulPod=true podCreationTimestamp="2026-09-12 00:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:09.422986373 +0000 UTC m=+302.473571998" watchObservedRunningTime="2026-09-12 00:34:09.423626638 +0000 UTC m=+302.474212248"
Sep 12 00:34:09.858993 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.858963    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"]
Sep 12 00:34:09.861120 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.861102    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:09.863325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.863308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 12 00:34:09.863494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.863472    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8v7mk\""
Sep 12 00:34:09.871133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.871114    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"]
Sep 12 00:34:09.890207 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.890184    2556 patch_prober.go:28] interesting pod/image-registry-845f7c77c9-mt9w2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 12 00:34:09.890296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.890225    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:34:09.964112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.964089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24b69f9f-5f94-4849-bbbc-932ad1197272-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:09.964209 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:09.964125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8zf\" (UniqueName: \"kubernetes.io/projected/24b69f9f-5f94-4849-bbbc-932ad1197272-kube-api-access-hd8zf\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.065376 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.065347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8zf\" (UniqueName: \"kubernetes.io/projected/24b69f9f-5f94-4849-bbbc-932ad1197272-kube-api-access-hd8zf\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.065505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.065425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24b69f9f-5f94-4849-bbbc-932ad1197272-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.067706 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.067680    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24b69f9f-5f94-4849-bbbc-932ad1197272-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.072535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.072511    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8zf\" (UniqueName: \"kubernetes.io/projected/24b69f9f-5f94-4849-bbbc-932ad1197272-kube-api-access-hd8zf\") pod \"monitoring-plugin-5d85778b9d-4thj7\" (UID: \"24b69f9f-5f94-4849-bbbc-932ad1197272\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.170319 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.170302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:10.401220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.401189    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f" exitCode=0
Sep 12 00:34:10.401588 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.401250    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"}
Sep 12 00:34:10.402400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.402385    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:34:10.435484 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:10.435431    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"]
Sep 12 00:34:10.437931 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:10.437913    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b69f9f_5f94_4849_bbbc_932ad1197272.slice/crio-f6ae53f85748a910b9b1425e6c78bcb628fd5aa774143839c4bbfe29148ed3ca WatchSource:0}: Error finding container f6ae53f85748a910b9b1425e6c78bcb628fd5aa774143839c4bbfe29148ed3ca: Status 404 returned error can't find the container with id f6ae53f85748a910b9b1425e6c78bcb628fd5aa774143839c4bbfe29148ed3ca
Sep 12 00:34:11.306622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:11.306598    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:34:11.409470 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:11.409430    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7" event={"ID":"24b69f9f-5f94-4849-bbbc-932ad1197272","Type":"ContainerStarted","Data":"f6ae53f85748a910b9b1425e6c78bcb628fd5aa774143839c4bbfe29148ed3ca"}
Sep 12 00:34:12.415059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.415027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7" event={"ID":"24b69f9f-5f94-4849-bbbc-932ad1197272","Type":"ContainerStarted","Data":"caeec368cd9893613f5c5abcb4b92f01fe70975e6b5df798c6555a90730a2dce"}
Sep 12 00:34:12.415410 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.415226    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:12.418641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.418619    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"}
Sep 12 00:34:12.418772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.418670    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"}
Sep 12 00:34:12.418772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.418694    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"}
Sep 12 00:34:12.418772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.418724    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"}
Sep 12 00:34:12.418772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.418745    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"}
Sep 12 00:34:12.420186 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.420166    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7"
Sep 12 00:34:12.429442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:12.429405    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4thj7" podStartSLOduration=2.22445252 podStartE2EDuration="3.429392712s" totalImagesPullingTime="1.204940192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:12.428353841 +0000 UTC m=+305.478939449" watchObservedRunningTime="2026-09-12 00:34:12.429392712 +0000 UTC m=+305.479978364"
Sep 12 00:34:13.425735 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:13.425705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerStarted","Data":"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"}
Sep 12 00:34:13.449275 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:13.449236    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.782343188 podStartE2EDuration="7.449223678s" totalImagesPullingTime="3.652268304s" totalInitContainerRuntime="14.612186ms" isStatefulPod=false podCreationTimestamp="2026-09-12 00:34:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:13.446983286 +0000 UTC m=+306.497568892" watchObservedRunningTime="2026-09-12 00:34:13.449223678 +0000 UTC m=+306.499809286"
Sep 12 00:34:16.220631 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.220592    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:34:16.223085 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.223060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.225726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.225696    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 12 00:34:16.226147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.226086    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 12 00:34:16.226939 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.226920    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 12 00:34:16.227317 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.227299    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 12 00:34:16.227442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.227369    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 12 00:34:16.227442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.227426    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 12 00:34:16.227557 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.227443    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wfdtk\""
Sep 12 00:34:16.227557 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.227369    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 12 00:34:16.232164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.232144    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 12 00:34:16.235386 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.235366    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:34:16.319969 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.319943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320066 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.319971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320066 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.319994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.320072    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.320104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320199 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.320141    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.320199 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.320157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtxlh\" (UniqueName: \"kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421087 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421087 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtxlh\" (UniqueName: \"kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421398 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421229    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.421994 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.421910    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.422048 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.422027    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.422048 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.422041    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.423427 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.423411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.423532 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.423516    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.428369 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.428351    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtxlh\" (UniqueName: \"kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh\") pod \"console-54875d4c6d-4c5zl\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") " pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.447695 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.447670    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:34:16.534072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.534018    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:16.801485 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:16.801412    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:34:16.804375 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:34:16.804343    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd888b8_63c4_47a1_912e_ab3f267d3bb9.slice/crio-9e5582269493fffbd1b52a3ba755e444343697c3cad69d503dd99c472f146bba WatchSource:0}: Error finding container 9e5582269493fffbd1b52a3ba755e444343697c3cad69d503dd99c472f146bba: Status 404 returned error can't find the container with id 9e5582269493fffbd1b52a3ba755e444343697c3cad69d503dd99c472f146bba
Sep 12 00:34:17.444324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:17.444293    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54875d4c6d-4c5zl" event={"ID":"1bd888b8-63c4-47a1-912e-ab3f267d3bb9","Type":"ContainerStarted","Data":"9e5582269493fffbd1b52a3ba755e444343697c3cad69d503dd99c472f146bba"}
Sep 12 00:34:19.454061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:19.454020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54875d4c6d-4c5zl" event={"ID":"1bd888b8-63c4-47a1-912e-ab3f267d3bb9","Type":"ContainerStarted","Data":"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"}
Sep 12 00:34:19.470900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:19.470850    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54875d4c6d-4c5zl" podStartSLOduration=0.962476369 podStartE2EDuration="3.470834515s" totalImagesPullingTime="2.508358146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:34:19.470650676 +0000 UTC m=+312.521236284" watchObservedRunningTime="2026-09-12 00:34:19.470834515 +0000 UTC m=+312.521420124"
Sep 12 00:34:20.304378 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:20.304348    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:34:26.534690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:26.534647    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:26.535109 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:26.534723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:26.539465 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:26.539448    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:27.486118 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:27.486091    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:34:45.323459 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.323420    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerName="registry" containerID="cri-o://301cb14b2538094436903ef258860a202b018eadba07314b0f6146b5dec279e5" gracePeriod=30
Sep 12 00:34:45.552404 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.552378    2556 generic.go:356] "Generic (PLEG): container finished" podID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerID="301cb14b2538094436903ef258860a202b018eadba07314b0f6146b5dec279e5" exitCode=0
Sep 12 00:34:45.552517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.552451    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" event={"ID":"d28072f5-9734-4ebd-ad99-3b9e171a55c2","Type":"ContainerDied","Data":"301cb14b2538094436903ef258860a202b018eadba07314b0f6146b5dec279e5"}
Sep 12 00:34:45.552517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.552491    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2" event={"ID":"d28072f5-9734-4ebd-ad99-3b9e171a55c2","Type":"ContainerDied","Data":"cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959"}
Sep 12 00:34:45.552517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.552503    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf2185871b0b1caf1884ec9e48bdce0506cef6425732c177dc44d6e8c8ae0959"
Sep 12 00:34:45.562675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.562657    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:34:45.660489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660459    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660503    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660525    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660549    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f5nx\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660604    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660661    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660691    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.660871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.660719    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token\") pod \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\" (UID: \"d28072f5-9734-4ebd-ad99-3b9e171a55c2\") "
Sep 12 00:34:45.661044 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.661019    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:34:45.661346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.661295    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:34:45.663189 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.663139    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:34:45.663281 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.663237    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:34:45.663341 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.663317    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:34:45.663395 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.663363    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:34:45.663457 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.663441    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx" (OuterVolumeSpecName: "kube-api-access-5f5nx") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "kube-api-access-5f5nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:34:45.668594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.668571    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d28072f5-9734-4ebd-ad99-3b9e171a55c2" (UID: "d28072f5-9734-4ebd-ad99-3b9e171a55c2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:34:45.762076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762050    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d28072f5-9734-4ebd-ad99-3b9e171a55c2-ca-trust-extracted\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762072    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762083    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f5nx\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-kube-api-access-5f5nx\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762092    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-installation-pull-secrets\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762101    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d28072f5-9734-4ebd-ad99-3b9e171a55c2-image-registry-private-configuration\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762109    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-registry-certificates\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762117    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d28072f5-9734-4ebd-ad99-3b9e171a55c2-bound-sa-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:45.762264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:45.762125    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d28072f5-9734-4ebd-ad99-3b9e171a55c2-trusted-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:34:46.560362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:46.560332    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845f7c77c9-mt9w2"
Sep 12 00:34:46.579861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:46.579834    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:34:46.583153 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:46.583131    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-845f7c77c9-mt9w2"]
Sep 12 00:34:47.452404 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:47.452370    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" path="/var/lib/kubelet/pods/d28072f5-9734-4ebd-ad99-3b9e171a55c2/volumes"
Sep 12 00:34:57.600986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:57.600908    2556 generic.go:356] "Generic (PLEG): container finished" podID="54d620f0-ebb1-4b2a-8548-410971d1bcad" containerID="5fab60c78f00993c8ce88e82cdf189827fe935f63fc42f1ea32b154c01d7f33b" exitCode=0
Sep 12 00:34:57.601313 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:57.600979    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5" event={"ID":"54d620f0-ebb1-4b2a-8548-410971d1bcad","Type":"ContainerDied","Data":"5fab60c78f00993c8ce88e82cdf189827fe935f63fc42f1ea32b154c01d7f33b"}
Sep 12 00:34:57.601313 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:57.601286    2556 scope.go:117] "RemoveContainer" containerID="5fab60c78f00993c8ce88e82cdf189827fe935f63fc42f1ea32b154c01d7f33b"
Sep 12 00:34:58.606299 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:34:58.606263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jgns5" event={"ID":"54d620f0-ebb1-4b2a-8548-410971d1bcad","Type":"ContainerStarted","Data":"621d9ae7105777e1b02c0177d9320a2327f0a44dbddcb410d5b8a83f4862bfa5"}
Sep 12 00:35:20.338907 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.338820    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:35:20.341065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.341032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf28e6c-de87-48c8-9fd8-77a6cb2a8782-metrics-certs\") pod \"network-metrics-daemon-wgkv5\" (UID: \"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782\") " pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:35:20.351687 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.351666    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bjlg\""
Sep 12 00:35:20.359635 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.359618    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgkv5"
Sep 12 00:35:20.627370 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.627347    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgkv5"]
Sep 12 00:35:20.629434 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:35:20.629406    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf28e6c_de87_48c8_9fd8_77a6cb2a8782.slice/crio-c72beea8035530a0c1b85a409935a30ce3307b4e973e68169bb15738a04d82b8 WatchSource:0}: Error finding container c72beea8035530a0c1b85a409935a30ce3307b4e973e68169bb15738a04d82b8: Status 404 returned error can't find the container with id c72beea8035530a0c1b85a409935a30ce3307b4e973e68169bb15738a04d82b8
Sep 12 00:35:20.696257 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:20.696224    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgkv5" event={"ID":"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782","Type":"ContainerStarted","Data":"c72beea8035530a0c1b85a409935a30ce3307b4e973e68169bb15738a04d82b8"}
Sep 12 00:35:21.703397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:21.703362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgkv5" event={"ID":"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782","Type":"ContainerStarted","Data":"d18c7f2743b9df7971631bb65f627fa76fe51cf381a9bc0608858567b02e5092"}
Sep 12 00:35:22.708353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:22.708317    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgkv5" event={"ID":"5bf28e6c-de87-48c8-9fd8-77a6cb2a8782","Type":"ContainerStarted","Data":"df6864abbe26fc18bbe17614550649b8f61cb13b4b17504d40e199347b78238e"}
Sep 12 00:35:22.722935 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:22.722887    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wgkv5" podStartSLOduration=373.762485092 podStartE2EDuration="6m14.722873363s" totalImagesPullingTime="960.388271ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:35:22.721629946 +0000 UTC m=+375.772215553" watchObservedRunningTime="2026-09-12 00:35:22.722873363 +0000 UTC m=+375.773458970"
Sep 12 00:35:25.291899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.291863    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:25.292304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292177    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="alertmanager" containerID="cri-o://bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0" gracePeriod=120
Sep 12 00:35:25.292304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292258    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-metric" containerID="cri-o://85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2" gracePeriod=120
Sep 12 00:35:25.292304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292271    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-web" containerID="cri-o://f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301" gracePeriod=120
Sep 12 00:35:25.292461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292311    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="config-reloader" containerID="cri-o://93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed" gracePeriod=120
Sep 12 00:35:25.292461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292308    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy" containerID="cri-o://b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839" gracePeriod=120
Sep 12 00:35:25.292461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.292334    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="prom-label-proxy" containerID="cri-o://c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9" gracePeriod=120
Sep 12 00:35:25.726315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726287    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9" exitCode=0
Sep 12 00:35:25.726315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726308    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839" exitCode=0
Sep 12 00:35:25.726315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726314    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed" exitCode=0
Sep 12 00:35:25.726315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726320    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0" exitCode=0
Sep 12 00:35:25.726545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726360    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"}
Sep 12 00:35:25.726545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"}
Sep 12 00:35:25.726545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726448    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"}
Sep 12 00:35:25.726545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:25.726470    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"}
Sep 12 00:35:26.531705 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.531683    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.685962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.685933    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.685981    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686006    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686029    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686079    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686113    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686135    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686172    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686207    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686238    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686260    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686299    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8dr6\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686312    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:35:26.686381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686333    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out\") pod \"763139ee-3eb4-4259-8999-f9ccbcbac56a\" (UID: \"763139ee-3eb4-4259-8999-f9ccbcbac56a\") "
Sep 12 00:35:26.686737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686548    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-metrics-client-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.686737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.686658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:35:26.689145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.688886    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume" (OuterVolumeSpecName: "config-volume") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.689268 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689162    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.689268 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689177    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.689268 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689223    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:35:26.689426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689352    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out" (OuterVolumeSpecName: "config-out") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:35:26.689426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689413    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.689535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.689514    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:35:26.690932 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.690911    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6" (OuterVolumeSpecName: "kube-api-access-d8dr6") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "kube-api-access-d8dr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:35:26.691220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.691199    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.693158 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.693135    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.699699 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.699678    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config" (OuterVolumeSpecName: "web-config") pod "763139ee-3eb4-4259-8999-f9ccbcbac56a" (UID: "763139ee-3eb4-4259-8999-f9ccbcbac56a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:35:26.733004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.732983    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2" exitCode=0
Sep 12 00:35:26.733004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733002    2556 generic.go:356] "Generic (PLEG): container finished" podID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerID="f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301" exitCode=0
Sep 12 00:35:26.733112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733074    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.733162 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733067    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"}
Sep 12 00:35:26.733220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733207    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"}
Sep 12 00:35:26.733249 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733239    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"763139ee-3eb4-4259-8999-f9ccbcbac56a","Type":"ContainerDied","Data":"0df08db25bffae61cc3a9de91d2e1c6f06b2f57bd7f8fa4839ead5ce639a9266"}
Sep 12 00:35:26.733282 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.733278    2556 scope.go:117] "RemoveContainer" containerID="c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"
Sep 12 00:35:26.741826 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.741808    2556 scope.go:117] "RemoveContainer" containerID="85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"
Sep 12 00:35:26.748536 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.748521    2556 scope.go:117] "RemoveContainer" containerID="b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"
Sep 12 00:35:26.755181 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.755157    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:26.755570 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.755558    2556 scope.go:117] "RemoveContainer" containerID="f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"
Sep 12 00:35:26.759600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.759575    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:26.762215 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.762200    2556 scope.go:117] "RemoveContainer" containerID="93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"
Sep 12 00:35:26.768690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.768672    2556 scope.go:117] "RemoveContainer" containerID="bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"
Sep 12 00:35:26.775454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.775437    2556 scope.go:117] "RemoveContainer" containerID="5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"
Sep 12 00:35:26.782101 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.782085    2556 scope.go:117] "RemoveContainer" containerID="c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"
Sep 12 00:35:26.782451 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.782427    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9\": container with ID starting with c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9 not found: ID does not exist" containerID="c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"
Sep 12 00:35:26.782534 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.782461    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"} err="failed to get container status \"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9\": rpc error: code = NotFound desc = could not find container \"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9\": container with ID starting with c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9 not found: ID does not exist"
Sep 12 00:35:26.782534 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.782503    2556 scope.go:117] "RemoveContainer" containerID="85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"
Sep 12 00:35:26.782820 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.782803    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2\": container with ID starting with 85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2 not found: ID does not exist" containerID="85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"
Sep 12 00:35:26.782894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.782828    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"} err="failed to get container status \"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2\": rpc error: code = NotFound desc = could not find container \"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2\": container with ID starting with 85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2 not found: ID does not exist"
Sep 12 00:35:26.782894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.782850    2556 scope.go:117] "RemoveContainer" containerID="b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"
Sep 12 00:35:26.783110 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.783089    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839\": container with ID starting with b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839 not found: ID does not exist" containerID="b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"
Sep 12 00:35:26.783148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783115    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"} err="failed to get container status \"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839\": rpc error: code = NotFound desc = could not find container \"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839\": container with ID starting with b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839 not found: ID does not exist"
Sep 12 00:35:26.783148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783129    2556 scope.go:117] "RemoveContainer" containerID="f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"
Sep 12 00:35:26.783382 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.783365    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301\": container with ID starting with f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301 not found: ID does not exist" containerID="f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"
Sep 12 00:35:26.783436 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783391    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"} err="failed to get container status \"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301\": rpc error: code = NotFound desc = could not find container \"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301\": container with ID starting with f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301 not found: ID does not exist"
Sep 12 00:35:26.783436 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783411    2556 scope.go:117] "RemoveContainer" containerID="93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"
Sep 12 00:35:26.783524 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783487    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:26.783642 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.783627    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed\": container with ID starting with 93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed not found: ID does not exist" containerID="93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"
Sep 12 00:35:26.783703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783647    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"} err="failed to get container status \"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed\": rpc error: code = NotFound desc = could not find container \"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed\": container with ID starting with 93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed not found: ID does not exist"
Sep 12 00:35:26.783703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783665    2556 scope.go:117] "RemoveContainer" containerID="bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"
Sep 12 00:35:26.783921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783905    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="config-reloader"
Sep 12 00:35:26.783958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783928    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="config-reloader"
Sep 12 00:35:26.783958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783938    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerName="registry"
Sep 12 00:35:26.783958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783943    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerName="registry"
Sep 12 00:35:26.783958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783951    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy"
Sep 12 00:35:26.783958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783956    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783962    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-metric"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783968    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-metric"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783975    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-web"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783981    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-web"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.783907    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0\": container with ID starting with bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0 not found: ID does not exist" containerID="bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783993    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="prom-label-proxy"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.783998    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="prom-label-proxy"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784004    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="alertmanager"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784010    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="alertmanager"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784023    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="init-config-reloader"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784028    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="init-config-reloader"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784074    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="alertmanager"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784002    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"} err="failed to get container status \"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0\": rpc error: code = NotFound desc = could not find container \"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0\": container with ID starting with bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0 not found: ID does not exist"
Sep 12 00:35:26.784097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784090    2556 scope.go:117] "RemoveContainer" containerID="5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784081    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-metric"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784144    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784153    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="prom-label-proxy"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784159    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="kube-rbac-proxy-web"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784166    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28072f5-9734-4ebd-ad99-3b9e171a55c2" containerName="registry"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784176    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" containerName="config-reloader"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:35:26.784312    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f\": container with ID starting with 5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f not found: ID does not exist" containerID="5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784329    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"} err="failed to get container status \"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f\": rpc error: code = NotFound desc = could not find container \"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f\": container with ID starting with 5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f not found: ID does not exist"
Sep 12 00:35:26.784579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784343    2556 scope.go:117] "RemoveContainer" containerID="c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"
Sep 12 00:35:26.784906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784583    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9"} err="failed to get container status \"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9\": rpc error: code = NotFound desc = could not find container \"c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9\": container with ID starting with c4e83c780c09f94174d81e78aef5968bdb049f68b9e6586598e4d0b902e6abf9 not found: ID does not exist"
Sep 12 00:35:26.784906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784597    2556 scope.go:117] "RemoveContainer" containerID="85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"
Sep 12 00:35:26.784906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784869    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2"} err="failed to get container status \"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2\": rpc error: code = NotFound desc = could not find container \"85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2\": container with ID starting with 85a007eae6b3f1d7e74a6115548a0d014eb8bd5aacab9fe85868fedda3b12ec2 not found: ID does not exist"
Sep 12 00:35:26.784906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.784884    2556 scope.go:117] "RemoveContainer" containerID="b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"
Sep 12 00:35:26.785113 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785094    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839"} err="failed to get container status \"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839\": rpc error: code = NotFound desc = could not find container \"b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839\": container with ID starting with b81362e4c140f7eec2842a43814754f618983a1ff1a400cdb6cae85fbd631839 not found: ID does not exist"
Sep 12 00:35:26.785159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785114    2556 scope.go:117] "RemoveContainer" containerID="f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"
Sep 12 00:35:26.785348 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785329    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301"} err="failed to get container status \"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301\": rpc error: code = NotFound desc = could not find container \"f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301\": container with ID starting with f7be5897132d8a3e4e1c88c12edd1a5bae758ee232edcd361b92fb31472c5301 not found: ID does not exist"
Sep 12 00:35:26.785413 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785350    2556 scope.go:117] "RemoveContainer" containerID="93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"
Sep 12 00:35:26.785563 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785547    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed"} err="failed to get container status \"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed\": rpc error: code = NotFound desc = could not find container \"93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed\": container with ID starting with 93a3af014bac7c8fd3100080e53ec7650393c46dd64a353dc944a763cd39b6ed not found: ID does not exist"
Sep 12 00:35:26.785628 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785564    2556 scope.go:117] "RemoveContainer" containerID="bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"
Sep 12 00:35:26.785806 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785790    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0"} err="failed to get container status \"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0\": rpc error: code = NotFound desc = could not find container \"bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0\": container with ID starting with bac29cca82c9d5320f342e98207b4fe01ddc7f82c867a69b9339fba6b22bddd0 not found: ID does not exist"
Sep 12 00:35:26.785876 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.785808    2556 scope.go:117] "RemoveContainer" containerID="5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"
Sep 12 00:35:26.786020 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.786004    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f"} err="failed to get container status \"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f\": rpc error: code = NotFound desc = could not find container \"5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f\": container with ID starting with 5e03f3c7bef9440137f7bcee4befae3f502eed3d00a2748e4ab69293664cef4f not found: ID does not exist"
Sep 12 00:35:26.787335 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787313    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787339    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-main-db\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787350    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-tls-assets\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787359    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-cluster-tls-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787367    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787377    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/763139ee-3eb4-4259-8999-f9ccbcbac56a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787385    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787393    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8dr6\" (UniqueName: \"kubernetes.io/projected/763139ee-3eb4-4259-8999-f9ccbcbac56a-kube-api-access-d8dr6\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787401    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-out\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787429    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-web-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787437    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.787527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.787445    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/763139ee-3eb4-4259-8999-f9ccbcbac56a-config-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:35:26.789523 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.789508    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.792054 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792034    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 12 00:35:26.792130 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792053    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 12 00:35:26.792352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792339    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 12 00:35:26.792407 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792359    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 12 00:35:26.792600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792584    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 12 00:35:26.792647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792600    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 12 00:35:26.792647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792584    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 12 00:35:26.792831 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792817    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kpqs2\""
Sep 12 00:35:26.792899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.792852    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 12 00:35:26.796822 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.796805    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 12 00:35:26.802594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.802575    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:26.887961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.887923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.887961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.887968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.887987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-out\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-web-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx67b\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-kube-api-access-bx67b\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.888521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.888372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989283 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989283 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989283 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989390    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-out\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989435    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-web-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx67b\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-kube-api-access-bx67b\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989485    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989687    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989724    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.989959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.989815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.990145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.990072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.990686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.990528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.990686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.990649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992506 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-web-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992619 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992687 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-out\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992687 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992666    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992815 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992745    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.992990 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.992963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.993340 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.993312    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.994063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.994048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:26.997288 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:26.997267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx67b\" (UniqueName: \"kubernetes.io/projected/7dbfea1e-e944-4f8f-ac64-0eb1f0867866-kube-api-access-bx67b\") pod \"alertmanager-main-0\" (UID: \"7dbfea1e-e944-4f8f-ac64-0eb1f0867866\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:27.097951 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.097920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:35:27.375609 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.375587    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:35:27.378154 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:35:27.378121    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbfea1e_e944_4f8f_ac64_0eb1f0867866.slice/crio-faa0fc45a7376b5e4f4050b61d97090990f0347c69c2c717adb7ec81724d76f0 WatchSource:0}: Error finding container faa0fc45a7376b5e4f4050b61d97090990f0347c69c2c717adb7ec81724d76f0: Status 404 returned error can't find the container with id faa0fc45a7376b5e4f4050b61d97090990f0347c69c2c717adb7ec81724d76f0
Sep 12 00:35:27.452892 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.452869    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763139ee-3eb4-4259-8999-f9ccbcbac56a" path="/var/lib/kubelet/pods/763139ee-3eb4-4259-8999-f9ccbcbac56a/volumes"
Sep 12 00:35:27.737909 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.737871    2556 generic.go:356] "Generic (PLEG): container finished" podID="7dbfea1e-e944-4f8f-ac64-0eb1f0867866" containerID="e18374ae2f8a65e534c860702d060ba5604131ec838d4c5cb7d5749820a46add" exitCode=0
Sep 12 00:35:27.738259 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.737955    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerDied","Data":"e18374ae2f8a65e534c860702d060ba5604131ec838d4c5cb7d5749820a46add"}
Sep 12 00:35:27.738259 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:27.738061    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"faa0fc45a7376b5e4f4050b61d97090990f0347c69c2c717adb7ec81724d76f0"}
Sep 12 00:35:28.746655 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746623    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"35a584d17f7bb7bb6eb3fc2db2110dc04c62eadc8dfabaeaf4bdcb02908c514c"}
Sep 12 00:35:28.747013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"0eed3d4e61fbb06f4c511b929aee0b998eb86599e4573380ce436454a28843a4"}
Sep 12 00:35:28.747013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"f26f5a0d8f0bf23d0ec434dce1f4ac9bcbb13dbef9709c021b557728a05698e1"}
Sep 12 00:35:28.747013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"30f9ad32c069ca7187eab3b5fc7774f7f33656bf27b1f5ee5cb023ab4f03e0ec"}
Sep 12 00:35:28.747013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"ad1afbe81b72a8a12ffdf663b6d3f5e5c66855223369b34b13a085ccda59a105"}
Sep 12 00:35:28.747013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.746816    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dbfea1e-e944-4f8f-ac64-0eb1f0867866","Type":"ContainerStarted","Data":"4d8709ddcfdbaaf2f5b49735669baadcb99b99a2efc239909704724d6ed40d42"}
Sep 12 00:35:28.774334 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:28.774289    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.759686812 podStartE2EDuration="2.774274304s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.587492ms" isStatefulPod=false podCreationTimestamp="2026-09-12 00:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:35:28.773266653 +0000 UTC m=+381.823852261" watchObservedRunningTime="2026-09-12 00:35:28.774274304 +0000 UTC m=+381.824859925"
Sep 12 00:35:29.314051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.314016    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"]
Sep 12 00:35:29.317546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.317524    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.320528 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.320505    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 12 00:35:29.320953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.320938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 12 00:35:29.321165 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.321148    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 12 00:35:29.321436 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.321420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lsvxv\""
Sep 12 00:35:29.321514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.321450    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 12 00:35:29.321668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.321652    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 12 00:35:29.328303 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.328284    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 12 00:35:29.335524 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.335504    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"]
Sep 12 00:35:29.409329 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-serving-certs-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409329 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409333    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwkhv\" (UniqueName: \"kubernetes.io/projected/af26812a-4a14-4df0-a0bc-80a50368bdd3-kube-api-access-kwkhv\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-federate-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409505    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-metrics-client-ca\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.409573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.409569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.510901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.510871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-serving-certs-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.510901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.510900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwkhv\" (UniqueName: \"kubernetes.io/projected/af26812a-4a14-4df0-a0bc-80a50368bdd3-kube-api-access-kwkhv\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511055 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.510921    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511055 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.510948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511055 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.510969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.511159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-federate-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511256 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.511198    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-metrics-client-ca\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511316 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.511297    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.511654 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.511629    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-serving-certs-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.512038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.512010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-metrics-client-ca\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.512297 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.512274    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.513659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.513632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-federate-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.513725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.513671    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.513954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.513936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-telemeter-client-tls\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.513989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.513935    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af26812a-4a14-4df0-a0bc-80a50368bdd3-secret-telemeter-client\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.518517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.518492    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwkhv\" (UniqueName: \"kubernetes.io/projected/af26812a-4a14-4df0-a0bc-80a50368bdd3-kube-api-access-kwkhv\") pod \"telemeter-client-6f766b69f7-s5xcx\" (UID: \"af26812a-4a14-4df0-a0bc-80a50368bdd3\") " pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.626992 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.626915    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"
Sep 12 00:35:29.897905 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:29.897804    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f766b69f7-s5xcx"]
Sep 12 00:35:29.900111 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:35:29.900088    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf26812a_4a14_4df0_a0bc_80a50368bdd3.slice/crio-3bb858158957b67f4a1c20ea68e5170d31dbc1e9ed9a8123367844c39f964131 WatchSource:0}: Error finding container 3bb858158957b67f4a1c20ea68e5170d31dbc1e9ed9a8123367844c39f964131: Status 404 returned error can't find the container with id 3bb858158957b67f4a1c20ea68e5170d31dbc1e9ed9a8123367844c39f964131
Sep 12 00:35:30.757458 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:30.757420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx" event={"ID":"af26812a-4a14-4df0-a0bc-80a50368bdd3","Type":"ContainerStarted","Data":"3bb858158957b67f4a1c20ea68e5170d31dbc1e9ed9a8123367844c39f964131"}
Sep 12 00:35:32.769093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.769062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx" event={"ID":"af26812a-4a14-4df0-a0bc-80a50368bdd3","Type":"ContainerStarted","Data":"fa1d6019828f8f7d38f6e2fb5307a3fb021b3f26b989840872804ff64aaaa3de"}
Sep 12 00:35:32.769415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.769142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx" event={"ID":"af26812a-4a14-4df0-a0bc-80a50368bdd3","Type":"ContainerStarted","Data":"1336c2f1b8c2cb91dfc77858b101e6ea6309dd69a06dfffef4afa0958a175d83"}
Sep 12 00:35:32.769415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.769168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx" event={"ID":"af26812a-4a14-4df0-a0bc-80a50368bdd3","Type":"ContainerStarted","Data":"fbee25e745d1aee8b8883b18c90a6d0c0c6cea45cd7a588011c23e3f7956a16f"}
Sep 12 00:35:32.793273 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.793215    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f766b69f7-s5xcx" podStartSLOduration=1.941274092 podStartE2EDuration="3.793195194s" totalImagesPullingTime="1.851921102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:35:32.790581396 +0000 UTC m=+385.841167003" watchObservedRunningTime="2026-09-12 00:35:32.793195194 +0000 UTC m=+385.843780801"
Sep 12 00:35:32.867826 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.867793    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:35:32.871265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.871242    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:32.881751 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:32.881728    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:35:33.041290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spdvn\" (UniqueName: \"kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.041462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.041444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142239    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spdvn\" (UniqueName: \"kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.142640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.142545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.143125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.143100    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.143240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.143099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.143240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.143105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.143323 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.143307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.144788 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.144749    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.144878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.144808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.149481 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.149464    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spdvn\" (UniqueName: \"kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn\") pod \"console-69f867689c-58mvx\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") " pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.180527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.180509    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:33.453219 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:35:33.453188    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba95c07_ca40_46c8_bbe7_7142ba802671.slice/crio-02ef1150c3177818ccd38772fd9f5cf0c4977e3fa307cd9ee211b4d08690ff53 WatchSource:0}: Error finding container 02ef1150c3177818ccd38772fd9f5cf0c4977e3fa307cd9ee211b4d08690ff53: Status 404 returned error can't find the container with id 02ef1150c3177818ccd38772fd9f5cf0c4977e3fa307cd9ee211b4d08690ff53
Sep 12 00:35:33.455265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.455234    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:35:33.775302 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.775217    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f867689c-58mvx" event={"ID":"7ba95c07-ca40-46c8-bbe7-7142ba802671","Type":"ContainerStarted","Data":"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"}
Sep 12 00:35:33.775302 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.775277    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f867689c-58mvx" event={"ID":"7ba95c07-ca40-46c8-bbe7-7142ba802671","Type":"ContainerStarted","Data":"02ef1150c3177818ccd38772fd9f5cf0c4977e3fa307cd9ee211b4d08690ff53"}
Sep 12 00:35:33.792789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:33.792728    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69f867689c-58mvx" podStartSLOduration=1.792712618 podStartE2EDuration="1.792712618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:35:33.791438411 +0000 UTC m=+386.842024017" watchObservedRunningTime="2026-09-12 00:35:33.792712618 +0000 UTC m=+386.843298224"
Sep 12 00:35:43.180995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:43.180948    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:43.181465 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:43.181025    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:43.185653 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:43.185625    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:43.823523 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:43.823493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:35:43.871852 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:35:43.871818    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:36:08.890915 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:08.890859    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54875d4c6d-4c5zl" podUID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" containerName="console" containerID="cri-o://8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6" gracePeriod=15
Sep 12 00:36:09.128597 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.128575    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:36:09.205478 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205450    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtxlh\" (UniqueName: \"kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205509    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205553    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205613    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205865 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205674    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.205865 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205740    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config\") pod \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\" (UID: \"1bd888b8-63c4-47a1-912e-ab3f267d3bb9\") "
Sep 12 00:36:09.206018 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205987    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:36:09.206100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.205999    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:36:09.206100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.206049    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config" (OuterVolumeSpecName: "console-config") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:36:09.206264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.206238    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:36:09.207685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.207665    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh" (OuterVolumeSpecName: "kube-api-access-dtxlh") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "kube-api-access-dtxlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:36:09.207813 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.207712    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:36:09.207813 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.207787    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bd888b8-63c4-47a1-912e-ab3f267d3bb9" (UID: "1bd888b8-63c4-47a1-912e-ab3f267d3bb9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:36:09.307106 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307075    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307106 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307102    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-oauth-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307115    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtxlh\" (UniqueName: \"kubernetes.io/projected/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-kube-api-access-dtxlh\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307127    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-trusted-ca-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307138    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-console-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307149    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.307272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.307159    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd888b8-63c4-47a1-912e-ab3f267d3bb9-oauth-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:36:09.929097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.929063    2556 generic.go:356] "Generic (PLEG): container finished" podID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" containerID="8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6" exitCode=0
Sep 12 00:36:09.929452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.929121    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54875d4c6d-4c5zl"
Sep 12 00:36:09.929452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.929140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54875d4c6d-4c5zl" event={"ID":"1bd888b8-63c4-47a1-912e-ab3f267d3bb9","Type":"ContainerDied","Data":"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"}
Sep 12 00:36:09.929452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.929178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54875d4c6d-4c5zl" event={"ID":"1bd888b8-63c4-47a1-912e-ab3f267d3bb9","Type":"ContainerDied","Data":"9e5582269493fffbd1b52a3ba755e444343697c3cad69d503dd99c472f146bba"}
Sep 12 00:36:09.929452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.929196    2556 scope.go:117] "RemoveContainer" containerID="8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"
Sep 12 00:36:09.937424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.937407    2556 scope.go:117] "RemoveContainer" containerID="8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"
Sep 12 00:36:09.937670 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:36:09.937651    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6\": container with ID starting with 8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6 not found: ID does not exist" containerID="8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"
Sep 12 00:36:09.937735 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.937680    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6"} err="failed to get container status \"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6\": rpc error: code = NotFound desc = could not find container \"8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6\": container with ID starting with 8a610dbae40a1546d8528c46485fb17ea2d839c5fb6b5f1fe836e9524c08d5a6 not found: ID does not exist"
Sep 12 00:36:09.945382 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.945358    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:36:09.946641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:09.946622    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54875d4c6d-4c5zl"]
Sep 12 00:36:11.453038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:11.453005    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" path="/var/lib/kubelet/pods/1bd888b8-63c4-47a1-912e-ab3f267d3bb9/volumes"
Sep 12 00:36:44.239236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.239202    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:36:44.239744 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.239679    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" containerName="console"
Sep 12 00:36:44.239744 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.239699    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" containerName="console"
Sep 12 00:36:44.239884 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.239794    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd888b8-63c4-47a1-912e-ab3f267d3bb9" containerName="console"
Sep 12 00:36:44.243064 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.243028    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.257937 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.257912    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:36:44.378352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2c7\" (UniqueName: \"kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.378668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.378517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479231 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2c7\" (UniqueName: \"kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479231 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.479397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.479378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.480103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.480067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.480103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.480089    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.480247 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.480105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.480247 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.480183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.482302 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.482280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.482361 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.482352    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.487670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.487645    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2c7\" (UniqueName: \"kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7\") pod \"console-7cfb6d9b55-wrv9t\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") " pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.551618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.551552    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:44.825149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:44.825124    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:36:44.827107 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:36:44.827078    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84941ab5_69de_4112_95ef_3a53e8ffb9dd.slice/crio-fc86ac66dd62abf5c5d9eef08efd6d05e7b61d8baba4f603e28e9c7bdf969eb5 WatchSource:0}: Error finding container fc86ac66dd62abf5c5d9eef08efd6d05e7b61d8baba4f603e28e9c7bdf969eb5: Status 404 returned error can't find the container with id fc86ac66dd62abf5c5d9eef08efd6d05e7b61d8baba4f603e28e9c7bdf969eb5
Sep 12 00:36:45.076101 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:45.076010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb6d9b55-wrv9t" event={"ID":"84941ab5-69de-4112-95ef-3a53e8ffb9dd","Type":"ContainerStarted","Data":"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"}
Sep 12 00:36:45.076101 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:45.076057    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb6d9b55-wrv9t" event={"ID":"84941ab5-69de-4112-95ef-3a53e8ffb9dd","Type":"ContainerStarted","Data":"fc86ac66dd62abf5c5d9eef08efd6d05e7b61d8baba4f603e28e9c7bdf969eb5"}
Sep 12 00:36:45.092019 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:45.091973    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cfb6d9b55-wrv9t" podStartSLOduration=1.091958815 podStartE2EDuration="1.091958815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:36:45.091571967 +0000 UTC m=+458.142157575" watchObservedRunningTime="2026-09-12 00:36:45.091958815 +0000 UTC m=+458.142544421"
Sep 12 00:36:54.552512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:54.552476    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:54.552899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:54.552542    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:54.557161 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:54.557137    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:55.122716 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:55.122685    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:36:55.166950 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:36:55.166922    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:37:20.186488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.186428    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69f867689c-58mvx" podUID="7ba95c07-ca40-46c8-bbe7-7142ba802671" containerName="console" containerID="cri-o://5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2" gracePeriod=15
Sep 12 00:37:20.423366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.423338    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:37:20.462290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462226    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462286    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462320    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spdvn\" (UniqueName: \"kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462363    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462408    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462434    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462654 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462504    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config\") pod \"7ba95c07-ca40-46c8-bbe7-7142ba802671\" (UID: \"7ba95c07-ca40-46c8-bbe7-7142ba802671\") "
Sep 12 00:37:20.462850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462798    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config" (OuterVolumeSpecName: "console-config") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:37:20.462850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462812    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:37:20.463001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462839    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:37:20.463001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.462870    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:37:20.464290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.464264    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:37:20.464380 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.464355    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn" (OuterVolumeSpecName: "kube-api-access-spdvn") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "kube-api-access-spdvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:37:20.464462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.464446    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ba95c07-ca40-46c8-bbe7-7142ba802671" (UID: "7ba95c07-ca40-46c8-bbe7-7142ba802671"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:37:20.563289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563267    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563288    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563298    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spdvn\" (UniqueName: \"kubernetes.io/projected/7ba95c07-ca40-46c8-bbe7-7142ba802671-kube-api-access-spdvn\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563306    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-oauth-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563314    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-trusted-ca-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563322    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba95c07-ca40-46c8-bbe7-7142ba802671-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:20.563442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:20.563330    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba95c07-ca40-46c8-bbe7-7142ba802671-console-oauth-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:21.230974 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.230936    2556 generic.go:356] "Generic (PLEG): container finished" podID="7ba95c07-ca40-46c8-bbe7-7142ba802671" containerID="5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2" exitCode=0
Sep 12 00:37:21.231423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.230986    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f867689c-58mvx"
Sep 12 00:37:21.231423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.231027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f867689c-58mvx" event={"ID":"7ba95c07-ca40-46c8-bbe7-7142ba802671","Type":"ContainerDied","Data":"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"}
Sep 12 00:37:21.231423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.231091    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f867689c-58mvx" event={"ID":"7ba95c07-ca40-46c8-bbe7-7142ba802671","Type":"ContainerDied","Data":"02ef1150c3177818ccd38772fd9f5cf0c4977e3fa307cd9ee211b4d08690ff53"}
Sep 12 00:37:21.231423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.231124    2556 scope.go:117] "RemoveContainer" containerID="5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"
Sep 12 00:37:21.239966 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.239951    2556 scope.go:117] "RemoveContainer" containerID="5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"
Sep 12 00:37:21.240213 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:37:21.240198    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2\": container with ID starting with 5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2 not found: ID does not exist" containerID="5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"
Sep 12 00:37:21.240249 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.240223    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2"} err="failed to get container status \"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2\": rpc error: code = NotFound desc = could not find container \"5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2\": container with ID starting with 5d331f32c928f2319ef3af82cf1fd22223d9635b67162357c3802c82a8ff3cf2 not found: ID does not exist"
Sep 12 00:37:21.251414 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.251391    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:37:21.255018 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.255001    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69f867689c-58mvx"]
Sep 12 00:37:21.452174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:21.452139    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba95c07-ca40-46c8-bbe7-7142ba802671" path="/var/lib/kubelet/pods/7ba95c07-ca40-46c8-bbe7-7142ba802671/volumes"
Sep 12 00:37:32.224461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.224431    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"]
Sep 12 00:37:32.224838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.224739    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba95c07-ca40-46c8-bbe7-7142ba802671" containerName="console"
Sep 12 00:37:32.224838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.224750    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba95c07-ca40-46c8-bbe7-7142ba802671" containerName="console"
Sep 12 00:37:32.224838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.224821    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba95c07-ca40-46c8-bbe7-7142ba802671" containerName="console"
Sep 12 00:37:32.227701 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.227678    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.230401 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.230381    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:37:32.230401 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.230394    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:37:32.230546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.230394    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh6mp\""
Sep 12 00:37:32.235838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.235819    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"]
Sep 12 00:37:32.348957 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.348927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.349094 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.348967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m2rq\" (UniqueName: \"kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.349094 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.349009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.449644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.449614    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.449828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.449653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m2rq\" (UniqueName: \"kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.449828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.449701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.449984 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.449965    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.450055 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.450034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.458182 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.458161    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m2rq\" (UniqueName: \"kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.537211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.537164    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:32.802061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:32.801969    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"]
Sep 12 00:37:32.804243 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:37:32.804208    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a29531_0376_4bcd_bbc8_a055ae4f7673.slice/crio-0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738 WatchSource:0}: Error finding container 0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738: Status 404 returned error can't find the container with id 0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738
Sep 12 00:37:33.279348 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:33.279317    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4" event={"ID":"f9a29531-0376-4bcd-bbc8-a055ae4f7673","Type":"ContainerStarted","Data":"0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738"}
Sep 12 00:37:39.311130 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:39.311043    2556 generic.go:356] "Generic (PLEG): container finished" podID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerID="2c11198d410ad532d397cff46e5453108102041435ebad81d0bb31311ee8a6e8" exitCode=0
Sep 12 00:37:39.311519 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:39.311125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4" event={"ID":"f9a29531-0376-4bcd-bbc8-a055ae4f7673","Type":"ContainerDied","Data":"2c11198d410ad532d397cff46e5453108102041435ebad81d0bb31311ee8a6e8"}
Sep 12 00:37:43.329789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:43.329740    2556 generic.go:356] "Generic (PLEG): container finished" podID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerID="48c90f8413df3da17df66a23b6c50729515fc3781201036f6a00be4cd7c4ddd6" exitCode=0
Sep 12 00:37:43.330178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:43.329805    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4" event={"ID":"f9a29531-0376-4bcd-bbc8-a055ae4f7673","Type":"ContainerDied","Data":"48c90f8413df3da17df66a23b6c50729515fc3781201036f6a00be4cd7c4ddd6"}
Sep 12 00:37:51.368837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:51.368750    2556 generic.go:356] "Generic (PLEG): container finished" podID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerID="a84f9bca4adda5409668fd339bb42a571acddc9c641cbd49ad70893775b3678b" exitCode=0
Sep 12 00:37:51.368837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:51.368785    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4" event={"ID":"f9a29531-0376-4bcd-bbc8-a055ae4f7673","Type":"ContainerDied","Data":"a84f9bca4adda5409668fd339bb42a571acddc9c641cbd49ad70893775b3678b"}
Sep 12 00:37:52.549919 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.549894    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:52.720521 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.720495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util\") pod \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") "
Sep 12 00:37:52.720674 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.720528    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle\") pod \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") "
Sep 12 00:37:52.720674 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.720568    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m2rq\" (UniqueName: \"kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq\") pod \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\" (UID: \"f9a29531-0376-4bcd-bbc8-a055ae4f7673\") "
Sep 12 00:37:52.721104 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.721080    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle" (OuterVolumeSpecName: "bundle") pod "f9a29531-0376-4bcd-bbc8-a055ae4f7673" (UID: "f9a29531-0376-4bcd-bbc8-a055ae4f7673"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:37:52.722551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.722518    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq" (OuterVolumeSpecName: "kube-api-access-4m2rq") pod "f9a29531-0376-4bcd-bbc8-a055ae4f7673" (UID: "f9a29531-0376-4bcd-bbc8-a055ae4f7673"). InnerVolumeSpecName "kube-api-access-4m2rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:37:52.725185 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.725165    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util" (OuterVolumeSpecName: "util") pod "f9a29531-0376-4bcd-bbc8-a055ae4f7673" (UID: "f9a29531-0376-4bcd-bbc8-a055ae4f7673"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:37:52.821782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.821744    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:52.821782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.821781    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a29531-0376-4bcd-bbc8-a055ae4f7673-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:52.821906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:52.821791    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m2rq\" (UniqueName: \"kubernetes.io/projected/f9a29531-0376-4bcd-bbc8-a055ae4f7673-kube-api-access-4m2rq\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:37:53.379122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:53.379094    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4"
Sep 12 00:37:53.379122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:53.379108    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540phkw4" event={"ID":"f9a29531-0376-4bcd-bbc8-a055ae4f7673","Type":"ContainerDied","Data":"0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738"}
Sep 12 00:37:53.379319 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:37:53.379154    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d3a7c4e3e0a7ef2b8458f2ad32ce6c1183920c76bb19cb06a6b073f30d50738"
Sep 12 00:38:00.198622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.198542    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"]
Sep 12 00:38:00.199013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.198995    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="extract"
Sep 12 00:38:00.199058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199014    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="extract"
Sep 12 00:38:00.199058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199024    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="util"
Sep 12 00:38:00.199058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199030    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="util"
Sep 12 00:38:00.199058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="pull"
Sep 12 00:38:00.199058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199045    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="pull"
Sep 12 00:38:00.199217 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.199097    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a29531-0376-4bcd-bbc8-a055ae4f7673" containerName="extract"
Sep 12 00:38:00.201192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.201177    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.203542 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.203515    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d4l5r\""
Sep 12 00:38:00.203654 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.203619    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 12 00:38:00.204121 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.204104    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:38:00.213712 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.213693    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"]
Sep 12 00:38:00.379540 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.379501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e0efba-de38-46c1-822c-278a3e39cb5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.379540 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.379544    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csntm\" (UniqueName: \"kubernetes.io/projected/92e0efba-de38-46c1-822c-278a3e39cb5f-kube-api-access-csntm\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.480453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.480376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e0efba-de38-46c1-822c-278a3e39cb5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.480453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.480411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csntm\" (UniqueName: \"kubernetes.io/projected/92e0efba-de38-46c1-822c-278a3e39cb5f-kube-api-access-csntm\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.480793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.480775    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e0efba-de38-46c1-822c-278a3e39cb5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.488906 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.488887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csntm\" (UniqueName: \"kubernetes.io/projected/92e0efba-de38-46c1-822c-278a3e39cb5f-kube-api-access-csntm\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpbfz\" (UID: \"92e0efba-de38-46c1-822c-278a3e39cb5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.509700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.509680    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"
Sep 12 00:38:00.780951 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:00.780926    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz"]
Sep 12 00:38:00.782663 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:00.782638    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e0efba_de38_46c1_822c_278a3e39cb5f.slice/crio-69b75ae7efeaaec7f0f5a4feac3d3e598bf2e439ebfd2f36fe3b06418fa5dd9f WatchSource:0}: Error finding container 69b75ae7efeaaec7f0f5a4feac3d3e598bf2e439ebfd2f36fe3b06418fa5dd9f: Status 404 returned error can't find the container with id 69b75ae7efeaaec7f0f5a4feac3d3e598bf2e439ebfd2f36fe3b06418fa5dd9f
Sep 12 00:38:01.419194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:01.419162    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz" event={"ID":"92e0efba-de38-46c1-822c-278a3e39cb5f","Type":"ContainerStarted","Data":"69b75ae7efeaaec7f0f5a4feac3d3e598bf2e439ebfd2f36fe3b06418fa5dd9f"}
Sep 12 00:38:03.430315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:03.430282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz" event={"ID":"92e0efba-de38-46c1-822c-278a3e39cb5f","Type":"ContainerStarted","Data":"d516894be0200719e51c80cf9f0d7c5cc917ce29a2ac63d6c52fc8ece3990769"}
Sep 12 00:38:03.452233 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:03.452178    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpbfz" podStartSLOduration=1.620379903 podStartE2EDuration="3.452157499s" totalImagesPullingTime="1.831777596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:38:03.450359466 +0000 UTC m=+536.500945088" watchObservedRunningTime="2026-09-12 00:38:03.452157499 +0000 UTC m=+536.502743107"
Sep 12 00:38:04.366780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.366736    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"]
Sep 12 00:38:04.369228 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.369211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.371743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.371725    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:38:04.372934 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.372913    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh6mp\""
Sep 12 00:38:04.373020 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.372913    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:38:04.377743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.377724    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"]
Sep 12 00:38:04.410286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.410260    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkm2f\" (UniqueName: \"kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.410379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.410288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.410379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.410305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.510982 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.510951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm2f\" (UniqueName: \"kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.510982 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.510987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.511443 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.511009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.511443 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.511380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.511511 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.511443    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.526480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.526459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkm2f\" (UniqueName: \"kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.678358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.678331    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:04.947597 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:04.947561    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"]
Sep 12 00:38:04.949457 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:04.949431    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cbd8e7e_6dcb_4042_aa1b_b548688d192a.slice/crio-8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3 WatchSource:0}: Error finding container 8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3: Status 404 returned error can't find the container with id 8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3
Sep 12 00:38:05.440796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:05.440739    2556 generic.go:356] "Generic (PLEG): container finished" podID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerID="a01bbc00e4c374b3639a63e67e54256f201b818f67a0276961fbf5c03dbeb628" exitCode=0
Sep 12 00:38:05.440962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:05.440832    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerDied","Data":"a01bbc00e4c374b3639a63e67e54256f201b818f67a0276961fbf5c03dbeb628"}
Sep 12 00:38:05.440962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:05.440884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerStarted","Data":"8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3"}
Sep 12 00:38:06.516088 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.516059    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"]
Sep 12 00:38:06.518777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.518735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.521330 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.521304    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 12 00:38:06.522820 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.522413    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 12 00:38:06.522820 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.522656    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tdzvw\""
Sep 12 00:38:06.525743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.525717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69pc\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-kube-api-access-l69pc\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.525853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.525832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.529497 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.529478    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"]
Sep 12 00:38:06.627183 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.627152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.627328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.627218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69pc\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-kube-api-access-l69pc\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.635478 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.635446    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.635696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.635679    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69pc\" (UniqueName: \"kubernetes.io/projected/0a5c251b-2fbb-498d-b2f0-fa0718c978f0-kube-api-access-l69pc\") pod \"cert-manager-cainjector-559cdd8c87-rfjp5\" (UID: \"0a5c251b-2fbb-498d-b2f0-fa0718c978f0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:06.837960 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:06.837870    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"
Sep 12 00:38:07.454711 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:07.454376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerStarted","Data":"b9ee05c577f885fc240dc3d2580e36c2b932542f77692e6d65ba86004ad97ca4"}
Sep 12 00:38:07.615236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:07.615214    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5"]
Sep 12 00:38:07.616795 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:07.616751    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a5c251b_2fbb_498d_b2f0_fa0718c978f0.slice/crio-8c1b90445fed0a5e7df872a82a47070f900db2c6d4e9adddb00ea9f5e0a2e184 WatchSource:0}: Error finding container 8c1b90445fed0a5e7df872a82a47070f900db2c6d4e9adddb00ea9f5e0a2e184: Status 404 returned error can't find the container with id 8c1b90445fed0a5e7df872a82a47070f900db2c6d4e9adddb00ea9f5e0a2e184
Sep 12 00:38:08.459320 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:08.459285    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5" event={"ID":"0a5c251b-2fbb-498d-b2f0-fa0718c978f0","Type":"ContainerStarted","Data":"8c1b90445fed0a5e7df872a82a47070f900db2c6d4e9adddb00ea9f5e0a2e184"}
Sep 12 00:38:08.461119 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:08.461096    2556 generic.go:356] "Generic (PLEG): container finished" podID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerID="b9ee05c577f885fc240dc3d2580e36c2b932542f77692e6d65ba86004ad97ca4" exitCode=0
Sep 12 00:38:08.461237 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:08.461179    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerDied","Data":"b9ee05c577f885fc240dc3d2580e36c2b932542f77692e6d65ba86004ad97ca4"}
Sep 12 00:38:09.468704 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:09.468667    2556 generic.go:356] "Generic (PLEG): container finished" podID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerID="13f91f240635a27dde9009ebf35f41fe92c629005ad77c3de18e6a1ddd3153c4" exitCode=0
Sep 12 00:38:09.469154 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:09.468776    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerDied","Data":"13f91f240635a27dde9009ebf35f41fe92c629005ad77c3de18e6a1ddd3153c4"}
Sep 12 00:38:10.602789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.602765    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:10.660503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.660476    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util\") pod \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") "
Sep 12 00:38:10.660691 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.660531    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle\") pod \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") "
Sep 12 00:38:10.660691 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.660600    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkm2f\" (UniqueName: \"kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f\") pod \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\" (UID: \"9cbd8e7e-6dcb-4042-aa1b-b548688d192a\") "
Sep 12 00:38:10.660907 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.660884    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle" (OuterVolumeSpecName: "bundle") pod "9cbd8e7e-6dcb-4042-aa1b-b548688d192a" (UID: "9cbd8e7e-6dcb-4042-aa1b-b548688d192a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:10.662625 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.662602    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f" (OuterVolumeSpecName: "kube-api-access-rkm2f") pod "9cbd8e7e-6dcb-4042-aa1b-b548688d192a" (UID: "9cbd8e7e-6dcb-4042-aa1b-b548688d192a"). InnerVolumeSpecName "kube-api-access-rkm2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:38:10.665711 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.665689    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util" (OuterVolumeSpecName: "util") pod "9cbd8e7e-6dcb-4042-aa1b-b548688d192a" (UID: "9cbd8e7e-6dcb-4042-aa1b-b548688d192a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:10.762079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.762005    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:10.762079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.762031    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:10.762079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:10.762041    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkm2f\" (UniqueName: \"kubernetes.io/projected/9cbd8e7e-6dcb-4042-aa1b-b548688d192a-kube-api-access-rkm2f\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:11.479403 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:11.479377    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk"
Sep 12 00:38:11.479540 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:11.479376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpglpk" event={"ID":"9cbd8e7e-6dcb-4042-aa1b-b548688d192a","Type":"ContainerDied","Data":"8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3"}
Sep 12 00:38:11.479540 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:11.479500    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8172c72c25d22313b8de0194601ec7da9bcacbf90715ba96f08f743952b801c3"
Sep 12 00:38:11.481013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:11.480984    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5" event={"ID":"0a5c251b-2fbb-498d-b2f0-fa0718c978f0","Type":"ContainerStarted","Data":"60338096ddc71b2fefc3d634d8244e2983e84d631b8615400018754345a3832f"}
Sep 12 00:38:11.498443 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:11.498397    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rfjp5" podStartSLOduration=2.696968283 podStartE2EDuration="5.498384918s" totalImagesPullingTime="2.801416635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:38:11.497024271 +0000 UTC m=+544.547609875" watchObservedRunningTime="2026-09-12 00:38:11.498384918 +0000 UTC m=+544.548970524"
Sep 12 00:38:12.112703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.112672    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gg99z"]
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113024    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="util"
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113036    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="util"
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113044    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="extract"
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113049    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="extract"
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113062    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="pull"
Sep 12 00:38:12.113083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113068    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="pull"
Sep 12 00:38:12.113251 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.113123    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cbd8e7e-6dcb-4042-aa1b-b548688d192a" containerName="extract"
Sep 12 00:38:12.116253 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.116234    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.120997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.120980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-794qv\""
Sep 12 00:38:12.128270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.128245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gg99z"]
Sep 12 00:38:12.175234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.175204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.175361 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.175261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dcv\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-kube-api-access-k8dcv\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.276185 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.276147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.276347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.276214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dcv\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-kube-api-access-k8dcv\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.283887 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.283858    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.284066 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.284046    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dcv\" (UniqueName: \"kubernetes.io/projected/741f7e44-964b-44ec-a9a0-e19bd216f82a-kube-api-access-k8dcv\") pod \"cert-manager-webhook-6486ffd997-gg99z\" (UID: \"741f7e44-964b-44ec-a9a0-e19bd216f82a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.425003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.424978    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:12.691157 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:12.691136    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gg99z"]
Sep 12 00:38:12.693344 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:12.693312    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod741f7e44_964b_44ec_a9a0_e19bd216f82a.slice/crio-a7c41900066b471d94ee2a17a484d8b9b3e8b43d774caa320184ff2a767a7d17 WatchSource:0}: Error finding container a7c41900066b471d94ee2a17a484d8b9b3e8b43d774caa320184ff2a767a7d17: Status 404 returned error can't find the container with id a7c41900066b471d94ee2a17a484d8b9b3e8b43d774caa320184ff2a767a7d17
Sep 12 00:38:13.492253 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:13.492216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z" event={"ID":"741f7e44-964b-44ec-a9a0-e19bd216f82a","Type":"ContainerStarted","Data":"e6a3c522dea4b2f67f61c7c3fa178ca0f3ede87b6428e8895bdfef4ad7d7ee63"}
Sep 12 00:38:13.492253 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:13.492255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z" event={"ID":"741f7e44-964b-44ec-a9a0-e19bd216f82a","Type":"ContainerStarted","Data":"a7c41900066b471d94ee2a17a484d8b9b3e8b43d774caa320184ff2a767a7d17"}
Sep 12 00:38:13.492636 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:13.492278    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:13.510701 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:13.510657    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z" podStartSLOduration=1.510642346 podStartE2EDuration="1.510642346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:38:13.510100767 +0000 UTC m=+546.560686374" watchObservedRunningTime="2026-09-12 00:38:13.510642346 +0000 UTC m=+546.561227953"
Sep 12 00:38:15.653578 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.653545    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grb5n"]
Sep 12 00:38:15.657496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.657476    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.661628 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.661610    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8t7d6\""
Sep 12 00:38:15.664740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.664720    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grb5n"]
Sep 12 00:38:15.704621 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.704600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.704717 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.704625    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dh84\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-kube-api-access-9dh84\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.805623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.805597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.805623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.805624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dh84\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-kube-api-access-9dh84\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.813214 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.813194    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-bound-sa-token\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.813306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.813266    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dh84\" (UniqueName: \"kubernetes.io/projected/d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe-kube-api-access-9dh84\") pod \"cert-manager-55b4d954d5-grb5n\" (UID: \"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe\") " pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:15.968456 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:15.968431    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grb5n"
Sep 12 00:38:16.237350 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:16.237326    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grb5n"]
Sep 12 00:38:16.239458 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:16.239430    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd259f797_d52a_4c21_a2eb_e6eb2ba9e6fe.slice/crio-84e9779358841ef71adf5f7595cf248892c24f0cabb2b787b1ed4457c1284424 WatchSource:0}: Error finding container 84e9779358841ef71adf5f7595cf248892c24f0cabb2b787b1ed4457c1284424: Status 404 returned error can't find the container with id 84e9779358841ef71adf5f7595cf248892c24f0cabb2b787b1ed4457c1284424
Sep 12 00:38:16.506383 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:16.506308    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grb5n" event={"ID":"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe","Type":"ContainerStarted","Data":"c87cedfcce664a26e568e29f198d03feb92af36f85d893cec4ffcba28f803078"}
Sep 12 00:38:16.506383 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:16.506346    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grb5n" event={"ID":"d259f797-d52a-4c21-a2eb-e6eb2ba9e6fe","Type":"ContainerStarted","Data":"84e9779358841ef71adf5f7595cf248892c24f0cabb2b787b1ed4457c1284424"}
Sep 12 00:38:16.522445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:16.522403    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-grb5n" podStartSLOduration=1.522390221 podStartE2EDuration="1.522390221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:38:16.520855801 +0000 UTC m=+549.571441409" watchObservedRunningTime="2026-09-12 00:38:16.522390221 +0000 UTC m=+549.572975827"
Sep 12 00:38:19.499335 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:19.499302    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gg99z"
Sep 12 00:38:29.887860 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.887827    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"]
Sep 12 00:38:29.892318 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.892299    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:29.895314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.895294    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:38:29.895407 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.895301    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh6mp\""
Sep 12 00:38:29.895407 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.895301    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:38:29.900496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:29.900476    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"]
Sep 12 00:38:30.018068 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.018031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4cq\" (UniqueName: \"kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.018231 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.018115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.018231 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.018154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.119371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.119340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.119520 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.119386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.119520 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.119410    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4cq\" (UniqueName: \"kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.119709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.119691    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.119801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.119782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.128523 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.128493    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4cq\" (UniqueName: \"kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.202155 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.202134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:30.475201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.475169    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"]
Sep 12 00:38:30.477357 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:30.477331    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1b27d2_1fc2_4c44_b363_c86d3c551c9b.slice/crio-92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969 WatchSource:0}: Error finding container 92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969: Status 404 returned error can't find the container with id 92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969
Sep 12 00:38:30.567583 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.567546    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerStarted","Data":"b09b461d7a4b321ca61398ac155ebb12a07792beddb0ff10bf1e7bfe1ffdc3d7"}
Sep 12 00:38:30.567769 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:30.567597    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerStarted","Data":"92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969"}
Sep 12 00:38:31.573841 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:31.573802    2556 generic.go:356] "Generic (PLEG): container finished" podID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerID="b09b461d7a4b321ca61398ac155ebb12a07792beddb0ff10bf1e7bfe1ffdc3d7" exitCode=0
Sep 12 00:38:31.574294 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:31.573857    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerDied","Data":"b09b461d7a4b321ca61398ac155ebb12a07792beddb0ff10bf1e7bfe1ffdc3d7"}
Sep 12 00:38:32.579744 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:32.579710    2556 generic.go:356] "Generic (PLEG): container finished" podID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerID="d2c597534368c0c91b852d1fa69245c80176dd30454df028fc983e251912516d" exitCode=0
Sep 12 00:38:32.580132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:32.579797    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerDied","Data":"d2c597534368c0c91b852d1fa69245c80176dd30454df028fc983e251912516d"}
Sep 12 00:38:33.586713 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:33.586679    2556 generic.go:356] "Generic (PLEG): container finished" podID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerID="b2bc596fbee5eeb3c1af097a202dbad36b37d87e5165d77671ba896f16d41a31" exitCode=0
Sep 12 00:38:33.587082 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:33.586779    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerDied","Data":"b2bc596fbee5eeb3c1af097a202dbad36b37d87e5165d77671ba896f16d41a31"}
Sep 12 00:38:34.722717 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.722696    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:34.857850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.857753    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp4cq\" (UniqueName: \"kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq\") pod \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") "
Sep 12 00:38:34.857997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.857866    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util\") pod \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") "
Sep 12 00:38:34.857997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.857912    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle\") pod \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\" (UID: \"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b\") "
Sep 12 00:38:34.858607 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.858577    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle" (OuterVolumeSpecName: "bundle") pod "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" (UID: "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:34.859874 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.859853    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq" (OuterVolumeSpecName: "kube-api-access-vp4cq") pod "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" (UID: "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b"). InnerVolumeSpecName "kube-api-access-vp4cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:38:34.863589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.863547    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util" (OuterVolumeSpecName: "util") pod "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" (UID: "5c1b27d2-1fc2-4c44-b363-c86d3c551c9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:34.959109 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.959077    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:34.959239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.959122    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp4cq\" (UniqueName: \"kubernetes.io/projected/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-kube-api-access-vp4cq\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:34.959239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:34.959132    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27d2-1fc2-4c44-b363-c86d3c551c9b-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:35.598970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:35.598940    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc" event={"ID":"5c1b27d2-1fc2-4c44-b363-c86d3c551c9b","Type":"ContainerDied","Data":"92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969"}
Sep 12 00:38:35.598970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:35.598966    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqc2qc"
Sep 12 00:38:35.599157 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:35.598989    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92fcd1d13578c29cb07607ee1f75b462234a50def53362adb20516466a502969"
Sep 12 00:38:39.773702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.773667    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"]
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774025    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="util"
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774038    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="util"
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774049    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="pull"
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774054    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="pull"
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774064    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="extract"
Sep 12 00:38:39.774072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774069    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="extract"
Sep 12 00:38:39.774251 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.774127    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1b27d2-1fc2-4c44-b363-c86d3c551c9b" containerName="extract"
Sep 12 00:38:39.776592 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.776576    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:39.780103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.780081    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh6mp\""
Sep 12 00:38:39.780420 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.780394    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:38:39.781124 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.781106    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:38:39.795512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.795491    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"]
Sep 12 00:38:39.902061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.902034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zq9\" (UniqueName: \"kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:39.902217 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.902072    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:39.902217 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:39.902093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.003313 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.003285    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zq9\" (UniqueName: \"kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.003423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.003323    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.003423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.003412    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.003647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.003632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.003732 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.003716    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.014508 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.014490    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zq9\" (UniqueName: \"kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.086202 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.086129    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:40.378740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.378716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"]
Sep 12 00:38:40.380461 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:40.380430    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e2acb4_e270_412d_a2c1_3bbaea9eefad.slice/crio-1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e WatchSource:0}: Error finding container 1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e: Status 404 returned error can't find the container with id 1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e
Sep 12 00:38:40.623479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.623447    2556 generic.go:356] "Generic (PLEG): container finished" podID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerID="ff685bc0e9c76d70d5683ca67072524c23cc0e6f72a0c2cef9515ce2e18a3a4e" exitCode=0
Sep 12 00:38:40.623647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.623529    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr" event={"ID":"75e2acb4-e270-412d-a2c1-3bbaea9eefad","Type":"ContainerDied","Data":"ff685bc0e9c76d70d5683ca67072524c23cc0e6f72a0c2cef9515ce2e18a3a4e"}
Sep 12 00:38:40.623647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:40.623580    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr" event={"ID":"75e2acb4-e270-412d-a2c1-3bbaea9eefad","Type":"ContainerStarted","Data":"1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e"}
Sep 12 00:38:41.630145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.630111    2556 generic.go:356] "Generic (PLEG): container finished" podID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerID="d7eef912269a6e89d2889bbf23ddb86bb39b6ae11ae66ccaa0ab27c4fcd45329" exitCode=0
Sep 12 00:38:41.630627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.630160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr" event={"ID":"75e2acb4-e270-412d-a2c1-3bbaea9eefad","Type":"ContainerDied","Data":"d7eef912269a6e89d2889bbf23ddb86bb39b6ae11ae66ccaa0ab27c4fcd45329"}
Sep 12 00:38:41.870313 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.870283    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"]
Sep 12 00:38:41.872633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.872618    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:41.881276 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.881230    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 12 00:38:41.881957 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.881941    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 12 00:38:41.882040 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.882018    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 12 00:38:41.882442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.882428    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 12 00:38:41.882983 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.882968    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g56gz\""
Sep 12 00:38:41.901535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:41.901516    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"]
Sep 12 00:38:42.021239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.021208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2mx8\" (UniqueName: \"kubernetes.io/projected/734fe9de-dd3a-49fe-8470-2af0d0e60371-kube-api-access-s2mx8\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.021239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.021251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-manifests\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.021494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.021290    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-tmp\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.021494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.021329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.021494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.021371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-webhook-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.122538 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.122506    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-tmp\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.122708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.122543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.122708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.122573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-webhook-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.122708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.122614    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2mx8\" (UniqueName: \"kubernetes.io/projected/734fe9de-dd3a-49fe-8470-2af0d0e60371-kube-api-access-s2mx8\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.122708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.122634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-manifests\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.123028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.123002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-manifests\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.124844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.124819    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/734fe9de-dd3a-49fe-8470-2af0d0e60371-tmp\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.125049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.125032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.125149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.125131    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734fe9de-dd3a-49fe-8470-2af0d0e60371-webhook-cert\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.135483 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.135434    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2mx8\" (UniqueName: \"kubernetes.io/projected/734fe9de-dd3a-49fe-8470-2af0d0e60371-kube-api-access-s2mx8\") pod \"opendatahub-operator-controller-manager-67b7744c54-knqn7\" (UID: \"734fe9de-dd3a-49fe-8470-2af0d0e60371\") " pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.182620 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.182587    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:42.457662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.457633    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"]
Sep 12 00:38:42.459500 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:38:42.459476    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fe9de_dd3a_49fe_8470_2af0d0e60371.slice/crio-60b109c24aff430e919072cc7c69681736ff4f738fc9a88d5cf95115c589e19e WatchSource:0}: Error finding container 60b109c24aff430e919072cc7c69681736ff4f738fc9a88d5cf95115c589e19e: Status 404 returned error can't find the container with id 60b109c24aff430e919072cc7c69681736ff4f738fc9a88d5cf95115c589e19e
Sep 12 00:38:42.645144 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.645105    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7" event={"ID":"734fe9de-dd3a-49fe-8470-2af0d0e60371","Type":"ContainerStarted","Data":"60b109c24aff430e919072cc7c69681736ff4f738fc9a88d5cf95115c589e19e"}
Sep 12 00:38:42.647389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.647363    2556 generic.go:356] "Generic (PLEG): container finished" podID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerID="82c940997ca8c9f6948755a01eefc1e3ea34dddfb59bf6504692dea481c62c53" exitCode=0
Sep 12 00:38:42.647523 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:42.647414    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr" event={"ID":"75e2acb4-e270-412d-a2c1-3bbaea9eefad","Type":"ContainerDied","Data":"82c940997ca8c9f6948755a01eefc1e3ea34dddfb59bf6504692dea481c62c53"}
Sep 12 00:38:43.819004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.818978    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:43.940774 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.940681    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle\") pod \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") "
Sep 12 00:38:43.940940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.940804    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8zq9\" (UniqueName: \"kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9\") pod \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") "
Sep 12 00:38:43.940940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.940865    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util\") pod \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\" (UID: \"75e2acb4-e270-412d-a2c1-3bbaea9eefad\") "
Sep 12 00:38:43.941703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.941658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle" (OuterVolumeSpecName: "bundle") pod "75e2acb4-e270-412d-a2c1-3bbaea9eefad" (UID: "75e2acb4-e270-412d-a2c1-3bbaea9eefad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:43.943390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.943351    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9" (OuterVolumeSpecName: "kube-api-access-k8zq9") pod "75e2acb4-e270-412d-a2c1-3bbaea9eefad" (UID: "75e2acb4-e270-412d-a2c1-3bbaea9eefad"). InnerVolumeSpecName "kube-api-access-k8zq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:38:43.949176 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:43.949130    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util" (OuterVolumeSpecName: "util") pod "75e2acb4-e270-412d-a2c1-3bbaea9eefad" (UID: "75e2acb4-e270-412d-a2c1-3bbaea9eefad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:38:44.042503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.042460    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8zq9\" (UniqueName: \"kubernetes.io/projected/75e2acb4-e270-412d-a2c1-3bbaea9eefad-kube-api-access-k8zq9\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:44.042503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.042489    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:44.042503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.042502    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e2acb4-e270-412d-a2c1-3bbaea9eefad-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:38:44.666609 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.666570    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr" event={"ID":"75e2acb4-e270-412d-a2c1-3bbaea9eefad","Type":"ContainerDied","Data":"1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e"}
Sep 12 00:38:44.666796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.666621    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08rtzr"
Sep 12 00:38:44.666796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:44.666630    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1207659a59de876dae4069be14b03879d49632f9719a7596a8d6c8c70c6f403e"
Sep 12 00:38:45.673189 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:45.673156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7" event={"ID":"734fe9de-dd3a-49fe-8470-2af0d0e60371","Type":"ContainerStarted","Data":"cb1ba675f4c7c658218f0a496209648c59d6249bc2068a83692c9da5df5fc7ac"}
Sep 12 00:38:46.679446 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:46.679409    2556 generic.go:356] "Generic (PLEG): container finished" podID="734fe9de-dd3a-49fe-8470-2af0d0e60371" containerID="cb1ba675f4c7c658218f0a496209648c59d6249bc2068a83692c9da5df5fc7ac" exitCode=0
Sep 12 00:38:46.679801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:46.679497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7" event={"ID":"734fe9de-dd3a-49fe-8470-2af0d0e60371","Type":"ContainerDied","Data":"cb1ba675f4c7c658218f0a496209648c59d6249bc2068a83692c9da5df5fc7ac"}
Sep 12 00:38:47.687255 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:47.687217    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7" event={"ID":"734fe9de-dd3a-49fe-8470-2af0d0e60371","Type":"ContainerStarted","Data":"2bc80712dccd889e77d2f2006b50dfa3d8af959a60a71cb70ad31ad347ecd643"}
Sep 12 00:38:47.687610 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:47.687374    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:38:47.709315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:47.709271    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7" podStartSLOduration=2.365513837 podStartE2EDuration="6.709255606s" totalImagesPullingTime="3.303603897s" totalInitContainerRuntime="1.040137872s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:38:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:38:47.707962953 +0000 UTC m=+580.758548585" watchObservedRunningTime="2026-09-12 00:38:47.709255606 +0000 UTC m=+580.759841213"
Sep 12 00:38:58.694637 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:38:58.694605    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67b7744c54-knqn7"
Sep 12 00:39:01.368119 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368083    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-797549bd89-twhcg"]
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368436    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="util"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368446    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="util"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368466    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="pull"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368474    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="pull"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368501    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="extract"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368511    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="extract"
Sep 12 00:39:01.368690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.368588    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e2acb4-e270-412d-a2c1-3bbaea9eefad" containerName="extract"
Sep 12 00:39:01.384125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.384101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.389320 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.389283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb0fa34-10a4-42d6-b521-43d731755f22-tmp\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.389454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.389326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxdn\" (UniqueName: \"kubernetes.io/projected/4eb0fa34-10a4-42d6-b521-43d731755f22-kube-api-access-pxxdn\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.389454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.389365    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb0fa34-10a4-42d6-b521-43d731755f22-tls-certs\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.395425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.395402    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 12 00:39:01.395573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.395451    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 12 00:39:01.395816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.395796    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 12 00:39:01.398922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.398902    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797549bd89-twhcg"]
Sep 12 00:39:01.403406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.403378    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 12 00:39:01.490227 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.490197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb0fa34-10a4-42d6-b521-43d731755f22-tmp\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.490362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.490232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxdn\" (UniqueName: \"kubernetes.io/projected/4eb0fa34-10a4-42d6-b521-43d731755f22-kube-api-access-pxxdn\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.490362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.490255    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb0fa34-10a4-42d6-b521-43d731755f22-tls-certs\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.492666 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.492642    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb0fa34-10a4-42d6-b521-43d731755f22-tls-certs\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.493030 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.493013    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eb0fa34-10a4-42d6-b521-43d731755f22-tmp\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.499833 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.499809    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxdn\" (UniqueName: \"kubernetes.io/projected/4eb0fa34-10a4-42d6-b521-43d731755f22-kube-api-access-pxxdn\") pod \"kube-auth-proxy-797549bd89-twhcg\" (UID: \"4eb0fa34-10a4-42d6-b521-43d731755f22\") " pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.695215 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.695183    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg"
Sep 12 00:39:01.967699 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:01.967673    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797549bd89-twhcg"]
Sep 12 00:39:01.968906 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:39:01.968879    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb0fa34_10a4_42d6_b521_43d731755f22.slice/crio-fbdd1ddd10c1042f823a91838b60518146075ef2512712ce450fbee42245c6ba WatchSource:0}: Error finding container fbdd1ddd10c1042f823a91838b60518146075ef2512712ce450fbee42245c6ba: Status 404 returned error can't find the container with id fbdd1ddd10c1042f823a91838b60518146075ef2512712ce450fbee42245c6ba
Sep 12 00:39:02.766652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:02.766612    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg" event={"ID":"4eb0fa34-10a4-42d6-b521-43d731755f22","Type":"ContainerStarted","Data":"fbdd1ddd10c1042f823a91838b60518146075ef2512712ce450fbee42245c6ba"}
Sep 12 00:39:03.012318 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.012280    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:03.015868 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.015842    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.018371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.018315    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 12 00:39:03.018505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.018482    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b9bvj\""
Sep 12 00:39:03.018596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.018577    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 12 00:39:03.018659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.018577    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 12 00:39:03.019029 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.019005    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 12 00:39:03.029103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.029078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:03.103304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.103527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.103482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7kz\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.203982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7kz\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204276    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204533 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.204533 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.204340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.205088 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.205038    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.206945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.206901    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.207053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.207022    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.207232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.207189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.207335 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.207274    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.212616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.212593    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.212875 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.212850    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7kz\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz\") pod \"istiod-openshift-gateway-7b7995d5cd-4v29t\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:03.328208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:03.328105    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:04.284705 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:04.284674    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:04.677182 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:39:04.677135    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210ab955_2383_44ec_a296_3281688d853c.slice/crio-d3884955fdd0b8bb35677de544cb43429944ca1ddcab9231e0b67e5bd5af886e WatchSource:0}: Error finding container d3884955fdd0b8bb35677de544cb43429944ca1ddcab9231e0b67e5bd5af886e: Status 404 returned error can't find the container with id d3884955fdd0b8bb35677de544cb43429944ca1ddcab9231e0b67e5bd5af886e
Sep 12 00:39:04.779828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:04.779792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" event={"ID":"210ab955-2383-44ec-a296-3281688d853c","Type":"ContainerStarted","Data":"d3884955fdd0b8bb35677de544cb43429944ca1ddcab9231e0b67e5bd5af886e"}
Sep 12 00:39:05.791581 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:05.791529    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg" event={"ID":"4eb0fa34-10a4-42d6-b521-43d731755f22","Type":"ContainerStarted","Data":"fc2bd8c558f601b2dd38ee8e104ae7610a9c8615ddef4f69e62b11d852f48b06"}
Sep 12 00:39:05.811794 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:05.811728    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-797549bd89-twhcg" podStartSLOduration=2.046140382 podStartE2EDuration="4.811713433s" totalImagesPullingTime="2.765573051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:39:05.809575863 +0000 UTC m=+598.860161471" watchObservedRunningTime="2026-09-12 00:39:05.811713433 +0000 UTC m=+598.862299040"
Sep 12 00:39:07.128242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.128205    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:39:07.128512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.128270    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:39:07.163804 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.163782    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cd88dfc4-nq5sp"]
Sep 12 00:39:07.168566 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.168542    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.173495 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:39:07.173470    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-79cd88dfc4-nq5sp\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="2436ccbc-9d10-4405-a642-0e44875de69f" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.185188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.185167    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cd88dfc4-nq5sp"]
Sep 12 00:39:07.239963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.239917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-service-ca\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.239972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-oauth-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.240010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.240054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-oauth-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.240087    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-trusted-ca-bundle\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240309 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.240137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss82n\" (UniqueName: \"kubernetes.io/projected/2436ccbc-9d10-4405-a642-0e44875de69f-kube-api-access-ss82n\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.240309 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.240222    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-console-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341249 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341217    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-oauth-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341249 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-trusted-ca-bundle\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341280    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss82n\" (UniqueName: \"kubernetes.io/projected/2436ccbc-9d10-4405-a642-0e44875de69f-kube-api-access-ss82n\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-console-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-service-ca\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-oauth-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.341667 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.341477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.342081 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.342055    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-console-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.342236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.342213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-service-ca\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.342393 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.342371    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-trusted-ca-bundle\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.342733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.342711    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2436ccbc-9d10-4405-a642-0e44875de69f-oauth-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.343702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.343676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-oauth-config\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.343951 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.343932    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2436ccbc-9d10-4405-a642-0e44875de69f-console-serving-cert\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.351136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.351114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss82n\" (UniqueName: \"kubernetes.io/projected/2436ccbc-9d10-4405-a642-0e44875de69f-kube-api-access-ss82n\") pod \"console-79cd88dfc4-nq5sp\" (UID: \"2436ccbc-9d10-4405-a642-0e44875de69f\") " pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.476826 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.476716    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:07.765996 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.765972    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cd88dfc4-nq5sp"]
Sep 12 00:39:07.767240 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:39:07.767210    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2436ccbc_9d10_4405_a642_0e44875de69f.slice/crio-c739ad861b14eb2b13454115abef6658d78ddd10b87f81eda5535cd831d40d28 WatchSource:0}: Error finding container c739ad861b14eb2b13454115abef6658d78ddd10b87f81eda5535cd831d40d28: Status 404 returned error can't find the container with id c739ad861b14eb2b13454115abef6658d78ddd10b87f81eda5535cd831d40d28
Sep 12 00:39:07.803737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.803711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" event={"ID":"210ab955-2383-44ec-a296-3281688d853c","Type":"ContainerStarted","Data":"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"}
Sep 12 00:39:07.803963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.803945    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:07.804914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.804892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cd88dfc4-nq5sp" event={"ID":"2436ccbc-9d10-4405-a642-0e44875de69f","Type":"ContainerStarted","Data":"c739ad861b14eb2b13454115abef6658d78ddd10b87f81eda5535cd831d40d28"}
Sep 12 00:39:07.835788 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:07.835732    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" podStartSLOduration=3.387806007 podStartE2EDuration="5.835717916s" totalImagesPullingTime="2.447911909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:39:07.833906167 +0000 UTC m=+600.884491811" watchObservedRunningTime="2026-09-12 00:39:07.835717916 +0000 UTC m=+600.886303523"
Sep 12 00:39:08.813011 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:08.812974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cd88dfc4-nq5sp" event={"ID":"2436ccbc-9d10-4405-a642-0e44875de69f","Type":"ContainerStarted","Data":"d7e7ca99001a0ed13e6b8c172f4f77f612c3c813d4817afcf85c4edf6d59cfe1"}
Sep 12 00:39:08.814613 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:08.814590    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:08.843378 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:08.843335    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cd88dfc4-nq5sp" podStartSLOduration=1.843321674 podStartE2EDuration="1.843321674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:39:08.842029606 +0000 UTC m=+601.892615214" watchObservedRunningTime="2026-09-12 00:39:08.843321674 +0000 UTC m=+601.893907323"
Sep 12 00:39:17.476881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:17.476841    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:17.477322 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:17.476898    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:17.481954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:17.481931    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:17.861333 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:17.861250    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79cd88dfc4-nq5sp"
Sep 12 00:39:17.919218 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:17.919170    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:39:19.062575 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.062539    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"]
Sep 12 00:39:19.067328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.067306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.082508 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.082485    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"]
Sep 12 00:39:19.147628 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb729\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-kube-api-access-qb729\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/244d3419-40a0-47da-b086-f85d45d8c026-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147932 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147855    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147932 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147888    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.147932 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.147909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248639 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248607    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/244d3419-40a0-47da-b086-f85d45d8c026-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248650    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248781    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.248839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.249399 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.248860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb729\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-kube-api-access-qb729\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.250729 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.250703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.251869 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.251624    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.251869 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.251794    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.251869 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.251832    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/244d3419-40a0-47da-b086-f85d45d8c026-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.252677 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.252629    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/244d3419-40a0-47da-b086-f85d45d8c026-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.259254 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.259210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.260015 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.259991    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb729\" (UniqueName: \"kubernetes.io/projected/244d3419-40a0-47da-b086-f85d45d8c026-kube-api-access-qb729\") pod \"istiod-openshift-gateway-5677ccb49b-c7zdh\" (UID: \"244d3419-40a0-47da-b086-f85d45d8c026\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.376671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.376580    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.666187 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.666136    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"]
Sep 12 00:39:19.667706 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:39:19.667664    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244d3419_40a0_47da_b086_f85d45d8c026.slice/crio-26625fb87386055dc74fee07b777edfb34a2742d47c76f268c663b4b87e8874d WatchSource:0}: Error finding container 26625fb87386055dc74fee07b777edfb34a2742d47c76f268c663b4b87e8874d: Status 404 returned error can't find the container with id 26625fb87386055dc74fee07b777edfb34a2742d47c76f268c663b4b87e8874d
Sep 12 00:39:19.670128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.670075    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:39:19.670244 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.670152    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:39:19.869289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.869252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh" event={"ID":"244d3419-40a0-47da-b086-f85d45d8c026","Type":"ContainerStarted","Data":"cbd2f768d5b4938e984fa30c26af80259df00634c287e3043ae47cdf4247bc07"}
Sep 12 00:39:19.869472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.869306    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh" event={"ID":"244d3419-40a0-47da-b086-f85d45d8c026","Type":"ContainerStarted","Data":"26625fb87386055dc74fee07b777edfb34a2742d47c76f268c663b4b87e8874d"}
Sep 12 00:39:19.869472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.869416    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:19.895003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:19.894958    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh" podStartSLOduration=0.894942384 podStartE2EDuration="894.942384ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:39:19.892823198 +0000 UTC m=+612.943408805" watchObservedRunningTime="2026-09-12 00:39:19.894942384 +0000 UTC m=+612.945527990"
Sep 12 00:39:20.876562 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:20.876536    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh"
Sep 12 00:39:20.952967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:20.952930    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:20.953192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:20.953164    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" podUID="210ab955-2383-44ec-a296-3281688d853c" containerName="discovery" containerID="cri-o://4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db" gracePeriod=30
Sep 12 00:39:21.199825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.199799    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:21.276208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276180    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276230    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276275    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276329    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276344    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276371 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276370    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph7kz\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz\") pod \"210ab955-2383-44ec-a296-3281688d853c\" (UID: \"210ab955-2383-44ec-a296-3281688d853c\") "
Sep 12 00:39:21.276749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.276708    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:39:21.278652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.278625    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts" (OuterVolumeSpecName: "cacerts") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:39:21.278817 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.278628    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz" (OuterVolumeSpecName: "kube-api-access-ph7kz") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "kube-api-access-ph7kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:39:21.278883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.278817    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:39:21.278883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.278873    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs" (OuterVolumeSpecName: "local-certs") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:39:21.278980 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.278938    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:39:21.279038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.279022    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token" (OuterVolumeSpecName: "istio-token") pod "210ab955-2383-44ec-a296-3281688d853c" (UID: "210ab955-2383-44ec-a296-3281688d853c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:39:21.377083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377047    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph7kz\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-kube-api-access-ph7kz\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377076    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210ab955-2383-44ec-a296-3281688d853c-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377085    2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/210ab955-2383-44ec-a296-3281688d853c-local-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377092    2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-cacerts\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377101    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-csr-dns-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377108    2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/210ab955-2383-44ec-a296-3281688d853c-istio-kubeconfig\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.377338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.377118    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/210ab955-2383-44ec-a296-3281688d853c-istio-csr-ca-configmap\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:21.883252 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.883166    2556 generic.go:356] "Generic (PLEG): container finished" podID="210ab955-2383-44ec-a296-3281688d853c" containerID="4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db" exitCode=0
Sep 12 00:39:21.883679 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.883247    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"
Sep 12 00:39:21.883679 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.883248    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" event={"ID":"210ab955-2383-44ec-a296-3281688d853c","Type":"ContainerDied","Data":"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"}
Sep 12 00:39:21.883679 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.883324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t" event={"ID":"210ab955-2383-44ec-a296-3281688d853c","Type":"ContainerDied","Data":"d3884955fdd0b8bb35677de544cb43429944ca1ddcab9231e0b67e5bd5af886e"}
Sep 12 00:39:21.883679 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.883356    2556 scope.go:117] "RemoveContainer" containerID="4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"
Sep 12 00:39:21.893611 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.893586    2556 scope.go:117] "RemoveContainer" containerID="4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"
Sep 12 00:39:21.894118 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:39:21.894093    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db\": container with ID starting with 4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db not found: ID does not exist" containerID="4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"
Sep 12 00:39:21.894424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.894128    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db"} err="failed to get container status \"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db\": rpc error: code = NotFound desc = could not find container \"4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db\": container with ID starting with 4b890555e563c5c4d19bede468cfbd7678565b105ece88d0e1bc15e3a99637db not found: ID does not exist"
Sep 12 00:39:21.925277 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.925248    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:21.933882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.933862    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t"]
Sep 12 00:39:21.985349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.985326    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"]
Sep 12 00:39:21.985692 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.985680    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210ab955-2383-44ec-a296-3281688d853c" containerName="discovery"
Sep 12 00:39:21.985764 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.985693    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="210ab955-2383-44ec-a296-3281688d853c" containerName="discovery"
Sep 12 00:39:21.985823 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.985780    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="210ab955-2383-44ec-a296-3281688d853c" containerName="discovery"
Sep 12 00:39:21.990153 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.990118    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:21.995059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.995026    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qx4d9\""
Sep 12 00:39:21.995280 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:21.995265    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 12 00:39:22.015177 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.015155    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"]
Sep 12 00:39:22.083234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.083194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbw99\" (UniqueName: \"kubernetes.io/projected/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-kube-api-access-xbw99\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.084353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.084324    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.186006 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.185953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbw99\" (UniqueName: \"kubernetes.io/projected/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-kube-api-access-xbw99\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.186202 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.186019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.186202 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:39:22.186195    2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 12 00:39:22.186321 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:39:22.186249    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert podName:b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc nodeName:}" failed. No retries permitted until 2026-09-12 00:39:22.686230575 +0000 UTC m=+615.736816160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert") pod "llmisvc-controller-manager-777c6bd7d5-fn2n7" (UID: "b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc") : secret "llmisvc-webhook-server-cert" not found
Sep 12 00:39:22.202272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.202246    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbw99\" (UniqueName: \"kubernetes.io/projected/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-kube-api-access-xbw99\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.691184 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.691143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.694242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.694210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fn2n7\" (UID: \"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:22.902808 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:22.902778    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:23.187221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:23.187188    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"]
Sep 12 00:39:23.192885 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:23.192855    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:39:23.453794 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:23.453749    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210ab955-2383-44ec-a296-3281688d853c" path="/var/lib/kubelet/pods/210ab955-2383-44ec-a296-3281688d853c/volumes"
Sep 12 00:39:23.900767 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:23.900668    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7" event={"ID":"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc","Type":"ContainerStarted","Data":"f088154194dab1d6e469c6c3f0faae24db6e2ea5d852232ef4b459465f894b0d"}
Sep 12 00:39:26.919147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:26.919110    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7" event={"ID":"b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc","Type":"ContainerStarted","Data":"b8e7a68e881715828423a10720cbe11039e3e89ee52394d718d874f5c8cc56d0"}
Sep 12 00:39:26.919520 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:26.919223    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:39:26.937394 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:26.937352    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7" podStartSLOduration=2.731992951 podStartE2EDuration="5.937339067s" totalImagesPullingTime="3.205346116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:39:26.935406698 +0000 UTC m=+619.985992304" watchObservedRunningTime="2026-09-12 00:39:26.937339067 +0000 UTC m=+619.987924714"
Sep 12 00:39:42.937961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:42.937902    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cfb6d9b55-wrv9t" podUID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" containerName="console" containerID="cri-o://386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2" gracePeriod=15
Sep 12 00:39:43.175539 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.175516    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:39:43.271011 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.270942    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271011 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.270973    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271054    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271088    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271155    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271184    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr2c7\" (UniqueName: \"kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271419 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271242    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config\") pod \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\" (UID: \"84941ab5-69de-4112-95ef-3a53e8ffb9dd\") "
Sep 12 00:39:43.271477 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271416    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config" (OuterVolumeSpecName: "console-config") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:39:43.271477 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271432    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:39:43.271573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271543    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:39:43.271573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271557    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-trusted-ca-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.271675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271584    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.271675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.271538    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:39:43.273139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.273115    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:39:43.273283 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.273262    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:39:43.273340 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.273293    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7" (OuterVolumeSpecName: "kube-api-access-nr2c7") pod "84941ab5-69de-4112-95ef-3a53e8ffb9dd" (UID: "84941ab5-69de-4112-95ef-3a53e8ffb9dd"). InnerVolumeSpecName "kube-api-access-nr2c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:39:43.372881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.372856    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.372881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.372878    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.373028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.372887    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84941ab5-69de-4112-95ef-3a53e8ffb9dd-oauth-serving-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.373028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.372896    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr2c7\" (UniqueName: \"kubernetes.io/projected/84941ab5-69de-4112-95ef-3a53e8ffb9dd-kube-api-access-nr2c7\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:43.373028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:43.372905    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84941ab5-69de-4112-95ef-3a53e8ffb9dd-console-oauth-config\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:39:44.005328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.005291    2556 generic.go:356] "Generic (PLEG): container finished" podID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" containerID="386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2" exitCode=0
Sep 12 00:39:44.005800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.005338    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb6d9b55-wrv9t"
Sep 12 00:39:44.005800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.005379    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb6d9b55-wrv9t" event={"ID":"84941ab5-69de-4112-95ef-3a53e8ffb9dd","Type":"ContainerDied","Data":"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"}
Sep 12 00:39:44.005800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.005423    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb6d9b55-wrv9t" event={"ID":"84941ab5-69de-4112-95ef-3a53e8ffb9dd","Type":"ContainerDied","Data":"fc86ac66dd62abf5c5d9eef08efd6d05e7b61d8baba4f603e28e9c7bdf969eb5"}
Sep 12 00:39:44.005800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.005441    2556 scope.go:117] "RemoveContainer" containerID="386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"
Sep 12 00:39:44.014515 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.014486    2556 scope.go:117] "RemoveContainer" containerID="386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"
Sep 12 00:39:44.014818 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:39:44.014792    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2\": container with ID starting with 386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2 not found: ID does not exist" containerID="386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"
Sep 12 00:39:44.014902 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.014828    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2"} err="failed to get container status \"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2\": rpc error: code = NotFound desc = could not find container \"386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2\": container with ID starting with 386e8c5219b1ec3aa2510bb06a34202f74ffd6c736b94e0d3beee5f71fe025f2 not found: ID does not exist"
Sep 12 00:39:44.022692 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.022666    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:39:44.025809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:44.025782    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cfb6d9b55-wrv9t"]
Sep 12 00:39:45.453726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:45.453694    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" path="/var/lib/kubelet/pods/84941ab5-69de-4112-95ef-3a53e8ffb9dd/volumes"
Sep 12 00:39:57.926621 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:39:57.926584    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fn2n7"
Sep 12 00:40:07.363412 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:07.363382    2556 scope.go:117] "RemoveContainer" containerID="301cb14b2538094436903ef258860a202b018eadba07314b0f6146b5dec279e5"
Sep 12 00:40:16.376570 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.376538    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"]
Sep 12 00:40:16.377049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.376940    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" containerName="console"
Sep 12 00:40:16.377049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.376953    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" containerName="console"
Sep 12 00:40:16.377049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.377025    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="84941ab5-69de-4112-95ef-3a53e8ffb9dd" containerName="console"
Sep 12 00:40:16.382035 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.382020    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.384867 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.384846    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:40:16.384979 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.384854    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:40:16.386442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.386420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kh6mp\""
Sep 12 00:40:16.388664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.388648    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"]
Sep 12 00:40:16.447882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.447860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbjt\" (UniqueName: \"kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.447989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.447902    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.447989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.447933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.475535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.475509    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"]
Sep 12 00:40:16.478878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.478864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.486083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.486052    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"]
Sep 12 00:40:16.548836 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7w8h\" (UniqueName: \"kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.548930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.548930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548862    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.548930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.549086 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbjt\" (UniqueName: \"kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.549086 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.548990    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.549163 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.549147    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.549232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.549216    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.557155 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.557132    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbjt\" (UniqueName: \"kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.571883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.571862    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"]
Sep 12 00:40:16.575461 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.575448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.583257 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.583238    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"]
Sep 12 00:40:16.649587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7w8h\" (UniqueName: \"kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.649587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.649587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.649804 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.649804 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.649804 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649677    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxgf\" (UniqueName: \"kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.650013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.649996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.650063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.650048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.658456 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.658432    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7w8h\" (UniqueName: \"kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.677362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.677341    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"]
Sep 12 00:40:16.680823 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.680809    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.689116 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.689097    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"]
Sep 12 00:40:16.692791 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.692748    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:16.765078 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.765306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.765429 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.765600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgwx\" (UniqueName: \"kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.765721 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.765873 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.765856    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxgf\" (UniqueName: \"kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.766654 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.766632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.767019 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.767001    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.776643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.776612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxgf\" (UniqueName: \"kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.788665 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.788640    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:16.867352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.867324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.867504 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.867360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgwx\" (UniqueName: \"kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.867504 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.867397    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.867868 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.867842    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.867979 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.867880    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.876221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.876196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgwx\" (UniqueName: \"kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:16.884927 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.884903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:16.968976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.968951    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"]
Sep 12 00:40:16.970441 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:16.970416    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2188713_be94_4b40_9bb8_a21ac3d2f5c2.slice/crio-d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9 WatchSource:0}: Error finding container d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9: Status 404 returned error can't find the container with id d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9
Sep 12 00:40:16.990232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:16.990205    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:17.067852 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:17.067815    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76646645_3686_4cfc_ae1d_962d41a0ea80.slice/crio-9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50 WatchSource:0}: Error finding container 9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50: Status 404 returned error can't find the container with id 9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50
Sep 12 00:40:17.069060 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.068993    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"]
Sep 12 00:40:17.155143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.155119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"]
Sep 12 00:40:17.156797 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:17.156769    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a232831_5868_40a5_8f0e_8617006f8e9a.slice/crio-348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928 WatchSource:0}: Error finding container 348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928: Status 404 returned error can't find the container with id 348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928
Sep 12 00:40:17.171499 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.171472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq" event={"ID":"7a232831-5868-40a5-8f0e-8617006f8e9a","Type":"ContainerStarted","Data":"348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928"}
Sep 12 00:40:17.173213 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.173186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv" event={"ID":"76646645-3686-4cfc-ae1d-962d41a0ea80","Type":"ContainerStarted","Data":"9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50"}
Sep 12 00:40:17.174793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.174746    2556 generic.go:356] "Generic (PLEG): container finished" podID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerID="19dcd02af3b4992553993dea79966a722a135b58e6c6fb779bb0a551e6806408" exitCode=0
Sep 12 00:40:17.174888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.174786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9" event={"ID":"b2188713-be94-4b40-9bb8-a21ac3d2f5c2","Type":"ContainerDied","Data":"19dcd02af3b4992553993dea79966a722a135b58e6c6fb779bb0a551e6806408"}
Sep 12 00:40:17.174888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.174830    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9" event={"ID":"b2188713-be94-4b40-9bb8-a21ac3d2f5c2","Type":"ContainerStarted","Data":"d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9"}
Sep 12 00:40:17.264050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:17.264025    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"]
Sep 12 00:40:17.309486 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:17.309459    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297c0b06_bd75_426a_978b_3722846c30b7.slice/crio-3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160 WatchSource:0}: Error finding container 3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160: Status 404 returned error can't find the container with id 3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160
Sep 12 00:40:18.182285 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.182250    2556 generic.go:356] "Generic (PLEG): container finished" podID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerID="d82433927e84cc721a99f2edc340885985cd6f97003f08fe0d04d28af9755886" exitCode=0
Sep 12 00:40:18.182674 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.182361    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9" event={"ID":"b2188713-be94-4b40-9bb8-a21ac3d2f5c2","Type":"ContainerDied","Data":"d82433927e84cc721a99f2edc340885985cd6f97003f08fe0d04d28af9755886"}
Sep 12 00:40:18.184047 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.184027    2556 generic.go:356] "Generic (PLEG): container finished" podID="297c0b06-bd75-426a-978b-3722846c30b7" containerID="ee5a359da3d0bbe032df2f3b1dbf437661d3fe33285b10e59b83c8e021db12cb" exitCode=0
Sep 12 00:40:18.184203 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.184099    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24" event={"ID":"297c0b06-bd75-426a-978b-3722846c30b7","Type":"ContainerDied","Data":"ee5a359da3d0bbe032df2f3b1dbf437661d3fe33285b10e59b83c8e021db12cb"}
Sep 12 00:40:18.184203 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.184140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24" event={"ID":"297c0b06-bd75-426a-978b-3722846c30b7","Type":"ContainerStarted","Data":"3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160"}
Sep 12 00:40:18.185726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.185705    2556 generic.go:356] "Generic (PLEG): container finished" podID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerID="3c974e2763bbe140c7dc51f67a348a5df79accce4be65185ceb6c5f106fd6bd9" exitCode=0
Sep 12 00:40:18.185810 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.185782    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq" event={"ID":"7a232831-5868-40a5-8f0e-8617006f8e9a","Type":"ContainerDied","Data":"3c974e2763bbe140c7dc51f67a348a5df79accce4be65185ceb6c5f106fd6bd9"}
Sep 12 00:40:18.187959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.187828    2556 generic.go:356] "Generic (PLEG): container finished" podID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerID="75083ef75c7c8000de225e21e315532d2eac9d79660015fd8b8c3d62afd999da" exitCode=0
Sep 12 00:40:18.187959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:18.187856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv" event={"ID":"76646645-3686-4cfc-ae1d-962d41a0ea80","Type":"ContainerDied","Data":"75083ef75c7c8000de225e21e315532d2eac9d79660015fd8b8c3d62afd999da"}
Sep 12 00:40:19.195700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:19.195669    2556 generic.go:356] "Generic (PLEG): container finished" podID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerID="153038f42025115841c36c7447bacf53e0fb42b235f2b81000b22ea6aa3059c5" exitCode=0
Sep 12 00:40:19.196090 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:19.195820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9" event={"ID":"b2188713-be94-4b40-9bb8-a21ac3d2f5c2","Type":"ContainerDied","Data":"153038f42025115841c36c7447bacf53e0fb42b235f2b81000b22ea6aa3059c5"}
Sep 12 00:40:19.197693 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:19.197670    2556 generic.go:356] "Generic (PLEG): container finished" podID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerID="b9a486f24751553869b2ea141ad9e008a5a7c82084325db6c05ad2fe198ccbde" exitCode=0
Sep 12 00:40:19.197810 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:19.197738    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq" event={"ID":"7a232831-5868-40a5-8f0e-8617006f8e9a","Type":"ContainerDied","Data":"b9a486f24751553869b2ea141ad9e008a5a7c82084325db6c05ad2fe198ccbde"}
Sep 12 00:40:20.211844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.211811    2556 generic.go:356] "Generic (PLEG): container finished" podID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerID="cc98538bacc419981dd4f798efba0887a7a431ba82d0178bcb3c7eb7a989d073" exitCode=0
Sep 12 00:40:20.212257 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.211897    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv" event={"ID":"76646645-3686-4cfc-ae1d-962d41a0ea80","Type":"ContainerDied","Data":"cc98538bacc419981dd4f798efba0887a7a431ba82d0178bcb3c7eb7a989d073"}
Sep 12 00:40:20.213775 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.213736    2556 generic.go:356] "Generic (PLEG): container finished" podID="297c0b06-bd75-426a-978b-3722846c30b7" containerID="c7f0b989506e972de9bfb548741e9a92762522dfd292b4d904b3963b111ed20a" exitCode=0
Sep 12 00:40:20.213899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.213790    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24" event={"ID":"297c0b06-bd75-426a-978b-3722846c30b7","Type":"ContainerDied","Data":"c7f0b989506e972de9bfb548741e9a92762522dfd292b4d904b3963b111ed20a"}
Sep 12 00:40:20.215953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.215934    2556 generic.go:356] "Generic (PLEG): container finished" podID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerID="2483c8dd7272d599b5129b1522de352486c9ad781b80019a89586d65a7222401" exitCode=0
Sep 12 00:40:20.216026 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.216006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq" event={"ID":"7a232831-5868-40a5-8f0e-8617006f8e9a","Type":"ContainerDied","Data":"2483c8dd7272d599b5129b1522de352486c9ad781b80019a89586d65a7222401"}
Sep 12 00:40:20.353462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.353434    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:20.497685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.497656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle\") pod \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") "
Sep 12 00:40:20.497846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.497702    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hbjt\" (UniqueName: \"kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt\") pod \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") "
Sep 12 00:40:20.497846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.497724    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util\") pod \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\" (UID: \"b2188713-be94-4b40-9bb8-a21ac3d2f5c2\") "
Sep 12 00:40:20.498132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.498104    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle" (OuterVolumeSpecName: "bundle") pod "b2188713-be94-4b40-9bb8-a21ac3d2f5c2" (UID: "b2188713-be94-4b40-9bb8-a21ac3d2f5c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:20.499681 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.499659    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt" (OuterVolumeSpecName: "kube-api-access-7hbjt") pod "b2188713-be94-4b40-9bb8-a21ac3d2f5c2" (UID: "b2188713-be94-4b40-9bb8-a21ac3d2f5c2"). InnerVolumeSpecName "kube-api-access-7hbjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:20.502748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.502724    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util" (OuterVolumeSpecName: "util") pod "b2188713-be94-4b40-9bb8-a21ac3d2f5c2" (UID: "b2188713-be94-4b40-9bb8-a21ac3d2f5c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:20.599650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.599544    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:20.599835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.599740    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hbjt\" (UniqueName: \"kubernetes.io/projected/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-kube-api-access-7hbjt\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:20.599835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:20.599777    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2188713-be94-4b40-9bb8-a21ac3d2f5c2-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:21.223895 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.223864    2556 generic.go:356] "Generic (PLEG): container finished" podID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerID="e0dfd0b074cb459e22a4e573c920c9f5c737dd212a7e881901a54e1f3a23f601" exitCode=0
Sep 12 00:40:21.224254 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.223948    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv" event={"ID":"76646645-3686-4cfc-ae1d-962d41a0ea80","Type":"ContainerDied","Data":"e0dfd0b074cb459e22a4e573c920c9f5c737dd212a7e881901a54e1f3a23f601"}
Sep 12 00:40:21.225772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.225738    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9"
Sep 12 00:40:21.225772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.225746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6z48q9" event={"ID":"b2188713-be94-4b40-9bb8-a21ac3d2f5c2","Type":"ContainerDied","Data":"d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9"}
Sep 12 00:40:21.225952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.225802    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d26f4b397d3a7154bbaffa8ce77990fcc12bffbd658ae6a69340821ff4ccb1a9"
Sep 12 00:40:21.227889 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.227867    2556 generic.go:356] "Generic (PLEG): container finished" podID="297c0b06-bd75-426a-978b-3722846c30b7" containerID="bd8aa1e40d43acc4079f24d05a50e43c3bd2b5721ec3232fc6651b5349d1254d" exitCode=0
Sep 12 00:40:21.228010 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.227929    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24" event={"ID":"297c0b06-bd75-426a-978b-3722846c30b7","Type":"ContainerDied","Data":"bd8aa1e40d43acc4079f24d05a50e43c3bd2b5721ec3232fc6651b5349d1254d"}
Sep 12 00:40:21.357718 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.357692    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:21.507324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.507295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle\") pod \"7a232831-5868-40a5-8f0e-8617006f8e9a\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") "
Sep 12 00:40:21.507324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.507326    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util\") pod \"7a232831-5868-40a5-8f0e-8617006f8e9a\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") "
Sep 12 00:40:21.507567 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.507394    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gxgf\" (UniqueName: \"kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf\") pod \"7a232831-5868-40a5-8f0e-8617006f8e9a\" (UID: \"7a232831-5868-40a5-8f0e-8617006f8e9a\") "
Sep 12 00:40:21.507853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.507818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle" (OuterVolumeSpecName: "bundle") pod "7a232831-5868-40a5-8f0e-8617006f8e9a" (UID: "7a232831-5868-40a5-8f0e-8617006f8e9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:21.509382 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.509353    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf" (OuterVolumeSpecName: "kube-api-access-7gxgf") pod "7a232831-5868-40a5-8f0e-8617006f8e9a" (UID: "7a232831-5868-40a5-8f0e-8617006f8e9a"). InnerVolumeSpecName "kube-api-access-7gxgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:21.512586 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.512566    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util" (OuterVolumeSpecName: "util") pod "7a232831-5868-40a5-8f0e-8617006f8e9a" (UID: "7a232831-5868-40a5-8f0e-8617006f8e9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:21.608689 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.608627    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gxgf\" (UniqueName: \"kubernetes.io/projected/7a232831-5868-40a5-8f0e-8617006f8e9a-kube-api-access-7gxgf\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:21.608689 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.608652    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:21.608689 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:21.608667    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a232831-5868-40a5-8f0e-8617006f8e9a-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.234684 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.234655    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq"
Sep 12 00:40:22.235108 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.234686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgkbkq" event={"ID":"7a232831-5868-40a5-8f0e-8617006f8e9a","Type":"ContainerDied","Data":"348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928"}
Sep 12 00:40:22.235108 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.234728    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348d49c069c4cc7674048fe16078d49e40fddce13503d15d1b11dee551259928"
Sep 12 00:40:22.365709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.365686    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:22.400526 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.400494    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:22.514866 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514770    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle\") pod \"297c0b06-bd75-426a-978b-3722846c30b7\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") "
Sep 12 00:40:22.514866 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514829    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util\") pod \"76646645-3686-4cfc-ae1d-962d41a0ea80\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") "
Sep 12 00:40:22.514866 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514854    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util\") pod \"297c0b06-bd75-426a-978b-3722846c30b7\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") "
Sep 12 00:40:22.515132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514908    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mgwx\" (UniqueName: \"kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx\") pod \"297c0b06-bd75-426a-978b-3722846c30b7\" (UID: \"297c0b06-bd75-426a-978b-3722846c30b7\") "
Sep 12 00:40:22.515132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514934    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle\") pod \"76646645-3686-4cfc-ae1d-962d41a0ea80\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") "
Sep 12 00:40:22.515132 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.514966    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7w8h\" (UniqueName: \"kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h\") pod \"76646645-3686-4cfc-ae1d-962d41a0ea80\" (UID: \"76646645-3686-4cfc-ae1d-962d41a0ea80\") "
Sep 12 00:40:22.515384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.515351    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle" (OuterVolumeSpecName: "bundle") pod "297c0b06-bd75-426a-978b-3722846c30b7" (UID: "297c0b06-bd75-426a-978b-3722846c30b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:22.515697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.515658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle" (OuterVolumeSpecName: "bundle") pod "76646645-3686-4cfc-ae1d-962d41a0ea80" (UID: "76646645-3686-4cfc-ae1d-962d41a0ea80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:22.517131 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.517107    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx" (OuterVolumeSpecName: "kube-api-access-6mgwx") pod "297c0b06-bd75-426a-978b-3722846c30b7" (UID: "297c0b06-bd75-426a-978b-3722846c30b7"). InnerVolumeSpecName "kube-api-access-6mgwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:22.517227 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.517208    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h" (OuterVolumeSpecName: "kube-api-access-n7w8h") pod "76646645-3686-4cfc-ae1d-962d41a0ea80" (UID: "76646645-3686-4cfc-ae1d-962d41a0ea80"). InnerVolumeSpecName "kube-api-access-n7w8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:22.520684 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.520666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util" (OuterVolumeSpecName: "util") pod "76646645-3686-4cfc-ae1d-962d41a0ea80" (UID: "76646645-3686-4cfc-ae1d-962d41a0ea80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:22.520796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.520777    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util" (OuterVolumeSpecName: "util") pod "297c0b06-bd75-426a-978b-3722846c30b7" (UID: "297c0b06-bd75-426a-978b-3722846c30b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:22.615805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615747    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.615805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615801    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.615805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615810    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297c0b06-bd75-426a-978b-3722846c30b7-util\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.616021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615818    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mgwx\" (UniqueName: \"kubernetes.io/projected/297c0b06-bd75-426a-978b-3722846c30b7-kube-api-access-6mgwx\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.616021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615827    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76646645-3686-4cfc-ae1d-962d41a0ea80-bundle\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:22.616021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:22.615836    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7w8h\" (UniqueName: \"kubernetes.io/projected/76646645-3686-4cfc-ae1d-962d41a0ea80-kube-api-access-n7w8h\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:23.247315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.247288    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv"
Sep 12 00:40:23.247315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.247303    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adsrlv" event={"ID":"76646645-3686-4cfc-ae1d-962d41a0ea80","Type":"ContainerDied","Data":"9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50"}
Sep 12 00:40:23.247785 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.247367    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ee1b127a69d5c33f030ab9a57fe5179d98532462c86c366134932bdfc3c7c50"
Sep 12 00:40:23.249188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.249167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24" event={"ID":"297c0b06-bd75-426a-978b-3722846c30b7","Type":"ContainerDied","Data":"3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160"}
Sep 12 00:40:23.249300 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.249202    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lxf24"
Sep 12 00:40:23.249300 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:23.249199    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d0f89e3ce04339be2d4787a49e2e6204140f399162988697fd0065648378160"
Sep 12 00:40:28.538612 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538580    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"]
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538940    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="util"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538957    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="util"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538968    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="pull"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538976    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="pull"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538991    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="util"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.538998    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="util"
Sep 12 00:40:28.539003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539006    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="util"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539012    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="util"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539019    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539027    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539047    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539059    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539067    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539077    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539085    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539101    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539110    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539119    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539128    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539146    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539151    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="pull"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539160    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="util"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539167    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="util"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539270    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="76646645-3686-4cfc-ae1d-962d41a0ea80" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539285    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a232831-5868-40a5-8f0e-8617006f8e9a" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539295    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2188713-be94-4b40-9bb8-a21ac3d2f5c2" containerName="extract"
Sep 12 00:40:28.539358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.539303    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="297c0b06-bd75-426a-978b-3722846c30b7" containerName="extract"
Sep 12 00:40:28.543899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.543883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:28.546529 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.546506    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 12 00:40:28.546641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.546530    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wnn9m\""
Sep 12 00:40:28.546641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.546534    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 12 00:40:28.546641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.546508    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 12 00:40:28.554925 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.553727    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"]
Sep 12 00:40:28.663853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.663814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmr7\" (UniqueName: \"kubernetes.io/projected/5f1c59bb-3b03-4302-8e7f-864bc0b679e0-kube-api-access-pvmr7\") pod \"dns-operator-controller-manager-7b84cd7c9c-dwpk4\" (UID: \"5f1c59bb-3b03-4302-8e7f-864bc0b679e0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:28.765282 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.765245    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmr7\" (UniqueName: \"kubernetes.io/projected/5f1c59bb-3b03-4302-8e7f-864bc0b679e0-kube-api-access-pvmr7\") pod \"dns-operator-controller-manager-7b84cd7c9c-dwpk4\" (UID: \"5f1c59bb-3b03-4302-8e7f-864bc0b679e0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:28.777281 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.777246    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmr7\" (UniqueName: \"kubernetes.io/projected/5f1c59bb-3b03-4302-8e7f-864bc0b679e0-kube-api-access-pvmr7\") pod \"dns-operator-controller-manager-7b84cd7c9c-dwpk4\" (UID: \"5f1c59bb-3b03-4302-8e7f-864bc0b679e0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:28.856080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:28.855983    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:29.136916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:29.136886    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"]
Sep 12 00:40:29.138327 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:29.138299    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1c59bb_3b03_4302_8e7f_864bc0b679e0.slice/crio-e7733777008f681a7729cf8ffeb5d1fda34bae21094808d2d68b1f365dad8619 WatchSource:0}: Error finding container e7733777008f681a7729cf8ffeb5d1fda34bae21094808d2d68b1f365dad8619: Status 404 returned error can't find the container with id e7733777008f681a7729cf8ffeb5d1fda34bae21094808d2d68b1f365dad8619
Sep 12 00:40:29.280725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:29.280692    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4" event={"ID":"5f1c59bb-3b03-4302-8e7f-864bc0b679e0","Type":"ContainerStarted","Data":"e7733777008f681a7729cf8ffeb5d1fda34bae21094808d2d68b1f365dad8619"}
Sep 12 00:40:32.302922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:32.302826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4" event={"ID":"5f1c59bb-3b03-4302-8e7f-864bc0b679e0","Type":"ContainerStarted","Data":"0b32d176ddd15ddc490efeb58aa9860008fda42e3afa449cb633229118d2fdca"}
Sep 12 00:40:32.302922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:32.302905    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:32.322741 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:32.322692    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4" podStartSLOduration=1.476166353 podStartE2EDuration="4.322680288s" totalImagesPullingTime="2.846513935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:40:32.31973997 +0000 UTC m=+685.370325579" watchObservedRunningTime="2026-09-12 00:40:32.322680288 +0000 UTC m=+685.373265894"
Sep 12 00:40:33.004075 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.004041    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"]
Sep 12 00:40:33.007182 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.007166    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.010116 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.010092    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2tmjk\""
Sep 12 00:40:33.020443 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.020417    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"]
Sep 12 00:40:33.111306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.111272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.111466 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.111330    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc2h\" (UniqueName: \"kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.212582 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.212547    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.212749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.212618    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc2h\" (UniqueName: \"kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.212942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.212922    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.220783 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.220745    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc2h\" (UniqueName: \"kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.317575 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.317511    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:33.594501 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:33.594469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"]
Sep 12 00:40:33.595748 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:33.595724    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1d742b_b5d2_4c5a_ab1c_558f1d2bfd60.slice/crio-66510d2fb43fda61029be2789277be0bd636ce9c19b6a6d4e399d91698b391d6 WatchSource:0}: Error finding container 66510d2fb43fda61029be2789277be0bd636ce9c19b6a6d4e399d91698b391d6: Status 404 returned error can't find the container with id 66510d2fb43fda61029be2789277be0bd636ce9c19b6a6d4e399d91698b391d6
Sep 12 00:40:34.314382 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:34.314342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w" event={"ID":"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60","Type":"ContainerStarted","Data":"66510d2fb43fda61029be2789277be0bd636ce9c19b6a6d4e399d91698b391d6"}
Sep 12 00:40:37.335040 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.335012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w" event={"ID":"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60","Type":"ContainerStarted","Data":"2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873"}
Sep 12 00:40:37.335409 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.335140    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:37.356963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.356915    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w" podStartSLOduration=1.713446866 podStartE2EDuration="5.356898745s" totalImagesPullingTime="3.643451879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:40:37.353616804 +0000 UTC m=+690.404202458" watchObservedRunningTime="2026-09-12 00:40:37.356898745 +0000 UTC m=+690.407484352"
Sep 12 00:40:37.649539 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.649441    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f56zl"]
Sep 12 00:40:37.654071 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.654042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:37.658368 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.658136    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-627fl\""
Sep 12 00:40:37.668704 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.668467    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f56zl"]
Sep 12 00:40:37.750234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.750195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x8lh\" (UniqueName: \"kubernetes.io/projected/bba4be01-d6af-462a-af2e-eee16272f073-kube-api-access-6x8lh\") pod \"authorino-operator-76b478bd78-f56zl\" (UID: \"bba4be01-d6af-462a-af2e-eee16272f073\") " pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:37.851418 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.851374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x8lh\" (UniqueName: \"kubernetes.io/projected/bba4be01-d6af-462a-af2e-eee16272f073-kube-api-access-6x8lh\") pod \"authorino-operator-76b478bd78-f56zl\" (UID: \"bba4be01-d6af-462a-af2e-eee16272f073\") " pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:37.860628 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.860577    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x8lh\" (UniqueName: \"kubernetes.io/projected/bba4be01-d6af-462a-af2e-eee16272f073-kube-api-access-6x8lh\") pod \"authorino-operator-76b478bd78-f56zl\" (UID: \"bba4be01-d6af-462a-af2e-eee16272f073\") " pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:37.971112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:37.971081    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:38.243969 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:38.243939    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f56zl"]
Sep 12 00:40:38.245379 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:38.245352    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba4be01_d6af_462a_af2e_eee16272f073.slice/crio-aded49a97d28182c9696b21011f7b30284345bb0ee24de4f84e4b8a56ae93d56 WatchSource:0}: Error finding container aded49a97d28182c9696b21011f7b30284345bb0ee24de4f84e4b8a56ae93d56: Status 404 returned error can't find the container with id aded49a97d28182c9696b21011f7b30284345bb0ee24de4f84e4b8a56ae93d56
Sep 12 00:40:38.342168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:38.342138    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl" event={"ID":"bba4be01-d6af-462a-af2e-eee16272f073","Type":"ContainerStarted","Data":"aded49a97d28182c9696b21011f7b30284345bb0ee24de4f84e4b8a56ae93d56"}
Sep 12 00:40:40.354549 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:40.354511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl" event={"ID":"bba4be01-d6af-462a-af2e-eee16272f073","Type":"ContainerStarted","Data":"d38bdf9897c6fbc2cff35c6a0fbebcb707309fff675736d5b28d9e580b990e22"}
Sep 12 00:40:40.354901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:40.354573    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:40.372464 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:40.372414    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl" podStartSLOduration=1.884424583 podStartE2EDuration="3.372399289s" totalImagesPullingTime="1.487974706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:40:40.370390848 +0000 UTC m=+693.420976479" watchObservedRunningTime="2026-09-12 00:40:40.372399289 +0000 UTC m=+693.422984895"
Sep 12 00:40:43.311196 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:43.311168    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dwpk4"
Sep 12 00:40:48.344406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:48.344374    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.245986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.245946    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"]
Sep 12 00:40:50.250925 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.250906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.266572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.266546    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"]
Sep 12 00:40:50.370113 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.370080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.370292 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.370125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxqr6\" (UniqueName: \"kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.470532 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.470501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxqr6\" (UniqueName: \"kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.470711 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.470566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.470965 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.470948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.479064 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.479040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxqr6\" (UniqueName: \"kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.487072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.487050    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"]
Sep 12 00:40:50.487238 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.487216    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" containerName="manager" containerID="cri-o://2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873" gracePeriod=2
Sep 12 00:40:50.497296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.497233    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"]
Sep 12 00:40:50.498324 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:50.498284    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\": pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.510096 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.510071    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:40:50.510478 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.510464    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" containerName="manager"
Sep 12 00:40:50.510532 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.510480    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" containerName="manager"
Sep 12 00:40:50.510572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.510549    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" containerName="manager"
Sep 12 00:40:50.513470 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.513456    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.513689 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.513668    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"]
Sep 12 00:40:50.514025 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.514012    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:50.515834 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:50.515800    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.527257 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.527225    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"]
Sep 12 00:40:50.529859 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.529837    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:40:50.546514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.546492    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:40:50.558424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.558397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.564630 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.564561    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:40:50.572052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.571922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.572175 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.572081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf7r4\" (UniqueName: \"kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.589296 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:50.589263    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.673392 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.673356    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgtm\" (UniqueName: \"kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.673528 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.673437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf7r4\" (UniqueName: \"kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.673528 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.673503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.673629 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.673538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.673945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.673924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.682496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.682477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf7r4\" (UniqueName: \"kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ncvmp\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.720528 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.720510    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.722942 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:50.722912    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:50.774882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.774809    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgc2h\" (UniqueName: \"kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h\") pod \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") "
Sep 12 00:40:50.774882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.774870    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume\") pod \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\" (UID: \"1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60\") "
Sep 12 00:40:50.775083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.775064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgtm\" (UniqueName: \"kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.775178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.775160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.775257 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.775244    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" (UID: "1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:50.775496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.775477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.776962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.776943    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h" (OuterVolumeSpecName: "kube-api-access-wgc2h") pod "1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" (UID: "1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60"). InnerVolumeSpecName "kube-api-access-wgc2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:50.801495 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.801468    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgtm\" (UniqueName: \"kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4vzxf\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:50.870518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.870482    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:50.875910 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.875886    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgc2h\" (UniqueName: \"kubernetes.io/projected/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-kube-api-access-wgc2h\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:50.875910 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.875909    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60-extensions-socket-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:50.876147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:50.876127    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:51.154936 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.154910    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:40:51.156911 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:51.156885    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3c5387_3c1e_43a0_a656_041051292ea5.slice/crio-621910006ac4cb88ac6e23f2c822aa8103fa5a95d33d2d6dcfa20e8157327be4 WatchSource:0}: Error finding container 621910006ac4cb88ac6e23f2c822aa8103fa5a95d33d2d6dcfa20e8157327be4: Status 404 returned error can't find the container with id 621910006ac4cb88ac6e23f2c822aa8103fa5a95d33d2d6dcfa20e8157327be4
Sep 12 00:40:51.164744 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.164724    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:40:51.165584 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:40:51.165557    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4196a5c9_b0b4_476a_9377_97f9c7c1baf2.slice/crio-d79b446750b1fafff6b84bccfd25cf100a954580508177e558ee2076706d66f8 WatchSource:0}: Error finding container d79b446750b1fafff6b84bccfd25cf100a954580508177e558ee2076706d66f8: Status 404 returned error can't find the container with id d79b446750b1fafff6b84bccfd25cf100a954580508177e558ee2076706d66f8
Sep 12 00:40:51.363123 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.363097    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-f56zl"
Sep 12 00:40:51.365484 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:51.365449    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:51.419031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.418992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" event={"ID":"4196a5c9-b0b4-476a-9377-97f9c7c1baf2","Type":"ContainerStarted","Data":"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"}
Sep 12 00:40:51.419208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.419058    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:40:51.419208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.419092    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" event={"ID":"4196a5c9-b0b4-476a-9377-97f9c7c1baf2","Type":"ContainerStarted","Data":"d79b446750b1fafff6b84bccfd25cf100a954580508177e558ee2076706d66f8"}
Sep 12 00:40:51.420541 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.420511    2556 generic.go:356] "Generic (PLEG): container finished" podID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" containerID="2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873" exitCode=0
Sep 12 00:40:51.420688 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.420544    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:51.420688 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.420604    2556 scope.go:117] "RemoveContainer" containerID="2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873"
Sep 12 00:40:51.422177 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:51.422149    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:51.422807 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.422788    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" event={"ID":"8c3c5387-3c1e-43a0-a656-041051292ea5","Type":"ContainerStarted","Data":"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"}
Sep 12 00:40:51.422913 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.422836    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" event={"ID":"8c3c5387-3c1e-43a0-a656-041051292ea5","Type":"ContainerStarted","Data":"621910006ac4cb88ac6e23f2c822aa8103fa5a95d33d2d6dcfa20e8157327be4"}
Sep 12 00:40:51.422913 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.422867    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:40:51.430154 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.430137    2556 scope.go:117] "RemoveContainer" containerID="2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873"
Sep 12 00:40:51.430430 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:51.430411    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873\": container with ID starting with 2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873 not found: ID does not exist" containerID="2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873"
Sep 12 00:40:51.430479 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.430438    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873"} err="failed to get container status \"2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873\": rpc error: code = NotFound desc = could not find container \"2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873\": container with ID starting with 2b9086843282cbf69de7de854c86ac716bfe03899aad9a9b9a6b059549daa873 not found: ID does not exist"
Sep 12 00:40:51.447656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.447612    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" podStartSLOduration=1.447599777 podStartE2EDuration="1.447599777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:40:51.445231387 +0000 UTC m=+704.495817030" watchObservedRunningTime="2026-09-12 00:40:51.447599777 +0000 UTC m=+704.498185384"
Sep 12 00:40:51.447812 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:51.447721    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7pl8w\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7pl8w"
Sep 12 00:40:51.461830 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.461805    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60" path="/var/lib/kubelet/pods/1a1d742b-b5d2-4c5a-ab1c-558f1d2bfd60/volumes"
Sep 12 00:40:51.479943 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:51.479891    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" podStartSLOduration=1.479872844 podStartE2EDuration="1.479872844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:40:51.479793579 +0000 UTC m=+704.530379191" watchObservedRunningTime="2026-09-12 00:40:51.479872844 +0000 UTC m=+704.530458451"
Sep 12 00:40:53.064557 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:53.064520    2556 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-s8sck_kuadrant-system_0d73595d-a386-4a0a-b0fc-690abfb95f85_0(08fe97a38d742e841c90d2ae9a678e4398043fe3d6e0ec2a917417973808e275): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-s8sck to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Sep 12 00:40:53.064867 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:53.064582    2556 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-s8sck_kuadrant-system_0d73595d-a386-4a0a-b0fc-690abfb95f85_0(08fe97a38d742e841c90d2ae9a678e4398043fe3d6e0ec2a917417973808e275): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-s8sck to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:53.435105 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.435071    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:53.443928 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.443906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:53.446309 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:53.446284    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="0d73595d-a386-4a0a-b0fc-690abfb95f85" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:53.495955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.495931    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxqr6\" (UniqueName: \"kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6\") pod \"0d73595d-a386-4a0a-b0fc-690abfb95f85\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") "
Sep 12 00:40:53.496052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.495976    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume\") pod \"0d73595d-a386-4a0a-b0fc-690abfb95f85\" (UID: \"0d73595d-a386-4a0a-b0fc-690abfb95f85\") "
Sep 12 00:40:53.496238 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.496217    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d73595d-a386-4a0a-b0fc-690abfb95f85" (UID: "0d73595d-a386-4a0a-b0fc-690abfb95f85"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:40:53.497926 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.497909    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6" (OuterVolumeSpecName: "kube-api-access-lxqr6") pod "0d73595d-a386-4a0a-b0fc-690abfb95f85" (UID: "0d73595d-a386-4a0a-b0fc-690abfb95f85"). InnerVolumeSpecName "kube-api-access-lxqr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:40:53.596871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.596846    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxqr6\" (UniqueName: \"kubernetes.io/projected/0d73595d-a386-4a0a-b0fc-690abfb95f85-kube-api-access-lxqr6\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:53.596871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:53.596869    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d73595d-a386-4a0a-b0fc-690abfb95f85-extensions-socket-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:40:54.440805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:54.440769    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:54.448608 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:40:54.448581    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-s8sck\" is forbidden: User \"system:node:ip-10-0-131-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-144.ec2.internal' and this object" podUID="0d73595d-a386-4a0a-b0fc-690abfb95f85" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-s8sck"
Sep 12 00:40:55.453408 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:40:55.453373    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d73595d-a386-4a0a-b0fc-690abfb95f85" path="/var/lib/kubelet/pods/0d73595d-a386-4a0a-b0fc-690abfb95f85/volumes"
Sep 12 00:41:02.432532 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.432455    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:41:02.432532 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.432523    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:41:02.503745 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.503709    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:41:02.503955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.503915    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" podUID="8c3c5387-3c1e-43a0-a656-041051292ea5" containerName="manager" containerID="cri-o://496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b" gracePeriod=10
Sep 12 00:41:02.758035 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.757996    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 00:41:02.763273 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.763247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.765194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.765170    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:41:02.773359 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.773336    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 00:41:02.877076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.877046    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf7r4\" (UniqueName: \"kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4\") pod \"8c3c5387-3c1e-43a0-a656-041051292ea5\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") "
Sep 12 00:41:02.877251 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.877154    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume\") pod \"8c3c5387-3c1e-43a0-a656-041051292ea5\" (UID: \"8c3c5387-3c1e-43a0-a656-041051292ea5\") "
Sep 12 00:41:02.877370 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.877353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpvc7\" (UniqueName: \"kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.877441 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.877403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.877589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.877566    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c3c5387-3c1e-43a0-a656-041051292ea5" (UID: "8c3c5387-3c1e-43a0-a656-041051292ea5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:41:02.879061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.879036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4" (OuterVolumeSpecName: "kube-api-access-kf7r4") pod "8c3c5387-3c1e-43a0-a656-041051292ea5" (UID: "8c3c5387-3c1e-43a0-a656-041051292ea5"). InnerVolumeSpecName "kube-api-access-kf7r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:41:02.978450 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.978412    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpvc7\" (UniqueName: \"kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.978450 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.978457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.978648 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.978558    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c3c5387-3c1e-43a0-a656-041051292ea5-extensions-socket-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:41:02.978648 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.978573    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf7r4\" (UniqueName: \"kubernetes.io/projected/8c3c5387-3c1e-43a0-a656-041051292ea5-kube-api-access-kf7r4\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:41:02.978894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.978877    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:02.988452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:02.988424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpvc7\" (UniqueName: \"kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d5ktr\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:03.074156 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.074054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:03.365851 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.365827    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 00:41:03.367801 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:41:03.367774    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85fa46e_bd84_4026_8424_7de26e7bb0b3.slice/crio-e14fe80e2072090ac64534b2752b426d5919dcf70baac8d96ef4cb3035330974 WatchSource:0}: Error finding container e14fe80e2072090ac64534b2752b426d5919dcf70baac8d96ef4cb3035330974: Status 404 returned error can't find the container with id e14fe80e2072090ac64534b2752b426d5919dcf70baac8d96ef4cb3035330974
Sep 12 00:41:03.492274 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.492242    2556 generic.go:356] "Generic (PLEG): container finished" podID="8c3c5387-3c1e-43a0-a656-041051292ea5" containerID="496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b" exitCode=0
Sep 12 00:41:03.492671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.492294    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"
Sep 12 00:41:03.492671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.492324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" event={"ID":"8c3c5387-3c1e-43a0-a656-041051292ea5","Type":"ContainerDied","Data":"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"}
Sep 12 00:41:03.492671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.492383    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp" event={"ID":"8c3c5387-3c1e-43a0-a656-041051292ea5","Type":"ContainerDied","Data":"621910006ac4cb88ac6e23f2c822aa8103fa5a95d33d2d6dcfa20e8157327be4"}
Sep 12 00:41:03.492671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.492416    2556 scope.go:117] "RemoveContainer" containerID="496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"
Sep 12 00:41:03.494280 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.494251    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerStarted","Data":"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"}
Sep 12 00:41:03.494409 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.494304    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerStarted","Data":"e14fe80e2072090ac64534b2752b426d5919dcf70baac8d96ef4cb3035330974"}
Sep 12 00:41:03.494409 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.494387    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:03.502857 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.502842    2556 scope.go:117] "RemoveContainer" containerID="496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"
Sep 12 00:41:03.503114 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:41:03.503095    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b\": container with ID starting with 496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b not found: ID does not exist" containerID="496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"
Sep 12 00:41:03.503170 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.503121    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b"} err="failed to get container status \"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b\": rpc error: code = NotFound desc = could not find container \"496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b\": container with ID starting with 496c8fed3729a41ef6edfe9196868deeef52752359124eeb127945fadc68070b not found: ID does not exist"
Sep 12 00:41:03.523632 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.523587    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" podStartSLOduration=1.5235754400000001 podStartE2EDuration="1.52357544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:41:03.522549485 +0000 UTC m=+716.573135090" watchObservedRunningTime="2026-09-12 00:41:03.52357544 +0000 UTC m=+716.574161119"
Sep 12 00:41:03.545175 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.545151    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:41:03.548829 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:03.548806    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ncvmp"]
Sep 12 00:41:05.453703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:05.453671    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c3c5387-3c1e-43a0-a656-041051292ea5" path="/var/lib/kubelet/pods/8c3c5387-3c1e-43a0-a656-041051292ea5/volumes"
Sep 12 00:41:14.503214 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.503185    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:41:14.557390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.557361    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:41:14.557568 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.557545    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" podUID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" containerName="manager" containerID="cri-o://e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08" gracePeriod=10
Sep 12 00:41:14.800618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.800593    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:41:14.893279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.893255    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxgtm\" (UniqueName: \"kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm\") pod \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") "
Sep 12 00:41:14.893424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.893299    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume\") pod \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\" (UID: \"4196a5c9-b0b4-476a-9377-97f9c7c1baf2\") "
Sep 12 00:41:14.893689 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.893660    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4196a5c9-b0b4-476a-9377-97f9c7c1baf2" (UID: "4196a5c9-b0b4-476a-9377-97f9c7c1baf2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:41:14.895236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.895217    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm" (OuterVolumeSpecName: "kube-api-access-jxgtm") pod "4196a5c9-b0b4-476a-9377-97f9c7c1baf2" (UID: "4196a5c9-b0b4-476a-9377-97f9c7c1baf2"). InnerVolumeSpecName "kube-api-access-jxgtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:41:14.993867 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.993842    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-extensions-socket-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:41:14.993867 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:14.993863    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxgtm\" (UniqueName: \"kubernetes.io/projected/4196a5c9-b0b4-476a-9377-97f9c7c1baf2-kube-api-access-jxgtm\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:41:15.559607 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.559574    2556 generic.go:356] "Generic (PLEG): container finished" podID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" containerID="e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08" exitCode=0
Sep 12 00:41:15.559987 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.559620    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"
Sep 12 00:41:15.559987 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.559631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" event={"ID":"4196a5c9-b0b4-476a-9377-97f9c7c1baf2","Type":"ContainerDied","Data":"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"}
Sep 12 00:41:15.559987 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.559671    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf" event={"ID":"4196a5c9-b0b4-476a-9377-97f9c7c1baf2","Type":"ContainerDied","Data":"d79b446750b1fafff6b84bccfd25cf100a954580508177e558ee2076706d66f8"}
Sep 12 00:41:15.559987 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.559693    2556 scope.go:117] "RemoveContainer" containerID="e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"
Sep 12 00:41:15.568497 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.568479    2556 scope.go:117] "RemoveContainer" containerID="e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"
Sep 12 00:41:15.568732 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:41:15.568717    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08\": container with ID starting with e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08 not found: ID does not exist" containerID="e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"
Sep 12 00:41:15.568824 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.568738    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08"} err="failed to get container status \"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08\": rpc error: code = NotFound desc = could not find container \"e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08\": container with ID starting with e50f90db5660a95ac8b2e652908ac73d047e6bd308154fdef42364adcc7c0b08 not found: ID does not exist"
Sep 12 00:41:15.578941 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.578914    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:41:15.581211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:15.581187    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4vzxf"]
Sep 12 00:41:17.454278 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:17.454249    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" path="/var/lib/kubelet/pods/4196a5c9-b0b4-476a-9377-97f9c7c1baf2/volumes"
Sep 12 00:41:35.881220 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881179    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:41:35.881858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881838    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" containerName="manager"
Sep 12 00:41:35.881945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881860    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" containerName="manager"
Sep 12 00:41:35.881945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881872    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3c5387-3c1e-43a0-a656-041051292ea5" containerName="manager"
Sep 12 00:41:35.881945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881880    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3c5387-3c1e-43a0-a656-041051292ea5" containerName="manager"
Sep 12 00:41:35.882093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881977    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4196a5c9-b0b4-476a-9377-97f9c7c1baf2" containerName="manager"
Sep 12 00:41:35.882093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.881992    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3c5387-3c1e-43a0-a656-041051292ea5" containerName="manager"
Sep 12 00:41:35.884989 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.884969    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:35.887247 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.887226    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 12 00:41:35.887380 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.887340    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mhmr6\""
Sep 12 00:41:35.892708 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.892690    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:41:35.919675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.919645    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:41:35.970986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.970962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c77c24a-ee36-4816-861b-8deaa0d10f60-config-file\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:35.971137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:35.970993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/5c77c24a-ee36-4816-861b-8deaa0d10f60-kube-api-access-lbplb\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.072065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.072028    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c77c24a-ee36-4816-861b-8deaa0d10f60-config-file\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.072235 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.072069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/5c77c24a-ee36-4816-861b-8deaa0d10f60-kube-api-access-lbplb\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.072644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.072623    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c77c24a-ee36-4816-861b-8deaa0d10f60-config-file\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.082076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.082052    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/5c77c24a-ee36-4816-861b-8deaa0d10f60-kube-api-access-lbplb\") pod \"limitador-limitador-84994f7ffc-xxslp\" (UID: \"5c77c24a-ee36-4816-861b-8deaa0d10f60\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.196512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.196483    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:36.466272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.466247    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:41:36.467324 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:41:36.467301    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c77c24a_ee36_4816_861b_8deaa0d10f60.slice/crio-aa9b0bed1a4fad29728f7c6cb3e48516449b8c2e3d66b29a2b4f86443ae88025 WatchSource:0}: Error finding container aa9b0bed1a4fad29728f7c6cb3e48516449b8c2e3d66b29a2b4f86443ae88025: Status 404 returned error can't find the container with id aa9b0bed1a4fad29728f7c6cb3e48516449b8c2e3d66b29a2b4f86443ae88025
Sep 12 00:41:36.679846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:36.679809    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp" event={"ID":"5c77c24a-ee36-4816-861b-8deaa0d10f60","Type":"ContainerStarted","Data":"aa9b0bed1a4fad29728f7c6cb3e48516449b8c2e3d66b29a2b4f86443ae88025"}
Sep 12 00:41:37.687289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:37.687255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp" event={"ID":"5c77c24a-ee36-4816-861b-8deaa0d10f60","Type":"ContainerStarted","Data":"883c9beb1ae5a27947bd5223c110ebe60e3f34f0206555bd8ce0aa33d8ac99e5"}
Sep 12 00:41:37.687715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:37.687386    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:41:37.703464 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:37.703362    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp" podStartSLOduration=1.7321570739999999 podStartE2EDuration="2.703348981s" totalImagesPullingTime="971.191907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:41:37.701953642 +0000 UTC m=+750.752539253" watchObservedRunningTime="2026-09-12 00:41:37.703348981 +0000 UTC m=+750.753934588"
Sep 12 00:41:48.693427 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:41:48.693397    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xxslp"
Sep 12 00:42:49.469159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.469128    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"]
Sep 12 00:42:49.472843 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.472824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.475536 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.475509    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jdlqj\""
Sep 12 00:42:49.475703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.475540    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 12 00:42:49.483200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.482792    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"]
Sep 12 00:42:49.533620 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.533590    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:42:49.616938 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.616906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5691c147-e9ef-4611-ad61-f70a23b92017-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.616938 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.616938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklf2\" (UniqueName: \"kubernetes.io/projected/5691c147-e9ef-4611-ad61-f70a23b92017-kube-api-access-dklf2\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.717941 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.717910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5691c147-e9ef-4611-ad61-f70a23b92017-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.717941 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.717942    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklf2\" (UniqueName: \"kubernetes.io/projected/5691c147-e9ef-4611-ad61-f70a23b92017-kube-api-access-dklf2\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.718700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.718673    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5691c147-e9ef-4611-ad61-f70a23b92017-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.725774 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.725708    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklf2\" (UniqueName: \"kubernetes.io/projected/5691c147-e9ef-4611-ad61-f70a23b92017-kube-api-access-dklf2\") pod \"payload-processing-5b54b7fbb7-p4mlv\" (UID: \"5691c147-e9ef-4611-ad61-f70a23b92017\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:49.787913 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:49.787877    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:50.056911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:50.056777    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"]
Sep 12 00:42:50.059271 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:42:50.059241    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5691c147_e9ef_4611_ad61_f70a23b92017.slice/crio-ad9f3ff8161a9d0e936fe0c0a8b38e7fdfc56a570f9f085e206615cf944798bc WatchSource:0}: Error finding container ad9f3ff8161a9d0e936fe0c0a8b38e7fdfc56a570f9f085e206615cf944798bc: Status 404 returned error can't find the container with id ad9f3ff8161a9d0e936fe0c0a8b38e7fdfc56a570f9f085e206615cf944798bc
Sep 12 00:42:50.092749 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:50.092722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv" event={"ID":"5691c147-e9ef-4611-ad61-f70a23b92017","Type":"ContainerStarted","Data":"ad9f3ff8161a9d0e936fe0c0a8b38e7fdfc56a570f9f085e206615cf944798bc"}
Sep 12 00:42:52.105075 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:52.105038    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv" event={"ID":"5691c147-e9ef-4611-ad61-f70a23b92017","Type":"ContainerStarted","Data":"4b4a35cebebdf902be86efacce86e27d4882a0216eda48b66c3ef7ec88414aca"}
Sep 12 00:42:52.105436 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:52.105110    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:42:52.123423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:42:52.123376    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv" podStartSLOduration=1.903216836 podStartE2EDuration="3.123362667s" totalImagesPullingTime="1.220145831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:42:52.122084242 +0000 UTC m=+825.172669854" watchObservedRunningTime="2026-09-12 00:42:52.123362667 +0000 UTC m=+825.173948273"
Sep 12 00:43:03.114451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:43:03.114416    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-p4mlv"
Sep 12 00:43:13.108176 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:43:13.108141    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:43:25.409520 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:43:25.409490    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:43:48.905921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:43:48.905888    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:44:09.810442 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:44:09.810400    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:44:25.210863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:44:25.210826    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:44:35.215696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:44:35.215663    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:44:48.914175 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:44:48.914143    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:45:00.133880 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.133838    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"]
Sep 12 00:45:00.137730 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.137706    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"
Sep 12 00:45:00.140373 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.140350    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sj5jt\""
Sep 12 00:45:00.143796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.143771    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"]
Sep 12 00:45:00.149151 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.149133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"
Sep 12 00:45:00.420002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.419974    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"]
Sep 12 00:45:00.421474 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:45:00.421450    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2511b109_ded5_470f_8bae_34e3ffeba78e.slice/crio-a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9 WatchSource:0}: Error finding container a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9: Status 404 returned error can't find the container with id a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9
Sep 12 00:45:00.423646 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.423628    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:45:00.817388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:00.817298    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd" event={"ID":"2511b109-ded5-470f-8bae-34e3ffeba78e","Type":"ContainerStarted","Data":"a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9"}
Sep 12 00:45:03.838967 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:03.838930    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd" event={"ID":"2511b109-ded5-470f-8bae-34e3ffeba78e","Type":"ContainerStarted","Data":"32917647e0e7870b76ddaf95a8feb8df7cdc71146946b6d9fc6b6908f84c5e5a"}
Sep 12 00:45:03.854875 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:03.854809    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd" podStartSLOduration=1.327059773 podStartE2EDuration="3.854788001s" totalImagesPullingTime="2.527728228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:03.853015658 +0000 UTC m=+956.903601264" watchObservedRunningTime="2026-09-12 00:45:03.854788001 +0000 UTC m=+956.905373610"
Sep 12 00:45:04.846394 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:04.846361    2556 generic.go:356] "Generic (PLEG): container finished" podID="2511b109-ded5-470f-8bae-34e3ffeba78e" containerID="32917647e0e7870b76ddaf95a8feb8df7cdc71146946b6d9fc6b6908f84c5e5a" exitCode=0
Sep 12 00:45:04.846777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:04.846454    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd" event={"ID":"2511b109-ded5-470f-8bae-34e3ffeba78e","Type":"ContainerDied","Data":"32917647e0e7870b76ddaf95a8feb8df7cdc71146946b6d9fc6b6908f84c5e5a"}
Sep 12 00:45:05.989401 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:05.989378    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"
Sep 12 00:45:06.858546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:06.858520    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd"
Sep 12 00:45:06.858742 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:06.858512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819565-xjhgd" event={"ID":"2511b109-ded5-470f-8bae-34e3ffeba78e","Type":"ContainerDied","Data":"a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9"}
Sep 12 00:45:06.858742 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:45:06.858646    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9896ee8f2cbea67b236e271e5554bb1b3197be924a2e877fa1344c1398653c9"
Sep 12 00:46:07.544281 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.544238    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 00:46:07.544850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.544828    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2511b109-ded5-470f-8bae-34e3ffeba78e" containerName="cleanup"
Sep 12 00:46:07.544850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.544845    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2511b109-ded5-470f-8bae-34e3ffeba78e" containerName="cleanup"
Sep 12 00:46:07.544980 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.544935    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2511b109-ded5-470f-8bae-34e3ffeba78e" containerName="cleanup"
Sep 12 00:46:07.548305 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.548284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.551354 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.551017    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-4d485e-openshift-default-dockercfg-67crs\""
Sep 12 00:46:07.560148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.560108    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 00:46:07.613218 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.613185    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:46:07.617893 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.617872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.621576 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.621557    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-81df64-openshift-default-dockercfg-s7hr8\""
Sep 12 00:46:07.629321 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.629295    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:46:07.670164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670238    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670266    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5gn9\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670499    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmlt\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670605 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670605 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670605 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670698 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670698 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670646    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670698 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.670812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.670812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.670719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.771737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.771737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771738    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmlt\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771766    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771945    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771974    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.771997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772022    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5gn9\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772195    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772872 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772549    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.772872 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772655    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.772973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.772906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.773174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.773152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.773301 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.773270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.773363 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.773323    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.773796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.773733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.774240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.774202    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.774613 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.774582    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.774828 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.774808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.775345 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.775323    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.776454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.776438    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.777022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.777003    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.781031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.781009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.781330 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.781315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmlt\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.786385 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.786362    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token\") pod \"e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") " pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.786510 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.786491    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5gn9\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9\") pod \"e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") " pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:07.865460 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.865388    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:07.933218 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:07.933186    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:08.150545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:08.150509    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 00:46:08.151896 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:08.151866    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3f2947_7af1_41fb_ab15_180891263b55.slice/crio-c8c19f10cacca0d1018aa8a15d26b41b69da1cfa5759400177fc133efbd8f15b WatchSource:0}: Error finding container c8c19f10cacca0d1018aa8a15d26b41b69da1cfa5759400177fc133efbd8f15b: Status 404 returned error can't find the container with id c8c19f10cacca0d1018aa8a15d26b41b69da1cfa5759400177fc133efbd8f15b
Sep 12 00:46:08.209029 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:08.209003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerStarted","Data":"c8c19f10cacca0d1018aa8a15d26b41b69da1cfa5759400177fc133efbd8f15b"}
Sep 12 00:46:08.215292 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:08.215186    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:46:08.217746 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:08.217722    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6957fd_6162_4202_b2b0_2a78ec730902.slice/crio-34049ad532e89f2b84f6a8f29e7292a62012a31a34cb8bacdbd32cb7442eef57 WatchSource:0}: Error finding container 34049ad532e89f2b84f6a8f29e7292a62012a31a34cb8bacdbd32cb7442eef57: Status 404 returned error can't find the container with id 34049ad532e89f2b84f6a8f29e7292a62012a31a34cb8bacdbd32cb7442eef57
Sep 12 00:46:09.216621 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:09.216584    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerStarted","Data":"34049ad532e89f2b84f6a8f29e7292a62012a31a34cb8bacdbd32cb7442eef57"}
Sep 12 00:46:10.429660 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.429558    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:46:10.996245 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.996210    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:10.996351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.996293    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:10.996417 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.996360    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:10.996944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.996919    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:10.996988 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.996975    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:10.997027 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:10.997003    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:11.234620 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.234472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerStarted","Data":"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"}
Sep 12 00:46:11.236734 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.236677    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerStarted","Data":"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"}
Sep 12 00:46:11.280268 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.280165    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podStartSLOduration=1.4381462790000001 podStartE2EDuration="4.280146408s" totalImagesPullingTime="2.842000129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:11.278692901 +0000 UTC m=+1024.329278534" watchObservedRunningTime="2026-09-12 00:46:11.280146408 +0000 UTC m=+1024.330732016"
Sep 12 00:46:11.280462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.280313    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podStartSLOduration=1.503353257 podStartE2EDuration="4.280305273s" totalImagesPullingTime="2.776952016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:11.259449556 +0000 UTC m=+1024.310035192" watchObservedRunningTime="2026-09-12 00:46:11.280305273 +0000 UTC m=+1024.330890881"
Sep 12 00:46:11.866422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.866385    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:11.935254 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:11.935219    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:12.871318 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:12.871286    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:12.939902 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:12.939877    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:13.247934 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:13.247898    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:13.248145 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:13.248108    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:13.248964 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:13.248946    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:13.249073 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:13.248993    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:15.347449 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.347417    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:46:15.351287 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.351266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.353986 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.353961    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 12 00:46:15.354118 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.354062    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 00:46:15.354975 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.354958    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-4d485e-serving-cert\""
Sep 12 00:46:15.355254 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.355001    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 12 00:46:15.355378 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.355022    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9r9zt\""
Sep 12 00:46:15.366785 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.365653    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:46:15.469108 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.469073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.469324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.469186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.469324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.469225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mclnb\" (UniqueName: \"kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.469324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.469316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.570853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.570812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mclnb\" (UniqueName: \"kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.571013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.570906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.571013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.570971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.571135 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.571033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.571196 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:15.571155    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-serving-cert: secret "maas-api-e2e-worker-w0-4d485e-serving-cert" not found
Sep 12 00:46:15.571253 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:15.571237    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls podName:786b6a58-2b9d-4bf3-8318-07b9db9ad2ec nodeName:}" failed. No retries permitted until 2026-09-12 00:46:16.071215004 +0000 UTC m=+1029.121800608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls") pod "maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" (UID: "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec") : secret "maas-api-e2e-worker-w0-4d485e-serving-cert" not found
Sep 12 00:46:15.571639 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.571614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.573513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.573491    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:15.579894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:15.579870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mclnb\" (UniqueName: \"kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:16.076324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.076282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:16.079454 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.079422    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:16.244520 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.244485    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:46:16.249046 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.249019    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.251476 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.251450    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-81df64-serving-cert\""
Sep 12 00:46:16.266878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.264073    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:46:16.268030 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.268009    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:16.379616 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.379581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9sks\" (UniqueName: \"kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.380022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.379634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.380022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.379664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.380022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.379770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.480577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.480536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.480780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.480600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.480780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.480662    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9sks\" (UniqueName: \"kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.480780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.480683    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.481252 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.481226    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.483162 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.483139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.483242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.483139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.488466 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.488441    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9sks\" (UniqueName: \"kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks\") pod \"maas-api-e2e-inf-a-81df64-f849694fb-ff4km\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.548847 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.548811    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:46:16.549830 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:16.549806    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786b6a58_2b9d_4bf3_8318_07b9db9ad2ec.slice/crio-5c858b97cada96f5deba983494ff1664cb53bd6717ab3bd8e981cae26e7799ad WatchSource:0}: Error finding container 5c858b97cada96f5deba983494ff1664cb53bd6717ab3bd8e981cae26e7799ad: Status 404 returned error can't find the container with id 5c858b97cada96f5deba983494ff1664cb53bd6717ab3bd8e981cae26e7799ad
Sep 12 00:46:16.569483 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.569236    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:16.849184 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:16.849132    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0188a33_ce01_4884_bde2_428a5d7028f2.slice/crio-4a77f0f1718857e59155957da0e00aa9c52eff07c9936fa94517893e5de83663 WatchSource:0}: Error finding container 4a77f0f1718857e59155957da0e00aa9c52eff07c9936fa94517893e5de83663: Status 404 returned error can't find the container with id 4a77f0f1718857e59155957da0e00aa9c52eff07c9936fa94517893e5de83663
Sep 12 00:46:16.849496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.849470    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:46:16.963628 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.963593    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:46:16.968533 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.968510    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:16.971345 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.971322    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-81df64-dockercfg-l5hnt\""
Sep 12 00:46:16.971345 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.971340    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-81df64\""
Sep 12 00:46:16.979656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:16.979067    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:46:17.085975 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.085704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqqg5\" (UniqueName: \"kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.085975 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.085859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.187307 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.187270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.187489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.187389    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqqg5\" (UniqueName: \"kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.188384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.188331    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.197493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.197445    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqqg5\" (UniqueName: \"kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5\") pod \"payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.284705 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.284466    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:17.286859 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.286775    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" event={"ID":"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec","Type":"ContainerStarted","Data":"5c858b97cada96f5deba983494ff1664cb53bd6717ab3bd8e981cae26e7799ad"}
Sep 12 00:46:17.296108 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.296037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" event={"ID":"c0188a33-ce01-4884-bde2-428a5d7028f2","Type":"ContainerStarted","Data":"4a77f0f1718857e59155957da0e00aa9c52eff07c9936fa94517893e5de83663"}
Sep 12 00:46:17.597211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:17.597127    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:46:17.602018 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:17.601988    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba285b5_d30a_40a2_a264_d9705458495f.slice/crio-5c4fbbcf9f4340eba6383fb18ee132ca91e0ea683d692960ed1cc6fc61b40d9b WatchSource:0}: Error finding container 5c4fbbcf9f4340eba6383fb18ee132ca91e0ea683d692960ed1cc6fc61b40d9b: Status 404 returned error can't find the container with id 5c4fbbcf9f4340eba6383fb18ee132ca91e0ea683d692960ed1cc6fc61b40d9b
Sep 12 00:46:18.311138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:18.311096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" event={"ID":"5ba285b5-d30a-40a2-a264-d9705458495f","Type":"ContainerStarted","Data":"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"}
Sep 12 00:46:18.311315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:18.311198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" event={"ID":"5ba285b5-d30a-40a2-a264-d9705458495f","Type":"ContainerStarted","Data":"5c4fbbcf9f4340eba6383fb18ee132ca91e0ea683d692960ed1cc6fc61b40d9b"}
Sep 12 00:46:18.311995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:18.311931    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:18.330949 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:18.330674    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" podStartSLOduration=2.33065438 podStartE2EDuration="2.33065438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:18.327379133 +0000 UTC m=+1031.377964752" watchObservedRunningTime="2026-09-12 00:46:18.33065438 +0000 UTC m=+1031.381239988"
Sep 12 00:46:20.331262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.331212    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" event={"ID":"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec","Type":"ContainerStarted","Data":"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"}
Sep 12 00:46:20.331736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.331421    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:20.333346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.333314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" event={"ID":"c0188a33-ce01-4884-bde2-428a5d7028f2","Type":"ContainerStarted","Data":"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"}
Sep 12 00:46:20.354462 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.354398    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" podStartSLOduration=2.318695759 podStartE2EDuration="5.35437789s" totalImagesPullingTime="3.035682131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:20.352064482 +0000 UTC m=+1033.402650125" watchObservedRunningTime="2026-09-12 00:46:20.35437789 +0000 UTC m=+1033.404963497"
Sep 12 00:46:20.370453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.370398    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" podStartSLOduration=1.628413096 podStartE2EDuration="4.370381998s" totalImagesPullingTime="2.741968902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:20.368252559 +0000 UTC m=+1033.418838167" watchObservedRunningTime="2026-09-12 00:46:20.370381998 +0000 UTC m=+1033.420967605"
Sep 12 00:46:20.831077 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:20.831045    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:46:21.338911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:21.338877    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:23.073047 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.073002    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:23.091780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.089940    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:23.091780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.090073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.101464 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.101438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-220bac51-serving-cert\""
Sep 12 00:46:23.261781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.259234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btth8\" (UniqueName: \"kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.261781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.259300    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.261781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.259431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.261781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.259457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.360961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.360858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.360961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.360912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.361205 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.360961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btth8\" (UniqueName: \"kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.361205 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.361010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.361205 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:23.361028    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-serving-cert: secret "maas-api-e2e-ait-220bac51-serving-cert" not found
Sep 12 00:46:23.361205 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:23.361106    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls podName:6df0f53f-d82f-431f-8a13-691001d3d229 nodeName:}" failed. No retries permitted until 2026-09-12 00:46:23.861083363 +0000 UTC m=+1036.911668962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls") pod "maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229") : secret "maas-api-e2e-ait-220bac51-serving-cert" not found
Sep 12 00:46:23.361841 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.361815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.365180 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.365156    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.369684 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.369661    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btth8\" (UniqueName: \"kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.869958 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:23.869919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:23.870363 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:23.870343    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-serving-cert: secret "maas-api-e2e-ait-220bac51-serving-cert" not found
Sep 12 00:46:23.870529 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:23.870518    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls podName:6df0f53f-d82f-431f-8a13-691001d3d229 nodeName:}" failed. No retries permitted until 2026-09-12 00:46:24.870495498 +0000 UTC m=+1037.921081099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls") pod "maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229") : secret "maas-api-e2e-ait-220bac51-serving-cert" not found
Sep 12 00:46:24.920726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:24.920540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:24.923133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:24.923102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:24.939285 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:24.939264    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:25.264833 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.263933    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:25.278737 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:25.275224    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df0f53f_d82f_431f_8a13_691001d3d229.slice/crio-e9c3a9c1e801a54ba23d2367ef54ea676d95bbc6bdb9cc90d22c5d7ffc676797 WatchSource:0}: Error finding container e9c3a9c1e801a54ba23d2367ef54ea676d95bbc6bdb9cc90d22c5d7ffc676797: Status 404 returned error can't find the container with id e9c3a9c1e801a54ba23d2367ef54ea676d95bbc6bdb9cc90d22c5d7ffc676797
Sep 12 00:46:25.397862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.394041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" event={"ID":"6df0f53f-d82f-431f-8a13-691001d3d229","Type":"ContainerStarted","Data":"e9c3a9c1e801a54ba23d2367ef54ea676d95bbc6bdb9cc90d22c5d7ffc676797"}
Sep 12 00:46:25.671777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.668167    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:46:25.681796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.678317    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.685052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.683368    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-4b6ed7-dockercfg-mx46k\""
Sep 12 00:46:25.685052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.683655    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-4b6ed7\""
Sep 12 00:46:25.722734 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.722707    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:46:25.835546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.835506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7cz4\" (UniqueName: \"kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.835714 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.835618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.936264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.936231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.936626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.936289    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7cz4\" (UniqueName: \"kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.936957 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.936940    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:25.951260 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:25.951235    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7cz4\" (UniqueName: \"kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4\") pod \"payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:26.015923 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.015890    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:26.344502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.344426    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:46:26.353788 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.353730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:46:26.354633 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:26.354601    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654c3799_ee67_4950_9faa_6551ebac9e34.slice/crio-460064fd97e398b537e6d06ce8af1a75be63066ce2d06386e4fcf7309e72a47b WatchSource:0}: Error finding container 460064fd97e398b537e6d06ce8af1a75be63066ce2d06386e4fcf7309e72a47b: Status 404 returned error can't find the container with id 460064fd97e398b537e6d06ce8af1a75be63066ce2d06386e4fcf7309e72a47b
Sep 12 00:46:26.417600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.413833    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" event={"ID":"6df0f53f-d82f-431f-8a13-691001d3d229","Type":"ContainerStarted","Data":"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"}
Sep 12 00:46:26.417600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.414692    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:26.421787 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.419388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" event={"ID":"654c3799-ee67-4950-9faa-6551ebac9e34","Type":"ContainerStarted","Data":"460064fd97e398b537e6d06ce8af1a75be63066ce2d06386e4fcf7309e72a47b"}
Sep 12 00:46:26.433988 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:26.433913    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" podStartSLOduration=3.104166631 podStartE2EDuration="3.433899362s" totalImagesPullingTime="329.732731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:26.431975196 +0000 UTC m=+1039.482560802" watchObservedRunningTime="2026-09-12 00:46:26.433899362 +0000 UTC m=+1039.484484969"
Sep 12 00:46:27.350354 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:27.350328    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:46:27.430669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:27.430621    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" event={"ID":"654c3799-ee67-4950-9faa-6551ebac9e34","Type":"ContainerStarted","Data":"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"}
Sep 12 00:46:27.430863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:27.430701    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:27.447782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:27.447728    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" podStartSLOduration=2.44771406 podStartE2EDuration="2.44771406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:27.445672233 +0000 UTC m=+1040.496257842" watchObservedRunningTime="2026-09-12 00:46:27.44771406 +0000 UTC m=+1040.498299669"
Sep 12 00:46:29.289970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:29.289915    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 00:46:29.290400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:29.289996    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 00:46:30.335811 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:30.335741    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:46:31.462781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.462737    2556 generic.go:356] "Generic (PLEG): container finished" podID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerID="4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625" exitCode=0
Sep 12 00:46:31.463270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.462819    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerDied","Data":"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"}
Sep 12 00:46:31.463338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.463278    2556 scope.go:117] "RemoveContainer" containerID="4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"
Sep 12 00:46:31.465888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.465860    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:31.465980 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.465924    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:31.465980 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:31.465972    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:32.475372 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.475324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerStarted","Data":"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"}
Sep 12 00:46:32.490375 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.490337    2556 generic.go:356] "Generic (PLEG): container finished" podID="ec3f2947-7af1-41fb-ab15-180891263b55" containerID="ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6" exitCode=0
Sep 12 00:46:32.490539 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.490406    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerDied","Data":"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"}
Sep 12 00:46:32.491064 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.491045    2556 scope.go:117] "RemoveContainer" containerID="ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"
Sep 12 00:46:32.493237 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.493210    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:32.493290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.493275    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:32.493339 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.493305    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:32.935250 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.935219    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:32.935451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.935371    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 12 00:46:32.935451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:32.935424    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 12 00:46:33.444093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.444067    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:33.514783 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.510859    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerStarted","Data":"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"}
Sep 12 00:46:33.865736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.865647    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:33.866100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.866074    2556 patch_prober.go:28] interesting pod/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:46:33.866172 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.866130    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 12 00:46:33.934781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.934729    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 12 00:46:33.934942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:33.934819    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 12 00:46:34.866346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:34.866303    2556 patch_prober.go:28] interesting pod/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:46:34.866896 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:34.866374    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 12 00:46:34.935156 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:34.935118    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 12 00:46:34.935320 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:34.935214    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 12 00:46:35.866399 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:35.866361    2556 patch_prober.go:28] interesting pod/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:46:35.867059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:35.867014    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 12 00:46:35.934809 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:35.934777    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 12 00:46:35.935026 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:35.935004    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 12 00:46:36.866174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:36.866128    2556 patch_prober.go:28] interesting pod/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:46:36.866367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:36.866215    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 12 00:46:36.935270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:36.935227    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 12 00:46:36.935664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:36.935317    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 12 00:46:37.865968 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:37.865932    2556 patch_prober.go:28] interesting pod/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:46:37.866256 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:37.866227    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 12 00:46:37.953091 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:37.953056    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:37.953652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:37.953634    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:37.959223 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:37.959195    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:46:38.440322 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:38.440292    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:46:38.871137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:38.871067    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:38.871473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:38.871441    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:38.872222 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:38.872202    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:46:40.562938 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.562904    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:46:40.568845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.568820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.571123 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.571098    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:46:40.572012 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.571992    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bb6e74-serving-cert\""
Sep 12 00:46:40.591578 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.591539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.591686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.591576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcz4f\" (UniqueName: \"kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.591686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.591633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.591807 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.591696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.692840 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.692809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.692840 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.692844    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcz4f\" (UniqueName: \"kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.693100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.692873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.693100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.692905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.693100 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:40.692994    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-serving-cert: secret "maas-api-e2e-inf-b-bb6e74-serving-cert" not found
Sep 12 00:46:40.693100 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:40.693086    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls podName:ea527749-7daa-440c-bd47-89f4b39c0c96 nodeName:}" failed. No retries permitted until 2026-09-12 00:46:41.19306444 +0000 UTC m=+1054.243650045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls") pod "maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96") : secret "maas-api-e2e-inf-b-bb6e74-serving-cert" not found
Sep 12 00:46:40.693561 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.693542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.695219 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.695198    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:40.701236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:40.701216    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcz4f\" (UniqueName: \"kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:41.197485 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:41.197449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:41.197652 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:41.197594    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-serving-cert: secret "maas-api-e2e-inf-b-bb6e74-serving-cert" not found
Sep 12 00:46:41.197696 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:41.197671    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls podName:ea527749-7daa-440c-bd47-89f4b39c0c96 nodeName:}" failed. No retries permitted until 2026-09-12 00:46:42.197655868 +0000 UTC m=+1055.248241453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls") pod "maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96") : secret "maas-api-e2e-inf-b-bb6e74-serving-cert" not found
Sep 12 00:46:42.208063 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:42.208024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:42.210579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:42.210548    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:42.381206 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:42.381164    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:42.541700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:42.541625    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:46:42.651074 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:42.651045    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:46:42.651957 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:42.651927    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea527749_7daa_440c_bd47_89f4b39c0c96.slice/crio-3e93a239450db69b8ebcfc2c10bcf9788c9c363b53ff22e20034e3460c5729ef WatchSource:0}: Error finding container 3e93a239450db69b8ebcfc2c10bcf9788c9c363b53ff22e20034e3460c5729ef: Status 404 returned error can't find the container with id 3e93a239450db69b8ebcfc2c10bcf9788c9c363b53ff22e20034e3460c5729ef
Sep 12 00:46:43.580899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:43.580861    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" event={"ID":"ea527749-7daa-440c-bd47-89f4b39c0c96","Type":"ContainerStarted","Data":"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"}
Sep 12 00:46:43.581356 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:43.580915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" event={"ID":"ea527749-7daa-440c-bd47-89f4b39c0c96","Type":"ContainerStarted","Data":"3e93a239450db69b8ebcfc2c10bcf9788c9c363b53ff22e20034e3460c5729ef"}
Sep 12 00:46:43.581356 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:43.580995    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:43.596466 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:43.596414    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" podStartSLOduration=3.281233809 podStartE2EDuration="3.596396733s" totalImagesPullingTime="315.162924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:43.596092539 +0000 UTC m=+1056.646678146" watchObservedRunningTime="2026-09-12 00:46:43.596396733 +0000 UTC m=+1056.646982341"
Sep 12 00:46:46.510579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.510545    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:46.511289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.511258    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" podUID="6df0f53f-d82f-431f-8a13-691001d3d229" containerName="maas-api" containerID="cri-o://3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad" gracePeriod=30
Sep 12 00:46:46.761777 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.761707    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:46.852387 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.852355    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btth8\" (UniqueName: \"kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8\") pod \"6df0f53f-d82f-431f-8a13-691001d3d229\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") "
Sep 12 00:46:46.852556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.852476    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs\") pod \"6df0f53f-d82f-431f-8a13-691001d3d229\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") "
Sep 12 00:46:46.852556 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.852530    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca\") pod \"6df0f53f-d82f-431f-8a13-691001d3d229\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") "
Sep 12 00:46:46.852671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.852599    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") pod \"6df0f53f-d82f-431f-8a13-691001d3d229\" (UID: \"6df0f53f-d82f-431f-8a13-691001d3d229\") "
Sep 12 00:46:46.853023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.852976    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6df0f53f-d82f-431f-8a13-691001d3d229" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:46:46.855697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.855658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8" (OuterVolumeSpecName: "kube-api-access-btth8") pod "6df0f53f-d82f-431f-8a13-691001d3d229" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229"). InnerVolumeSpecName "kube-api-access-btth8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:46:46.856221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.856187    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6df0f53f-d82f-431f-8a13-691001d3d229" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:46:46.861325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.861290    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6df0f53f-d82f-431f-8a13-691001d3d229" (UID: "6df0f53f-d82f-431f-8a13-691001d3d229"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:46:46.954670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.954073    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:46:46.954670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.954116    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6df0f53f-d82f-431f-8a13-691001d3d229-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:46:46.954670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.954132    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6df0f53f-d82f-431f-8a13-691001d3d229-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:46:46.954670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:46.954145    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btth8\" (UniqueName: \"kubernetes.io/projected/6df0f53f-d82f-431f-8a13-691001d3d229-kube-api-access-btth8\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:46:47.609023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.608989    2556 generic.go:356] "Generic (PLEG): container finished" podID="6df0f53f-d82f-431f-8a13-691001d3d229" containerID="3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad" exitCode=0
Sep 12 00:46:47.609463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.609054    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"
Sep 12 00:46:47.609463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.609054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" event={"ID":"6df0f53f-d82f-431f-8a13-691001d3d229","Type":"ContainerDied","Data":"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"}
Sep 12 00:46:47.609463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.609215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm" event={"ID":"6df0f53f-d82f-431f-8a13-691001d3d229","Type":"ContainerDied","Data":"e9c3a9c1e801a54ba23d2367ef54ea676d95bbc6bdb9cc90d22c5d7ffc676797"}
Sep 12 00:46:47.609463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.609242    2556 scope.go:117] "RemoveContainer" containerID="3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"
Sep 12 00:46:47.620423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.620352    2556 scope.go:117] "RemoveContainer" containerID="3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"
Sep 12 00:46:47.620835 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:47.620813    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad\": container with ID starting with 3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad not found: ID does not exist" containerID="3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"
Sep 12 00:46:47.620920 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.620843    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad"} err="failed to get container status \"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad\": rpc error: code = NotFound desc = could not find container \"3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad\": container with ID starting with 3a6de770fa204520f921c13be92ee14efcb8f16b4c3f62de14b9dc7b37f304ad not found: ID does not exist"
Sep 12 00:46:47.628402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.628375    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:47.634024 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.634003    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-220bac51-84c5f5979d-p4hrm"]
Sep 12 00:46:47.844204 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.844118    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:46:47.844877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.844851    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df0f53f-d82f-431f-8a13-691001d3d229" containerName="maas-api"
Sep 12 00:46:47.844877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.844877    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df0f53f-d82f-431f-8a13-691001d3d229" containerName="maas-api"
Sep 12 00:46:47.845074 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.844986    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df0f53f-d82f-431f-8a13-691001d3d229" containerName="maas-api"
Sep 12 00:46:47.851988 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.851964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.856027 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.855172    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-723148b6-gw-openshift-default-dockercfg-dqlcs\""
Sep 12 00:46:47.865725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.865697    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:46:47.963230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5wc\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:47.963743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:47.963512    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.064840 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.064840 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064847    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065089 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.064994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065240    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5wc\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065285    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065332    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065646    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.065730 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.065696    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.067515 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.067495    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.067826 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.067808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.073210 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.073185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.074318 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.074298    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5wc\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc\") pod \"e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") " pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.171348 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.171316    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:48.449607 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.449582    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:46:48.450695 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:48.450669    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b9c762_8c17_48d8_8624_e6b92b16aa6b.slice/crio-90d30b05da882b29c5b0935aa6ba230e61dfe5f6186fab6f77567abe14ddaf95 WatchSource:0}: Error finding container 90d30b05da882b29c5b0935aa6ba230e61dfe5f6186fab6f77567abe14ddaf95: Status 404 returned error can't find the container with id 90d30b05da882b29c5b0935aa6ba230e61dfe5f6186fab6f77567abe14ddaf95
Sep 12 00:46:48.453397 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.453367    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:48.453474 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.453429    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:48.453474 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.453455    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:46:48.619983 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.619934    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerStarted","Data":"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"}
Sep 12 00:46:48.620392 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.619998    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerStarted","Data":"90d30b05da882b29c5b0935aa6ba230e61dfe5f6186fab6f77567abe14ddaf95"}
Sep 12 00:46:48.640525 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:48.640467    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podStartSLOduration=1.640449436 podStartE2EDuration="1.640449436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:48.638032029 +0000 UTC m=+1061.688617636" watchObservedRunningTime="2026-09-12 00:46:48.640449436 +0000 UTC m=+1061.691035043"
Sep 12 00:46:49.172393 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.172356    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:49.177901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.177877    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:49.454605 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.454523    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df0f53f-d82f-431f-8a13-691001d3d229" path="/var/lib/kubelet/pods/6df0f53f-d82f-431f-8a13-691001d3d229/volumes"
Sep 12 00:46:49.592514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.592485    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:46:49.626289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.626260    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:49.627289 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:49.627270    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:46:52.039084 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.039043    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:46:52.043293 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.043270    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.045963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.045941    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-723148b6-serving-cert\""
Sep 12 00:46:52.054053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.053692    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:46:52.109166 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.109139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.109335 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.109178    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.109335 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.109220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.109445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.109371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjlx\" (UniqueName: \"kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.210221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.210194    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.210221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.210228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.210473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.210262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.210473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.210317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjlx\" (UniqueName: \"kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.210473 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:52.210437    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-serving-cert: secret "maas-api-e2e-migrate-723148b6-serving-cert" not found
Sep 12 00:46:52.210636 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:46:52.210524    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls podName:8a06249a-bc87-4db3-8213-48037e5119c8 nodeName:}" failed. No retries permitted until 2026-09-12 00:46:52.710503918 +0000 UTC m=+1065.761089517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls") pod "maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" (UID: "8a06249a-bc87-4db3-8213-48037e5119c8") : secret "maas-api-e2e-migrate-723148b6-serving-cert" not found
Sep 12 00:46:52.211019 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.210997    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.212505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.212490    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.218560 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.218539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjlx\" (UniqueName: \"kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.717275 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.717243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.719476 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.719448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") pod \"maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:52.960131 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:52.959863    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:53.230251 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:53.230218    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:46:53.230660 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:46:53.230634    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a06249a_bc87_4db3_8213_48037e5119c8.slice/crio-d5836779a39815995a00fb8dd9ef2f24fc11a066a59e01fa7c9e6bbaa98927b3 WatchSource:0}: Error finding container d5836779a39815995a00fb8dd9ef2f24fc11a066a59e01fa7c9e6bbaa98927b3: Status 404 returned error can't find the container with id d5836779a39815995a00fb8dd9ef2f24fc11a066a59e01fa7c9e6bbaa98927b3
Sep 12 00:46:53.654014 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:53.653975    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" event={"ID":"8a06249a-bc87-4db3-8213-48037e5119c8","Type":"ContainerStarted","Data":"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"}
Sep 12 00:46:53.654390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:53.654031    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" event={"ID":"8a06249a-bc87-4db3-8213-48037e5119c8","Type":"ContainerStarted","Data":"d5836779a39815995a00fb8dd9ef2f24fc11a066a59e01fa7c9e6bbaa98927b3"}
Sep 12 00:46:53.654390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:53.654094    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:46:53.670215 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:53.670164    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" podStartSLOduration=1.365435666 podStartE2EDuration="1.670143834s" totalImagesPullingTime="304.708168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:53.669853424 +0000 UTC m=+1066.720439031" watchObservedRunningTime="2026-09-12 00:46:53.670143834 +0000 UTC m=+1066.720729442"
Sep 12 00:46:58.214802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:58.214765    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:46:59.666102 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:46:59.666076    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:47:08.747862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.747771    2556 generic.go:356] "Generic (PLEG): container finished" podID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerID="76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714" exitCode=0
Sep 12 00:47:08.747862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.747829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerDied","Data":"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"}
Sep 12 00:47:08.748298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.748270    2556 scope.go:117] "RemoveContainer" containerID="76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"
Sep 12 00:47:08.749493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.749465    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:08.749552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.749535    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:08.749586 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:08.749565    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:09.757816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:09.756835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerStarted","Data":"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"}
Sep 12 00:47:10.172403 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:10.172364    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:10.172591 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:10.172490    2556 patch_prober.go:28] interesting pod/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:47:10.172591 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:10.172532    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 12 00:47:11.172502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:11.172465    2556 patch_prober.go:28] interesting pod/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:47:11.173114 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:11.173080    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 12 00:47:12.172298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:12.172250    2556 patch_prober.go:28] interesting pod/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:47:12.172514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:12.172326    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 12 00:47:13.173241 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:13.172788    2556 patch_prober.go:28] interesting pod/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:47:13.173241 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:13.172851    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 12 00:47:14.172360 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:14.172319    2556 patch_prober.go:28] interesting pod/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:47:14.172671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:14.172637    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 12 00:47:15.175872 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:15.175835    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:15.176294 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:15.176113    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:15.176929 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:15.176911    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:15.705737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:15.705704    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:47:21.858069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:21.858032    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:47:21.858519 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:21.858475    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" podUID="8a06249a-bc87-4db3-8213-48037e5119c8" containerName="maas-api" containerID="cri-o://416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b" gracePeriod=30
Sep 12 00:47:22.113228 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.113171    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:47:22.182396 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.182365    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:47:22.182649 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.182622    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy" containerID="cri-o://cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7" gracePeriod=30
Sep 12 00:47:22.222299 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.222272    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs\") pod \"8a06249a-bc87-4db3-8213-48037e5119c8\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") "
Sep 12 00:47:22.222437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.222310    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") pod \"8a06249a-bc87-4db3-8213-48037e5119c8\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") "
Sep 12 00:47:22.222513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.222463    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgjlx\" (UniqueName: \"kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx\") pod \"8a06249a-bc87-4db3-8213-48037e5119c8\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") "
Sep 12 00:47:22.222513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.222498    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca\") pod \"8a06249a-bc87-4db3-8213-48037e5119c8\" (UID: \"8a06249a-bc87-4db3-8213-48037e5119c8\") "
Sep 12 00:47:22.222896 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.222870    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a06249a-bc87-4db3-8213-48037e5119c8" (UID: "8a06249a-bc87-4db3-8213-48037e5119c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:22.224391 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.224362    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a06249a-bc87-4db3-8213-48037e5119c8" (UID: "8a06249a-bc87-4db3-8213-48037e5119c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:22.224391 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.224380    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a06249a-bc87-4db3-8213-48037e5119c8" (UID: "8a06249a-bc87-4db3-8213-48037e5119c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:22.224513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.224458    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx" (OuterVolumeSpecName: "kube-api-access-bgjlx") pod "8a06249a-bc87-4db3-8213-48037e5119c8" (UID: "8a06249a-bc87-4db3-8213-48037e5119c8"). InnerVolumeSpecName "kube-api-access-bgjlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:47:22.323538 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.323507    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgjlx\" (UniqueName: \"kubernetes.io/projected/8a06249a-bc87-4db3-8213-48037e5119c8-kube-api-access-bgjlx\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:22.323538 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.323536    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06249a-bc87-4db3-8213-48037e5119c8-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:22.323538 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.323546    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:22.323799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.323564    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a06249a-bc87-4db3-8213-48037e5119c8-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:22.856404 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.856371    2556 generic.go:356] "Generic (PLEG): container finished" podID="8a06249a-bc87-4db3-8213-48037e5119c8" containerID="416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b" exitCode=0
Sep 12 00:47:22.856596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.856427    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"
Sep 12 00:47:22.856596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.856428    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" event={"ID":"8a06249a-bc87-4db3-8213-48037e5119c8","Type":"ContainerDied","Data":"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"}
Sep 12 00:47:22.856596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.856549    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm" event={"ID":"8a06249a-bc87-4db3-8213-48037e5119c8","Type":"ContainerDied","Data":"d5836779a39815995a00fb8dd9ef2f24fc11a066a59e01fa7c9e6bbaa98927b3"}
Sep 12 00:47:22.856596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.856587    2556 scope.go:117] "RemoveContainer" containerID="416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"
Sep 12 00:47:22.868715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.868565    2556 scope.go:117] "RemoveContainer" containerID="416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"
Sep 12 00:47:22.868955 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:22.868825    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b\": container with ID starting with 416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b not found: ID does not exist" containerID="416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"
Sep 12 00:47:22.868955 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.868848    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b"} err="failed to get container status \"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b\": rpc error: code = NotFound desc = could not find container \"416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b\": container with ID starting with 416f0ba8095b8a348262d82d12fe54052a841d0b21a15527e6e757fc5df6805b not found: ID does not exist"
Sep 12 00:47:22.903375 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.903345    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:47:22.911921 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.911898    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-723148b6-6d57b7fdd4-lv7dm"]
Sep 12 00:47:22.986031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.985991    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:47:22.986963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.986937    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a06249a-bc87-4db3-8213-48037e5119c8" containerName="maas-api"
Sep 12 00:47:22.987096 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.987049    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a06249a-bc87-4db3-8213-48037e5119c8" containerName="maas-api"
Sep 12 00:47:22.987216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.987201    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a06249a-bc87-4db3-8213-48037e5119c8" containerName="maas-api"
Sep 12 00:47:22.992043 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.992024    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:22.995501 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.995480    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-51ad044d-openshift-default-dockercfg-kxjfk\""
Sep 12 00:47:22.999669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:22.999647    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:47:23.031097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031214 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031214 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031312 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031312 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031266    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031312 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rs5s\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031423 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.031500 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.031425    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.132976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.132882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.132976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.132930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rs5s\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133625 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133470    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133625 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133611    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.133803 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.133778    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.134042 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.134021    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.135724 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.135705    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.135855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.135834    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.143304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.143284    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rs5s\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.143527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.143507    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token\") pod \"e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") " pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.306837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.306807    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:23.454669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.454637    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a06249a-bc87-4db3-8213-48037e5119c8" path="/var/lib/kubelet/pods/8a06249a-bc87-4db3-8213-48037e5119c8/volumes"
Sep 12 00:47:23.585695 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.585667    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:47:23.590167 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.589361    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:23.590167 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.589489    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:23.590167 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.589565    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:23.866256 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.866164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerStarted","Data":"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"}
Sep 12 00:47:23.866256 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.866227    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerStarted","Data":"00b7fb19d4592deebebd675ac1b04d53e48cfc1f112ea06e89b160655e099b56"}
Sep 12 00:47:23.889434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:23.889386    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podStartSLOduration=1.889372277 podStartE2EDuration="1.889372277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:47:23.887516822 +0000 UTC m=+1096.938102430" watchObservedRunningTime="2026-09-12 00:47:23.889372277 +0000 UTC m=+1096.939957884"
Sep 12 00:47:24.307310 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:24.307273    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:24.312781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:24.312739    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:24.875032 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:24.874999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:24.875867 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:24.875849    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:26.985472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:26.985443    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:26.989405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:26.989384    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:26.991651 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:26.991628    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-51ad044d-serving-cert\""
Sep 12 00:47:27.001543 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.001521    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:27.074663 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.074614    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.074663 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.074668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccxd\" (UniqueName: \"kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.074900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.074738    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.074900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.074779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.176142 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.176101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.176315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.176154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.176315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.176287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.176392 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.176322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jccxd\" (UniqueName: \"kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.176392 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:27.176327    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-serving-cert: secret "maas-api-e2e-ait-51ad044d-serving-cert" not found
Sep 12 00:47:27.176469 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:27.176405    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls podName:61042b39-b68b-4f75-8488-c989c19e2be3 nodeName:}" failed. No retries permitted until 2026-09-12 00:47:27.676381936 +0000 UTC m=+1100.726967541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls") pod "maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" (UID: "61042b39-b68b-4f75-8488-c989c19e2be3") : secret "maas-api-e2e-ait-51ad044d-serving-cert" not found
Sep 12 00:47:27.176914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.176887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.178718 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.178694    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.187699 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.187676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccxd\" (UniqueName: \"kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.453165 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.453140    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:27.580496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580420    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580472    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580496 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580493    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580539    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc5wc\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580577    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580606    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580633    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580663    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.580736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580695    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:47:27.581112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580737    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket\") pod \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\" (UID: \"e6b9c762-8c17-48d8-8624-e6b92b16aa6b\") "
Sep 12 00:47:27.581112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.580790    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:47:27.581112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581021    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:47:27.581112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581037    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:27.581112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581073    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:47:27.581367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581220    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.581367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581240    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.581367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581252    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.581367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581263    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.581367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.581274    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.583253 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.583226    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:47:27.583412 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.583395    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:47:27.583546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.583525    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:47:27.583644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.583627    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc" (OuterVolumeSpecName: "kube-api-access-vc5wc") pod "e6b9c762-8c17-48d8-8624-e6b92b16aa6b" (UID: "e6b9c762-8c17-48d8-8624-e6b92b16aa6b"). InnerVolumeSpecName "kube-api-access-vc5wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:47:27.682315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.682282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.682471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.682378    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.682471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.682390    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc5wc\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-kube-api-access-vc5wc\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.682471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.682398    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.682471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.682408    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6b9c762-8c17-48d8-8624-e6b92b16aa6b-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:27.684587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.684560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") pod \"maas-api-e2e-ait-51ad044d-f475b676c-j2t9h\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.894600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.894513    2556 generic.go:356] "Generic (PLEG): container finished" podID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerID="cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7" exitCode=0
Sep 12 00:47:27.894600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.894551    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerDied","Data":"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"}
Sep 12 00:47:27.894600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.894555    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"
Sep 12 00:47:27.894600 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.894594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x" event={"ID":"e6b9c762-8c17-48d8-8624-e6b92b16aa6b","Type":"ContainerDied","Data":"90d30b05da882b29c5b0935aa6ba230e61dfe5f6186fab6f77567abe14ddaf95"}
Sep 12 00:47:27.894880 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.894615    2556 scope.go:117] "RemoveContainer" containerID="cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"
Sep 12 00:47:27.906263 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.906182    2556 scope.go:117] "RemoveContainer" containerID="76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"
Sep 12 00:47:27.906330 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.906312    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:27.919509 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.919488    2556 scope.go:117] "RemoveContainer" containerID="cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"
Sep 12 00:47:27.920002 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:27.919804    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7\": container with ID starting with cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7 not found: ID does not exist" containerID="cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"
Sep 12 00:47:27.920002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.919843    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7"} err="failed to get container status \"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7\": rpc error: code = NotFound desc = could not find container \"cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7\": container with ID starting with cb346abfaf627c60391647ceb05f9f0e6d570120b9ef763024dfb059209ce6c7 not found: ID does not exist"
Sep 12 00:47:27.920002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.919866    2556 scope.go:117] "RemoveContainer" containerID="76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"
Sep 12 00:47:27.920731 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:27.920704    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714\": container with ID starting with 76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714 not found: ID does not exist" containerID="76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"
Sep 12 00:47:27.920847 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.920741    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714"} err="failed to get container status \"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714\": rpc error: code = NotFound desc = could not find container \"76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714\": container with ID starting with 76a45520d1ca4a8a88411ea2f5fe4692ea57efb5b7e017e2ff2de493fd0ec714 not found: ID does not exist"
Sep 12 00:47:27.923272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.923254    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:47:27.926606 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:27.926584    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x"]
Sep 12 00:47:28.109715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.109679    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:47:28.184366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.184341    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:28.185047 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:47:28.185025    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61042b39_b68b_4f75_8488_c989c19e2be3.slice/crio-885c7cb7a96237722755e85d26ad9c9dda6f9507277f388bc4f2f818f262093c WatchSource:0}: Error finding container 885c7cb7a96237722755e85d26ad9c9dda6f9507277f388bc4f2f818f262093c: Status 404 returned error can't find the container with id 885c7cb7a96237722755e85d26ad9c9dda6f9507277f388bc4f2f818f262093c
Sep 12 00:47:28.906051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.905959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" event={"ID":"61042b39-b68b-4f75-8488-c989c19e2be3","Type":"ContainerStarted","Data":"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"}
Sep 12 00:47:28.906051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.906016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" event={"ID":"61042b39-b68b-4f75-8488-c989c19e2be3","Type":"ContainerStarted","Data":"885c7cb7a96237722755e85d26ad9c9dda6f9507277f388bc4f2f818f262093c"}
Sep 12 00:47:28.906279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.906054    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:28.926333 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:28.926287    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" podStartSLOduration=2.543472339 podStartE2EDuration="2.926272625s" totalImagesPullingTime="382.800286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:47:28.923348414 +0000 UTC m=+1101.973934047" watchObservedRunningTime="2026-09-12 00:47:28.926272625 +0000 UTC m=+1101.976858231"
Sep 12 00:47:29.455362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:29.455326    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" path="/var/lib/kubelet/pods/e6b9c762-8c17-48d8-8624-e6b92b16aa6b/volumes"
Sep 12 00:47:34.920956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:34.920929    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:49.037127 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.037096    2556 generic.go:356] "Generic (PLEG): container finished" podID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerID="d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db" exitCode=0
Sep 12 00:47:49.037560 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.037178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerDied","Data":"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"}
Sep 12 00:47:49.037645 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.037629    2556 scope.go:117] "RemoveContainer" containerID="d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"
Sep 12 00:47:49.038808 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.038779    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:49.038899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.038848    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:49.038899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:49.038876    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:50.045455 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:50.045416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerStarted","Data":"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"}
Sep 12 00:47:50.307088 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:50.306938    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:50.308499 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:50.308463    2556 patch_prober.go:28] interesting pod/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 12 00:47:50.308645 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:50.308536    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 12 00:47:51.307342 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:51.307301    2556 patch_prober.go:28] interesting pod/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 12 00:47:51.307723 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:51.307373    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 12 00:47:52.307391 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:52.307354    2556 patch_prober.go:28] interesting pod/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 12 00:47:52.307965 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:52.307931    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 12 00:47:53.307922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:53.307882    2556 patch_prober.go:28] interesting pod/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 12 00:47:53.308434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:53.307941    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 12 00:47:54.307164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:54.307131    2556 patch_prober.go:28] interesting pod/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 12 00:47:54.307330 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:54.307196    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 12 00:47:54.875028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:54.874993    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:55.220505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:55.220475    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:47:55.311455 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:55.311426    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:55.312415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:55.312394    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:47:57.112027 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.111992    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:57.112440 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.112254    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" podUID="61042b39-b68b-4f75-8488-c989c19e2be3" containerName="maas-api" containerID="cri-o://ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4" gracePeriod=30
Sep 12 00:47:57.367953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.367883    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:57.480122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480089    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jccxd\" (UniqueName: \"kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd\") pod \"61042b39-b68b-4f75-8488-c989c19e2be3\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") "
Sep 12 00:47:57.480302 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480220    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca\") pod \"61042b39-b68b-4f75-8488-c989c19e2be3\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") "
Sep 12 00:47:57.480302 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480275    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") pod \"61042b39-b68b-4f75-8488-c989c19e2be3\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") "
Sep 12 00:47:57.480432 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480301    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs\") pod \"61042b39-b68b-4f75-8488-c989c19e2be3\" (UID: \"61042b39-b68b-4f75-8488-c989c19e2be3\") "
Sep 12 00:47:57.480648 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480618    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61042b39-b68b-4f75-8488-c989c19e2be3" (UID: "61042b39-b68b-4f75-8488-c989c19e2be3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:57.480790 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.480742    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61042b39-b68b-4f75-8488-c989c19e2be3-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:57.482636 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.482597    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61042b39-b68b-4f75-8488-c989c19e2be3" (UID: "61042b39-b68b-4f75-8488-c989c19e2be3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:57.482889 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.482864    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd" (OuterVolumeSpecName: "kube-api-access-jccxd") pod "61042b39-b68b-4f75-8488-c989c19e2be3" (UID: "61042b39-b68b-4f75-8488-c989c19e2be3"). InnerVolumeSpecName "kube-api-access-jccxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:47:57.483160 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.483140    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "61042b39-b68b-4f75-8488-c989c19e2be3" (UID: "61042b39-b68b-4f75-8488-c989c19e2be3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:57.582022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.581988    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:57.582022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.582017    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61042b39-b68b-4f75-8488-c989c19e2be3-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:57.582022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:57.582026    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jccxd\" (UniqueName: \"kubernetes.io/projected/61042b39-b68b-4f75-8488-c989c19e2be3-kube-api-access-jccxd\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:47:58.114199 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.114161    2556 generic.go:356] "Generic (PLEG): container finished" podID="61042b39-b68b-4f75-8488-c989c19e2be3" containerID="ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4" exitCode=0
Sep 12 00:47:58.114577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.114218    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"
Sep 12 00:47:58.114577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.114225    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" event={"ID":"61042b39-b68b-4f75-8488-c989c19e2be3","Type":"ContainerDied","Data":"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"}
Sep 12 00:47:58.114577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.114270    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h" event={"ID":"61042b39-b68b-4f75-8488-c989c19e2be3","Type":"ContainerDied","Data":"885c7cb7a96237722755e85d26ad9c9dda6f9507277f388bc4f2f818f262093c"}
Sep 12 00:47:58.114577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.114291    2556 scope.go:117] "RemoveContainer" containerID="ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"
Sep 12 00:47:58.124635 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.124620    2556 scope.go:117] "RemoveContainer" containerID="ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"
Sep 12 00:47:58.124932 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:47:58.124910    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4\": container with ID starting with ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4 not found: ID does not exist" containerID="ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"
Sep 12 00:47:58.125034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.124936    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4"} err="failed to get container status \"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4\": rpc error: code = NotFound desc = could not find container \"ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4\": container with ID starting with ce354e12bac4a6f138aae66eeec729e0e6c7e647226bc6b02b8e4dbab4fec8f4 not found: ID does not exist"
Sep 12 00:47:58.136431 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.136403    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:58.138928 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.138910    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51ad044d-f475b676c-j2t9h"]
Sep 12 00:47:58.420452 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.420422    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:47:58.420637 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:58.420614    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy" containerID="cri-o://6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423" gracePeriod=30
Sep 12 00:47:59.115913 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.115881    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:47:59.116584 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.116566    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:47:59.116752 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.116740    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:47:59.116869 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.116858    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61042b39-b68b-4f75-8488-c989c19e2be3" containerName="maas-api"
Sep 12 00:47:59.116946 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.116936    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61042b39-b68b-4f75-8488-c989c19e2be3" containerName="maas-api"
Sep 12 00:47:59.117079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.117062    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:47:59.117079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.117079    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:47:59.117233 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.117221    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:47:59.117270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.117243    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="61042b39-b68b-4f75-8488-c989c19e2be3" containerName="maas-api"
Sep 12 00:47:59.121485 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.121463    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.124261 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.124238    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f2beda59-openshift-default-dockercfg-2vbp9\""
Sep 12 00:47:59.129976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.129950    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:47:59.197512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.197512 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.197862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkl9j\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.197862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.197862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.197862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197811    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.198080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.198080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197901    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.198080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.197955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299326 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkl9j\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299531 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299531 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299531 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299531 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299507    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.299748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.299655    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.300476 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.300446    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.301267 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.301242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.302693 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.301656    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.302851 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.302241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.303541 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.303499    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.303541 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.303515    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.303541 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.303527    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.308134 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.308110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkl9j\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.309528 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.309506    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token\") pod \"e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") " pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.434551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.434515    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:47:59.455451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.455416    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61042b39-b68b-4f75-8488-c989c19e2be3" path="/var/lib/kubelet/pods/61042b39-b68b-4f75-8488-c989c19e2be3/volumes"
Sep 12 00:47:59.712226 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.712186    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:47:59.713103 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:47:59.713079    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109f503e_5327_4482_b6c3_8b5a1730f09d.slice/crio-a9b7cb1a372d51146108fba4098fd7f44addc600f5c50f0aaa22297bcec244b9 WatchSource:0}: Error finding container a9b7cb1a372d51146108fba4098fd7f44addc600f5c50f0aaa22297bcec244b9: Status 404 returned error can't find the container with id a9b7cb1a372d51146108fba4098fd7f44addc600f5c50f0aaa22297bcec244b9
Sep 12 00:47:59.715241 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.715208    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:59.715322 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.715273    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:47:59.715322 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:47:59.715300    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:48:00.131139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:00.131043    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerStarted","Data":"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"}
Sep 12 00:48:00.131139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:00.131117    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerStarted","Data":"a9b7cb1a372d51146108fba4098fd7f44addc600f5c50f0aaa22297bcec244b9"}
Sep 12 00:48:00.151839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:00.151791    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podStartSLOduration=1.151770034 podStartE2EDuration="1.151770034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:00.150194355 +0000 UTC m=+1133.200779987" watchObservedRunningTime="2026-09-12 00:48:00.151770034 +0000 UTC m=+1133.202355638"
Sep 12 00:48:00.435518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:00.435486    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:00.440173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:00.440151    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:01.138083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:01.138053    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:01.138917 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:01.138895    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:03.680954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.680889    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:48:03.742950 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.742920    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.742990    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743022    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743052    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743115    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743133    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rs5s\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743164    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743212    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy\") pod \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\" (UID: \"fbeddca7-a14b-489e-9c9a-010ced1a1a0b\") "
Sep 12 00:48:03.743494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743312    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:03.743494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743366    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:48:03.743494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743320    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:03.743494 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743436    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:03.743696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743569    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:03.743696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743658    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.743696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743677    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.743696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743689    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.743922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743702    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.743922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.743715    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.745325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.745302    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:03.745437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.745376    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s" (OuterVolumeSpecName: "kube-api-access-2rs5s") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "kube-api-access-2rs5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:03.745437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.745422    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:03.745527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.745510    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbeddca7-a14b-489e-9c9a-010ced1a1a0b" (UID: "fbeddca7-a14b-489e-9c9a-010ced1a1a0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:48:03.844650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.844623    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.844650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.844645    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.844650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.844656    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rs5s\" (UniqueName: \"kubernetes.io/projected/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-kube-api-access-2rs5s\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:03.844895 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:03.844664    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbeddca7-a14b-489e-9c9a-010ced1a1a0b-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:04.160018 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.159979    2556 generic.go:356] "Generic (PLEG): container finished" podID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerID="6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423" exitCode=0
Sep 12 00:48:04.160168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.160028    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"
Sep 12 00:48:04.160168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.160050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerDied","Data":"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"}
Sep 12 00:48:04.160168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.160102    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg" event={"ID":"fbeddca7-a14b-489e-9c9a-010ced1a1a0b","Type":"ContainerDied","Data":"00b7fb19d4592deebebd675ac1b04d53e48cfc1f112ea06e89b160655e099b56"}
Sep 12 00:48:04.160168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.160130    2556 scope.go:117] "RemoveContainer" containerID="6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"
Sep 12 00:48:04.171100 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.171078    2556 scope.go:117] "RemoveContainer" containerID="d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"
Sep 12 00:48:04.180236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.180006    2556 scope.go:117] "RemoveContainer" containerID="6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"
Sep 12 00:48:04.180356 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:04.180313    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423\": container with ID starting with 6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423 not found: ID does not exist" containerID="6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"
Sep 12 00:48:04.180417 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.180349    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423"} err="failed to get container status \"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423\": rpc error: code = NotFound desc = could not find container \"6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423\": container with ID starting with 6a2f981047cf8109bccfbfbebb1caa474e861f6e93784739346dba16c00ea423 not found: ID does not exist"
Sep 12 00:48:04.180417 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.180367    2556 scope.go:117] "RemoveContainer" containerID="d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"
Sep 12 00:48:04.180658 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:04.180639    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db\": container with ID starting with d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db not found: ID does not exist" containerID="d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"
Sep 12 00:48:04.180716 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.180663    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db"} err="failed to get container status \"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db\": rpc error: code = NotFound desc = could not find container \"d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db\": container with ID starting with d584582e8a890f9705528138e58e4f4bd7452e2c34dbc6d278ce4d4206dfd5db not found: ID does not exist"
Sep 12 00:48:04.183488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.183459    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:48:04.186374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:04.186354    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg"]
Sep 12 00:48:05.455166 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:05.455131    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" path="/var/lib/kubelet/pods/fbeddca7-a14b-489e-9c9a-010ced1a1a0b/volumes"
Sep 12 00:48:06.165051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.165011    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:06.165914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.165889    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.165914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.165912    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.166115 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.165939    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.166115 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.165946    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.166115 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.166062    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.166115 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.166075    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbeddca7-a14b-489e-9c9a-010ced1a1a0b" containerName="istio-proxy"
Sep 12 00:48:06.166115 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.166091    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6b9c762-8c17-48d8-8624-e6b92b16aa6b" containerName="istio-proxy"
Sep 12 00:48:06.168278 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.168260    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.170966 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.170948    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f2beda59-serving-cert\""
Sep 12 00:48:06.178424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.178144    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:06.271261 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.271165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.271261 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.271221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.271504 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.271285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.271504 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.271320    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp9rp\" (UniqueName: \"kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.371878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.371843    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.371878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.371884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.372087 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.371924    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.372087 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.371946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp9rp\" (UniqueName: \"kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.372668 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.372641    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.374518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.374487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.374613 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.374487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.380507 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.380486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp9rp\" (UniqueName: \"kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp\") pod \"maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.484192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.484107    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:06.758624 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:06.757996    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:07.187817 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:07.187792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" event={"ID":"d4c22752-3a36-4836-8930-6a8a7b3d097a","Type":"ContainerStarted","Data":"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"}
Sep 12 00:48:07.187934 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:07.187849    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" event={"ID":"d4c22752-3a36-4836-8930-6a8a7b3d097a","Type":"ContainerStarted","Data":"72a13fb32a561c663906ffb93127fa2b55b2a63d4fc6068ec4d082e0f559ed01"}
Sep 12 00:48:07.187934 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:07.187878    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:07.205911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:07.205870    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" podStartSLOduration=0.852820215 podStartE2EDuration="1.205855605s" totalImagesPullingTime="353.03539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:07.203418415 +0000 UTC m=+1140.254004013" watchObservedRunningTime="2026-09-12 00:48:07.205855605 +0000 UTC m=+1140.256441211"
Sep 12 00:48:13.199594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:13.199565    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:16.920536 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:16.920500    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:48:28.336671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.336630    2556 generic.go:356] "Generic (PLEG): container finished" podID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerID="08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb" exitCode=0
Sep 12 00:48:28.337120 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.336703    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerDied","Data":"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"}
Sep 12 00:48:28.337120 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.337117    2556 scope.go:117] "RemoveContainer" containerID="08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"
Sep 12 00:48:28.338198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.338174    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:48:28.338296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.338238    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:48:28.338296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:28.338269    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:48:29.345197 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:29.345165    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerStarted","Data":"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"}
Sep 12 00:48:29.435355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:29.435323    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:29.436581 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:29.436557    2556 patch_prober.go:28] interesting pod/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:48:29.436657 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:29.436621    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 12 00:48:30.434908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:30.434830    2556 patch_prober.go:28] interesting pod/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:48:30.434908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:30.434886    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 12 00:48:31.138656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:31.138614    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:31.435022 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:31.434986    2556 patch_prober.go:28] interesting pod/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:48:31.435404 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:31.435037    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 12 00:48:32.434950 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:32.434916    2556 patch_prober.go:28] interesting pod/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:48:32.435117 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:32.434969    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 12 00:48:33.435020 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.434987    2556 patch_prober.go:28] interesting pod/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:48:33.435194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.435041    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 12 00:48:33.630202 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.630170    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:48:33.630414 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.630388    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" podUID="654c3799-ee67-4950-9faa-6551ebac9e34" containerName="payload-pre-processing" containerID="cri-o://92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e" gracePeriod=30
Sep 12 00:48:33.715194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.714856    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:33.715194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:33.715089    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" podUID="d4c22752-3a36-4836-8930-6a8a7b3d097a" containerName="maas-api" containerID="cri-o://906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c" gracePeriod=30
Sep 12 00:48:34.076357 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.076331    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:48:34.078953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.078929    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:34.238425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238353    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp9rp\" (UniqueName: \"kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp\") pod \"d4c22752-3a36-4836-8930-6a8a7b3d097a\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") "
Sep 12 00:48:34.238425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238414    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume\") pod \"654c3799-ee67-4950-9faa-6551ebac9e34\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") "
Sep 12 00:48:34.238694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238445    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca\") pod \"d4c22752-3a36-4836-8930-6a8a7b3d097a\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") "
Sep 12 00:48:34.238694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238527    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls\") pod \"d4c22752-3a36-4836-8930-6a8a7b3d097a\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") "
Sep 12 00:48:34.238694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238550    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs\") pod \"d4c22752-3a36-4836-8930-6a8a7b3d097a\" (UID: \"d4c22752-3a36-4836-8930-6a8a7b3d097a\") "
Sep 12 00:48:34.238694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.238602    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7cz4\" (UniqueName: \"kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4\") pod \"654c3799-ee67-4950-9faa-6551ebac9e34\" (UID: \"654c3799-ee67-4950-9faa-6551ebac9e34\") "
Sep 12 00:48:34.239535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.239249    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4c22752-3a36-4836-8930-6a8a7b3d097a" (UID: "d4c22752-3a36-4836-8930-6a8a7b3d097a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:48:34.240033 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.239984    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "654c3799-ee67-4950-9faa-6551ebac9e34" (UID: "654c3799-ee67-4950-9faa-6551ebac9e34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:48:34.243865 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.243828    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4" (OuterVolumeSpecName: "kube-api-access-c7cz4") pod "654c3799-ee67-4950-9faa-6551ebac9e34" (UID: "654c3799-ee67-4950-9faa-6551ebac9e34"). InnerVolumeSpecName "kube-api-access-c7cz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:34.244513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.244480    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp" (OuterVolumeSpecName: "kube-api-access-fp9rp") pod "d4c22752-3a36-4836-8930-6a8a7b3d097a" (UID: "d4c22752-3a36-4836-8930-6a8a7b3d097a"). InnerVolumeSpecName "kube-api-access-fp9rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:34.244610 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.244587    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d4c22752-3a36-4836-8930-6a8a7b3d097a" (UID: "d4c22752-3a36-4836-8930-6a8a7b3d097a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:48:34.244820 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.244789    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4c22752-3a36-4836-8930-6a8a7b3d097a" (UID: "d4c22752-3a36-4836-8930-6a8a7b3d097a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:48:34.263507 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.263207    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:48:34.263507 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.263394    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy" containerID="cri-o://ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a" gracePeriod=30
Sep 12 00:48:34.339922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339835    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654c3799-ee67-4950-9faa-6551ebac9e34-plugins-config-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.339922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339876    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c22752-3a36-4836-8930-6a8a7b3d097a-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.339922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339892    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.339922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339905    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4c22752-3a36-4836-8930-6a8a7b3d097a-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.339922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339917    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7cz4\" (UniqueName: \"kubernetes.io/projected/654c3799-ee67-4950-9faa-6551ebac9e34-kube-api-access-c7cz4\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.340185 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.339930    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp9rp\" (UniqueName: \"kubernetes.io/projected/d4c22752-3a36-4836-8930-6a8a7b3d097a-kube-api-access-fp9rp\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:34.391799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.391734    2556 generic.go:356] "Generic (PLEG): container finished" podID="654c3799-ee67-4950-9faa-6551ebac9e34" containerID="92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e" exitCode=0
Sep 12 00:48:34.391799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.391790    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"
Sep 12 00:48:34.392052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.391837    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" event={"ID":"654c3799-ee67-4950-9faa-6551ebac9e34","Type":"ContainerDied","Data":"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"}
Sep 12 00:48:34.392052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.391899    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w" event={"ID":"654c3799-ee67-4950-9faa-6551ebac9e34","Type":"ContainerDied","Data":"460064fd97e398b537e6d06ce8af1a75be63066ce2d06386e4fcf7309e72a47b"}
Sep 12 00:48:34.392052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.391928    2556 scope.go:117] "RemoveContainer" containerID="92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"
Sep 12 00:48:34.394242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.393841    2556 generic.go:356] "Generic (PLEG): container finished" podID="d4c22752-3a36-4836-8930-6a8a7b3d097a" containerID="906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c" exitCode=0
Sep 12 00:48:34.394242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.393889    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"
Sep 12 00:48:34.394242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.393892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" event={"ID":"d4c22752-3a36-4836-8930-6a8a7b3d097a","Type":"ContainerDied","Data":"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"}
Sep 12 00:48:34.394242 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.393998    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m" event={"ID":"d4c22752-3a36-4836-8930-6a8a7b3d097a","Type":"ContainerDied","Data":"72a13fb32a561c663906ffb93127fa2b55b2a63d4fc6068ec4d082e0f559ed01"}
Sep 12 00:48:34.409393 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.409365    2556 scope.go:117] "RemoveContainer" containerID="92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"
Sep 12 00:48:34.409894 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:34.409866    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e\": container with ID starting with 92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e not found: ID does not exist" containerID="92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"
Sep 12 00:48:34.409993 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.409901    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e"} err="failed to get container status \"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e\": rpc error: code = NotFound desc = could not find container \"92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e\": container with ID starting with 92aa72fea7ed1b3a452c32cc99f954be0c0ca6132e3c62803b84cce78c60bc7e not found: ID does not exist"
Sep 12 00:48:34.409993 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.409922    2556 scope.go:117] "RemoveContainer" containerID="906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"
Sep 12 00:48:34.418956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.418934    2556 scope.go:117] "RemoveContainer" containerID="906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"
Sep 12 00:48:34.419196 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:34.419178    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c\": container with ID starting with 906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c not found: ID does not exist" containerID="906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"
Sep 12 00:48:34.419252 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.419203    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c"} err="failed to get container status \"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c\": rpc error: code = NotFound desc = could not find container \"906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c\": container with ID starting with 906f880b21472be9a016dd94e16130dba394181ffed3fc19e448dc3cee1b177c not found: ID does not exist"
Sep 12 00:48:34.431200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.431175    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:34.434045 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.433962    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f2beda59-77cdf6954f-mk28m"]
Sep 12 00:48:34.444285 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.444261    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:48:34.449150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:34.449128    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w"]
Sep 12 00:48:35.455036 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:35.454997    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654c3799-ee67-4950-9faa-6551ebac9e34" path="/var/lib/kubelet/pods/654c3799-ee67-4950-9faa-6551ebac9e34/volumes"
Sep 12 00:48:35.455613 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:35.455591    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c22752-3a36-4836-8930-6a8a7b3d097a" path="/var/lib/kubelet/pods/d4c22752-3a36-4836-8930-6a8a7b3d097a/volumes"
Sep 12 00:48:39.602248 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.602222    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:39.689264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689232    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689264    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689314    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689351    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689510 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689491    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689557 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689532    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkl9j\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689598 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689574    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689645 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689622    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689639    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:39.689694 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689649    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy\") pod \"109f503e-5327-4482-b6c3-8b5a1730f09d\" (UID: \"109f503e-5327-4482-b6c3-8b5a1730f09d\") "
Sep 12 00:48:39.689834 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689784    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:48:39.689834 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689781    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:39.689940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689869    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:39.689940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.689891    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data" (OuterVolumeSpecName: "istio-data") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:39.690067 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.690049    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109f503e-5327-4482-b6c3-8b5a1730f09d-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.690128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.690073    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.690128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.690087    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.690128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.690100    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.690128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.690113    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.691640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.691561    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j" (OuterVolumeSpecName: "kube-api-access-nkl9j") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "kube-api-access-nkl9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:39.691811 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.691649    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:39.691871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.691818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:48:39.692087 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.692066    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token" (OuterVolumeSpecName: "istio-token") pod "109f503e-5327-4482-b6c3-8b5a1730f09d" (UID: "109f503e-5327-4482-b6c3-8b5a1730f09d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:39.791223 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.791198    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkl9j\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-kube-api-access-nkl9j\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.791223 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.791222    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.791385 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.791232    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:39.791385 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:39.791241    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109f503e-5327-4482-b6c3-8b5a1730f09d-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:48:40.433415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.433381    2556 generic.go:356] "Generic (PLEG): container finished" podID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerID="ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a" exitCode=0
Sep 12 00:48:40.433415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.433419    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerDied","Data":"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"}
Sep 12 00:48:40.433623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.433429    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"
Sep 12 00:48:40.433623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.433460    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q" event={"ID":"109f503e-5327-4482-b6c3-8b5a1730f09d","Type":"ContainerDied","Data":"a9b7cb1a372d51146108fba4098fd7f44addc600f5c50f0aaa22297bcec244b9"}
Sep 12 00:48:40.433623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.433482    2556 scope.go:117] "RemoveContainer" containerID="ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"
Sep 12 00:48:40.443491 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.443474    2556 scope.go:117] "RemoveContainer" containerID="08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"
Sep 12 00:48:40.452218 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.452200    2556 scope.go:117] "RemoveContainer" containerID="ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"
Sep 12 00:48:40.452496 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:40.452478    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a\": container with ID starting with ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a not found: ID does not exist" containerID="ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"
Sep 12 00:48:40.452550 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.452503    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a"} err="failed to get container status \"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a\": rpc error: code = NotFound desc = could not find container \"ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a\": container with ID starting with ea239e5959e6fc25152e56ad41c55441e6aab4636951e461b4a3d47684af8f6a not found: ID does not exist"
Sep 12 00:48:40.452594 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.452552    2556 scope.go:117] "RemoveContainer" containerID="08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"
Sep 12 00:48:40.453021 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:48:40.452983    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb\": container with ID starting with 08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb not found: ID does not exist" containerID="08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"
Sep 12 00:48:40.453128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.453016    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb"} err="failed to get container status \"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb\": rpc error: code = NotFound desc = could not find container \"08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb\": container with ID starting with 08258e72621c0476b9ee974c2213893564d3fd7fae5659255c61be564e2f27bb not found: ID does not exist"
Sep 12 00:48:40.456222 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.456199    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:48:40.460563 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:40.460542    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q"]
Sep 12 00:48:41.453622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:41.453587    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" path="/var/lib/kubelet/pods/109f503e-5327-4482-b6c3-8b5a1730f09d/volumes"
Sep 12 00:48:42.110024 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:48:42.109990    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:49:04.639886 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.639851    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640307    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c22752-3a36-4836-8930-6a8a7b3d097a" containerName="maas-api"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640319    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c22752-3a36-4836-8930-6a8a7b3d097a" containerName="maas-api"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640340    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640346    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640364    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654c3799-ee67-4950-9faa-6551ebac9e34" containerName="payload-pre-processing"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640370    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="654c3799-ee67-4950-9faa-6551ebac9e34" containerName="payload-pre-processing"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640436    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640444    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="654c3799-ee67-4950-9faa-6551ebac9e34" containerName="payload-pre-processing"
Sep 12 00:49:04.640445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640450    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:04.640934 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.640458    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c22752-3a36-4836-8930-6a8a7b3d097a" containerName="maas-api"
Sep 12 00:49:04.645262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.645242    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.648684 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.648658    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c3f8d8-openshift-default-dockercfg-p2lp5\""
Sep 12 00:49:04.657619 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.657585    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719423    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6j8z\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.719952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.719472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820096    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6j8z\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820166    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820388 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820366    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820429    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820473    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.820877 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.820801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.821174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.821003    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.821174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.821022    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.821174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.821168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.822659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.822632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.822808 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.822713    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.828473 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.828454    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6j8z\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.828618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.828599    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token\") pod \"e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") " pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:04.956564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:04.956526    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:05.235308 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.235278    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:49:05.236968 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:49:05.236936    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181e50af_fa01_4c74_9931_781b8514da6f.slice/crio-30c5e39975ba9d457cfe993215a9b57161453c369ae83934144941a008e7d1e1 WatchSource:0}: Error finding container 30c5e39975ba9d457cfe993215a9b57161453c369ae83934144941a008e7d1e1: Status 404 returned error can't find the container with id 30c5e39975ba9d457cfe993215a9b57161453c369ae83934144941a008e7d1e1
Sep 12 00:49:05.239558 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.239519    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:05.239664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.239600    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:05.239664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.239629    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:05.589824 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.589708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerStarted","Data":"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"}
Sep 12 00:49:05.589824 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.589786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerStarted","Data":"30c5e39975ba9d457cfe993215a9b57161453c369ae83934144941a008e7d1e1"}
Sep 12 00:49:05.613508 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.613461    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podStartSLOduration=1.613445848 podStartE2EDuration="1.613445848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:05.611624404 +0000 UTC m=+1198.662210008" watchObservedRunningTime="2026-09-12 00:49:05.613445848 +0000 UTC m=+1198.664031455"
Sep 12 00:49:05.956805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:05.956769    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:06.962200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:06.962173    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:07.601653 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:07.601626    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:07.602451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:07.602433    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:09.739052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:09.739017    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:49:11.073615 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.073580    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:49:11.074298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.074275    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:11.074298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.074296    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="109f503e-5327-4482-b6c3-8b5a1730f09d" containerName="istio-proxy"
Sep 12 00:49:11.079097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.079075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.085844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.085823    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-c3f8d8-serving-cert\""
Sep 12 00:49:11.095920 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.095896    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:49:11.192472 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.192327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.192681 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.192515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.192681 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.192602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.192681 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.192630    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.293969 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.293931    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.294128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.293988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.294128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.294013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.294128 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.294115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.294289 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:49:11.294243    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-serving-cert: secret "maas-api-e2e-explicit-c3f8d8-serving-cert" not found
Sep 12 00:49:11.294346 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:49:11.294335    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls podName:fc45597d-4d5d-42a2-bb87-3b0eb07620be nodeName:}" failed. No retries permitted until 2026-09-12 00:49:11.794312005 +0000 UTC m=+1204.844897594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls") pod "maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" (UID: "fc45597d-4d5d-42a2-bb87-3b0eb07620be") : secret "maas-api-e2e-explicit-c3f8d8-serving-cert" not found
Sep 12 00:49:11.294704 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.294687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.296426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.296404    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.313070 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.313040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.800369 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.800332    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.803031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.803004    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") pod \"maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:11.993061 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:11.993032    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:12.270644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:12.270601    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:49:12.273382 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:49:12.273357    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc45597d_4d5d_42a2_bb87_3b0eb07620be.slice/crio-ae78c7cd710f676ce8df057c7c39e16ecaafa3b8bf19e2a479f290e0718bce24 WatchSource:0}: Error finding container ae78c7cd710f676ce8df057c7c39e16ecaafa3b8bf19e2a479f290e0718bce24: Status 404 returned error can't find the container with id ae78c7cd710f676ce8df057c7c39e16ecaafa3b8bf19e2a479f290e0718bce24
Sep 12 00:49:12.634589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:12.634504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" event={"ID":"fc45597d-4d5d-42a2-bb87-3b0eb07620be","Type":"ContainerStarted","Data":"ae78c7cd710f676ce8df057c7c39e16ecaafa3b8bf19e2a479f290e0718bce24"}
Sep 12 00:49:13.641985 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:13.641945    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" event={"ID":"fc45597d-4d5d-42a2-bb87-3b0eb07620be","Type":"ContainerStarted","Data":"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"}
Sep 12 00:49:13.642440 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:13.642071    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:13.661389 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:13.661336    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" podStartSLOduration=2.249011391 podStartE2EDuration="2.661320107s" totalImagesPullingTime="412.308716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:13.660001044 +0000 UTC m=+1206.710586665" watchObservedRunningTime="2026-09-12 00:49:13.661320107 +0000 UTC m=+1206.711905713"
Sep 12 00:49:19.652889 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:19.652862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:49:31.752966 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.752937    2556 generic.go:356] "Generic (PLEG): container finished" podID="181e50af-fa01-4c74-9931-781b8514da6f" containerID="dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b" exitCode=0
Sep 12 00:49:31.753283 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.753009    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerDied","Data":"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"}
Sep 12 00:49:31.753383 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.753369    2556 scope.go:117] "RemoveContainer" containerID="dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"
Sep 12 00:49:31.754445 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.754421    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:31.754497 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.754485    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:31.754539 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:31.754518    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:49:32.765588 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:32.765505    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerStarted","Data":"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"}
Sep 12 00:49:32.958164 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:32.958127    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:32.958558 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:32.958474    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:32.958731 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:32.958709    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:33.133562 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:33.133479    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:49:33.957660 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:33.957615    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:33.958148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:33.957686    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:34.957353 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:34.957310    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:34.957602 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:34.957378    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:35.957547 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:35.957507    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:35.958238 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:35.958209    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:36.957131 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:36.957089    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:36.957345 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:36.957153    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:37.602203 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:37.602153    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:37.957875 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:37.957834    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:49:37.958072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:37.957902    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 12 00:49:38.960940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:38.960913    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:49:38.962110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:49:38.962089    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:50:03.920310 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:03.920234    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:50:10.236465 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.236426    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:50:10.240927 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.240908    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242446 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4t4w\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242586 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242598    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242659    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.242835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.242818    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.243748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.243730    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ee23f934-openshift-default-dockercfg-ft76t\""
Sep 12 00:50:10.251959 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.251935    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:50:10.343659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343618    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4t4w\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.343861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343670    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.343861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343710    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.343861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.343861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.343861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343843    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343864    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.343978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.344174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344455 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.344423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.344670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.344629    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.345212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.345187    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.345357 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.345263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.347848 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.347782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.348279 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.348236    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.353076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.353051    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4t4w\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.354382 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.354343    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token\") pod \"e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") " pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.553661 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.553578    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:10.945090 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.945058    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:50:10.988661 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:50:10.988633    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fabcbe_8222_4514_8c18_b5658db2cfa2.slice/crio-95c5298b53a70ce3c32482020e8e36b434dace5fea273d04a28a2311fdc8ffb1 WatchSource:0}: Error finding container 95c5298b53a70ce3c32482020e8e36b434dace5fea273d04a28a2311fdc8ffb1: Status 404 returned error can't find the container with id 95c5298b53a70ce3c32482020e8e36b434dace5fea273d04a28a2311fdc8ffb1
Sep 12 00:50:10.991246 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.991203    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:10.991324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.991299    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:10.991364 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:10.991342    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:11.004066 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:11.004039    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerStarted","Data":"95c5298b53a70ce3c32482020e8e36b434dace5fea273d04a28a2311fdc8ffb1"}
Sep 12 00:50:12.011170 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:12.011128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerStarted","Data":"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"}
Sep 12 00:50:12.067337 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:12.067292    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podStartSLOduration=2.067276828 podStartE2EDuration="2.067276828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:50:12.063458351 +0000 UTC m=+1265.114043959" watchObservedRunningTime="2026-09-12 00:50:12.067276828 +0000 UTC m=+1265.117862435"
Sep 12 00:50:12.553931 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:12.553898    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:12.559871 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:12.559844    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:13.018183 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:13.018156    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:13.018998 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:13.018977    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:33.616720 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:33.616680    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:50:43.795825 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:43.795789    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": read tcp 10.132.0.2:55812->10.132.0.71:15021: read: connection reset by peer" start-of-body=
Sep 12 00:50:43.796178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:43.795901    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": read tcp 10.132.0.2:55812->10.132.0.71:15021: read: connection reset by peer"
Sep 12 00:50:44.219517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.219484    2556 generic.go:356] "Generic (PLEG): container finished" podID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerID="21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4" exitCode=0
Sep 12 00:50:44.219690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.219561    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerDied","Data":"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"}
Sep 12 00:50:44.220028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.220012    2556 scope.go:117] "RemoveContainer" containerID="21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"
Sep 12 00:50:44.221091 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.221064    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:44.221149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.221126    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:44.221188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:44.221155    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:50:45.227147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:45.227115    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerStarted","Data":"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"}
Sep 12 00:50:45.554149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:45.554054    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:45.554297 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:45.554252    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:45.554338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:45.554302    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:46.558894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:46.558857    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:46.559437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:46.559407    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:47.554467 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:47.554436    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:47.554635 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:47.554487    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:48.554285 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:48.554249    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:48.554675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:48.554301    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:49.555014 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:49.554975    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:49.555475 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:49.555040    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:50.554848 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:50.554812    2556 patch_prober.go:28] interesting pod/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 12 00:50:50.555129 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:50.555098    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 12 00:50:51.559489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:51.559452    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:51.560021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:51.559791    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:50:51.570135 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:50:51.569654    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:51:03.927846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:03.927808    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:51:15.934419 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:15.934385    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:51:15.934916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:15.934589    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy" containerID="cri-o://5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106" gracePeriod=30
Sep 12 00:51:21.195926 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.195902    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:51:21.345599 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345521    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345599 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345564    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345599 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345602    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345650    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345700    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345735    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345829    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345830    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:21.345916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345858    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4t4w\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w\") pod \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\" (UID: \"a0fabcbe-8222-4514-8c18-b5658db2cfa2\") "
Sep 12 00:51:21.346239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345945    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:21.346239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.345965    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:21.346239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346147    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:21.346239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346229    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:21.346448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346356    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.346448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346373    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.346448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346386    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.346448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346399    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.346448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.346412    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.347914 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.347888    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:21.348008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.347918    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:51:21.348008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.347939    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:21.348008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.347976    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w" (OuterVolumeSpecName: "kube-api-access-b4t4w") pod "a0fabcbe-8222-4514-8c18-b5658db2cfa2" (UID: "a0fabcbe-8222-4514-8c18-b5658db2cfa2"). InnerVolumeSpecName "kube-api-access-b4t4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:21.448002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.447973    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.448002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.447994    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.448002 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.448004    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4t4w\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-kube-api-access-b4t4w\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.448278 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.448014    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0fabcbe-8222-4514-8c18-b5658db2cfa2-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:21.451883 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.451851    2556 generic.go:356] "Generic (PLEG): container finished" podID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerID="5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106" exitCode=0
Sep 12 00:51:21.452017 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.451939    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"
Sep 12 00:51:21.455074 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.455044    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerDied","Data":"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"}
Sep 12 00:51:21.455198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.455100    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t" event={"ID":"a0fabcbe-8222-4514-8c18-b5658db2cfa2","Type":"ContainerDied","Data":"95c5298b53a70ce3c32482020e8e36b434dace5fea273d04a28a2311fdc8ffb1"}
Sep 12 00:51:21.455198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.455131    2556 scope.go:117] "RemoveContainer" containerID="5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"
Sep 12 00:51:21.467629 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.467612    2556 scope.go:117] "RemoveContainer" containerID="21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"
Sep 12 00:51:21.476110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.476084    2556 scope.go:117] "RemoveContainer" containerID="5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"
Sep 12 00:51:21.476370 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:51:21.476350    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106\": container with ID starting with 5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106 not found: ID does not exist" containerID="5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"
Sep 12 00:51:21.476434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.476376    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106"} err="failed to get container status \"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106\": rpc error: code = NotFound desc = could not find container \"5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106\": container with ID starting with 5288857d02610f6e2c1b61b760c627fa2403e0b48472c68c9414651f4a3f3106 not found: ID does not exist"
Sep 12 00:51:21.476434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.476392    2556 scope.go:117] "RemoveContainer" containerID="21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"
Sep 12 00:51:21.476623 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:51:21.476604    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4\": container with ID starting with 21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4 not found: ID does not exist" containerID="21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"
Sep 12 00:51:21.476663 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.476630    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4"} err="failed to get container status \"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4\": rpc error: code = NotFound desc = could not find container \"21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4\": container with ID starting with 21ba0188abeab0eb5558a3a2bdfdb3bb827774c6d4df6f21861e8439e964b3e4 not found: ID does not exist"
Sep 12 00:51:21.482640 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.482621    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:51:21.490214 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:21.490193    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t"]
Sep 12 00:51:23.457963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:23.455275    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" path="/var/lib/kubelet/pods/a0fabcbe-8222-4514-8c18-b5658db2cfa2/volumes"
Sep 12 00:51:36.597106 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597048    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:51:36.597772 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597738    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:36.597876 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597778    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:36.597876 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597792    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:36.597876 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597798    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:36.598023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.597915    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:36.603031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.603011    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.606249 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.606228    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-088c83-openshift-default-dockercfg-kpl9x\""
Sep 12 00:51:36.608024 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.608002    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:51:36.608217 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.608180    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" podUID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" containerName="maas-api" containerID="cri-o://b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d" gracePeriod=30
Sep 12 00:51:36.657078 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.657036    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:51:36.696112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696084    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696112 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696314 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669sb\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.696535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.696483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.798490 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.797923    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.798793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798547    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.798793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.798793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669sb\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.798793 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798881    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.799626    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.799675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.798453    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.800814 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.800297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.800814 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.800547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.800814 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.800779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.813447 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.812871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.813447 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.813105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.858316 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.858239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.861469 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.861379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669sb\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb\") pod \"e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") " pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:36.890990 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.890960    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:51:36.914322 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:36.914294    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:37.002147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.001564    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") pod \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") "
Sep 12 00:51:37.002147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.001623    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca\") pod \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") "
Sep 12 00:51:37.002147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.001644    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs\") pod \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") "
Sep 12 00:51:37.002147 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.001709    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j\") pod \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\" (UID: \"fc45597d-4d5d-42a2-bb87-3b0eb07620be\") "
Sep 12 00:51:37.002693 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.002650    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc45597d-4d5d-42a2-bb87-3b0eb07620be" (UID: "fc45597d-4d5d-42a2-bb87-3b0eb07620be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:37.005149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.004728    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j" (OuterVolumeSpecName: "kube-api-access-8rt5j") pod "fc45597d-4d5d-42a2-bb87-3b0eb07620be" (UID: "fc45597d-4d5d-42a2-bb87-3b0eb07620be"). InnerVolumeSpecName "kube-api-access-8rt5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:37.005149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.005059    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc45597d-4d5d-42a2-bb87-3b0eb07620be" (UID: "fc45597d-4d5d-42a2-bb87-3b0eb07620be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:51:37.005349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.005185    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fc45597d-4d5d-42a2-bb87-3b0eb07620be" (UID: "fc45597d-4d5d-42a2-bb87-3b0eb07620be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:51:37.103379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.103350    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:37.103379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.103376    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc45597d-4d5d-42a2-bb87-3b0eb07620be-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:37.103572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.103389    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc45597d-4d5d-42a2-bb87-3b0eb07620be-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:37.103572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.103400    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/fc45597d-4d5d-42a2-bb87-3b0eb07620be-kube-api-access-8rt5j\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:37.215706 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.215682    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:51:37.217416 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:51:37.217377    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a86e158_8daf_455a_98c7_5d50710fc713.slice/crio-92aaf8361d356a950db3a51d2dbe80b10b07ee97b7bd2383fe28043a5746f164 WatchSource:0}: Error finding container 92aaf8361d356a950db3a51d2dbe80b10b07ee97b7bd2383fe28043a5746f164: Status 404 returned error can't find the container with id 92aaf8361d356a950db3a51d2dbe80b10b07ee97b7bd2383fe28043a5746f164
Sep 12 00:51:37.219911 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.219877    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:37.220000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.219950    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:37.220000 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.219983    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:37.558814 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.558773    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerStarted","Data":"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"}
Sep 12 00:51:37.559091 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.559052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerStarted","Data":"92aaf8361d356a950db3a51d2dbe80b10b07ee97b7bd2383fe28043a5746f164"}
Sep 12 00:51:37.560576 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.560540    2556 generic.go:356] "Generic (PLEG): container finished" podID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" containerID="b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d" exitCode=0
Sep 12 00:51:37.560667 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.560587    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" event={"ID":"fc45597d-4d5d-42a2-bb87-3b0eb07620be","Type":"ContainerDied","Data":"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"}
Sep 12 00:51:37.560667 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.560615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v" event={"ID":"fc45597d-4d5d-42a2-bb87-3b0eb07620be","Type":"ContainerDied","Data":"ae78c7cd710f676ce8df057c7c39e16ecaafa3b8bf19e2a479f290e0718bce24"}
Sep 12 00:51:37.560667 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.560633    2556 scope.go:117] "RemoveContainer" containerID="b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"
Sep 12 00:51:37.560795 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.560587    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"
Sep 12 00:51:37.570093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.570076    2556 scope.go:117] "RemoveContainer" containerID="b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"
Sep 12 00:51:37.570373 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:51:37.570356    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d\": container with ID starting with b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d not found: ID does not exist" containerID="b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"
Sep 12 00:51:37.570416 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.570383    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d"} err="failed to get container status \"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d\": rpc error: code = NotFound desc = could not find container \"b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d\": container with ID starting with b3fb28ce08f1abc1d362d1d25737f272c5740250d7cb43cc6008ad0e5d132b4d not found: ID does not exist"
Sep 12 00:51:37.610136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.610094    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podStartSLOduration=1.6100811529999999 podStartE2EDuration="1.610081153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:37.608912879 +0000 UTC m=+1350.659498486" watchObservedRunningTime="2026-09-12 00:51:37.610081153 +0000 UTC m=+1350.660666804"
Sep 12 00:51:37.654686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.654660    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:51:37.662453 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.662425    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-c3f8d8-d76c7658b-8qd9v"]
Sep 12 00:51:37.914795 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:37.914747    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:38.920110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:38.920082    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:39.454553 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:39.454521    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" path="/var/lib/kubelet/pods/fc45597d-4d5d-42a2-bb87-3b0eb07620be/volumes"
Sep 12 00:51:39.574666 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:39.574637    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:39.575725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:39.575704    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:51:40.060069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:40.060038    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:51:45.580899 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.580862    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:51:45.581527 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.581507    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" containerName="maas-api"
Sep 12 00:51:45.581623 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.581530    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" containerName="maas-api"
Sep 12 00:51:45.581675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.581654    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fabcbe-8222-4514-8c18-b5658db2cfa2" containerName="istio-proxy"
Sep 12 00:51:45.581675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.581670    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc45597d-4d5d-42a2-bb87-3b0eb07620be" containerName="maas-api"
Sep 12 00:51:45.586410 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.586358    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.589093 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.589073    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-088c83-serving-cert\""
Sep 12 00:51:45.600726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.600703    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:51:45.688748 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.688717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.688900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.688783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzg7n\" (UniqueName: \"kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.688900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.688810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.688900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.688860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.790265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.790228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzg7n\" (UniqueName: \"kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.790985 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.790958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.791745 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.791723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.792747 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.792728    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.793378 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.792575    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.794305 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.794284    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.796163 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.796143    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.801895 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.801874    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzg7n\" (UniqueName: \"kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n\") pod \"maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:45.898863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:45.898788    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:46.185571 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:46.185544    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:51:46.187660 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:51:46.187636    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40d3671_89fb_4684_9d68_f69f9c3bdb24.slice/crio-3def13c9cb3d844f6e3256484dc294252cdd6c9dec833fc577993d8ea889f3f1 WatchSource:0}: Error finding container 3def13c9cb3d844f6e3256484dc294252cdd6c9dec833fc577993d8ea889f3f1: Status 404 returned error can't find the container with id 3def13c9cb3d844f6e3256484dc294252cdd6c9dec833fc577993d8ea889f3f1
Sep 12 00:51:46.189433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:46.189412    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:51:46.626611 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:46.626588    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" event={"ID":"f40d3671-89fb-4684-9d68-f69f9c3bdb24","Type":"ContainerStarted","Data":"3def13c9cb3d844f6e3256484dc294252cdd6c9dec833fc577993d8ea889f3f1"}
Sep 12 00:51:47.634209 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:47.634173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" event={"ID":"f40d3671-89fb-4684-9d68-f69f9c3bdb24","Type":"ContainerStarted","Data":"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"}
Sep 12 00:51:47.634800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:47.634228    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:47.655041 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:47.654994    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" podStartSLOduration=2.239271551 podStartE2EDuration="2.654979276s" totalImagesPullingTime="415.707725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:47.653246949 +0000 UTC m=+1360.703832555" watchObservedRunningTime="2026-09-12 00:51:47.654979276 +0000 UTC m=+1360.705564882"
Sep 12 00:51:49.964174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:49.964136    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:51:49.964657 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:49.964335    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" containerID="cri-o://6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd" gracePeriod=30
Sep 12 00:51:50.724569 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.724530    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:51:50.729003 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.728534    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.731247 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.731217    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-904cd0-openshift-default-dockercfg-2mzrh\""
Sep 12 00:51:50.743866 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.743841    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:51:50.848036 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9bpj\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848236 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848413 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848413 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848525 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848525 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.848525 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.848464    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.949751 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.949723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.949942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.949774    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.949942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.949822    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.949942 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.949845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.949967    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950125 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950036    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950144    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9bpj\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950240 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950456 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950566    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950719 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.950929 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.950909    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.952620 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.952596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.952824 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.952808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.963801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.963774    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:50.964639 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:50.964618    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9bpj\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj\") pod \"e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") " pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:51.040750 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.040686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:51.328862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.328834    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:51:51.329636 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:51:51.329612    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df69ddd_c6e6_4b37_8a11_ca7fdd98197d.slice/crio-99adfa3fd4014182caae73f0b17d6c524f54888b3e718d78131e93bc569c182b WatchSource:0}: Error finding container 99adfa3fd4014182caae73f0b17d6c524f54888b3e718d78131e93bc569c182b: Status 404 returned error can't find the container with id 99adfa3fd4014182caae73f0b17d6c524f54888b3e718d78131e93bc569c182b
Sep 12 00:51:51.332211 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.332175    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:51.332301 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.332256    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:51.332338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.332297    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:51:51.665021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.664992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" event={"ID":"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d","Type":"ContainerStarted","Data":"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"}
Sep 12 00:51:51.665231 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.665041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" event={"ID":"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d","Type":"ContainerStarted","Data":"99adfa3fd4014182caae73f0b17d6c524f54888b3e718d78131e93bc569c182b"}
Sep 12 00:51:51.691501 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:51.691458    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" podStartSLOduration=1.691442271 podStartE2EDuration="1.691442271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:51.688846562 +0000 UTC m=+1364.739432168" watchObservedRunningTime="2026-09-12 00:51:51.691442271 +0000 UTC m=+1364.742027878"
Sep 12 00:51:52.041887 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:52.041811    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:52.047747 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:52.047723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:52.678140 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:52.678104    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:52.678973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:52.678952    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:51:53.648072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:53.648039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:51:53.962979 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:53.962947    2556 patch_prober.go:28] interesting pod/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 00:51:53.963138 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:53.963002    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:51:55.210291 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.210270    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:51:55.296004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.295921    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.295981    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296009    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6j8z\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296049    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296081    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296108    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296135    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296190    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:55.296286 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296224    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket\") pod \"181e50af-fa01-4c74-9931-781b8514da6f\" (UID: \"181e50af-fa01-4c74-9931-781b8514da6f\") "
Sep 12 00:51:55.296643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296421    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:55.296643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:55.296643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296607    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:55.296643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296619    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.296643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296635    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.296931 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296649    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/181e50af-fa01-4c74-9931-781b8514da6f-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.296931 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.296661    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:55.298272 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.298239    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:55.298384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.298290    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z" (OuterVolumeSpecName: "kube-api-access-n6j8z") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "kube-api-access-n6j8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:55.298384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.298308    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:51:55.298384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.298342    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "181e50af-fa01-4c74-9931-781b8514da6f" (UID: "181e50af-fa01-4c74-9931-781b8514da6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:51:55.397844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397813    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6j8z\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-kube-api-access-n6j8z\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.397844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397838    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/181e50af-fa01-4c74-9931-781b8514da6f-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.397844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397848    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/181e50af-fa01-4c74-9931-781b8514da6f-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.398056 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397857    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.398056 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397865    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.398056 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.397873    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/181e50af-fa01-4c74-9931-781b8514da6f-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:51:55.698232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.698198    2556 generic.go:356] "Generic (PLEG): container finished" podID="181e50af-fa01-4c74-9931-781b8514da6f" containerID="6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd" exitCode=0
Sep 12 00:51:55.698415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.698246    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"
Sep 12 00:51:55.698415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.698252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerDied","Data":"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"}
Sep 12 00:51:55.698415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.698301    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n" event={"ID":"181e50af-fa01-4c74-9931-781b8514da6f","Type":"ContainerDied","Data":"30c5e39975ba9d457cfe993215a9b57161453c369ae83934144941a008e7d1e1"}
Sep 12 00:51:55.698415 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.698327    2556 scope.go:117] "RemoveContainer" containerID="6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"
Sep 12 00:51:55.707264 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.707246    2556 scope.go:117] "RemoveContainer" containerID="dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"
Sep 12 00:51:55.715163 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.715147    2556 scope.go:117] "RemoveContainer" containerID="6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"
Sep 12 00:51:55.715432 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:51:55.715414    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd\": container with ID starting with 6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd not found: ID does not exist" containerID="6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"
Sep 12 00:51:55.715490 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.715439    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd"} err="failed to get container status \"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd\": rpc error: code = NotFound desc = could not find container \"6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd\": container with ID starting with 6f17c817b5bd731991b2d3e6d57732989eb337ab16faca0c15087504176c74dd not found: ID does not exist"
Sep 12 00:51:55.715490 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.715455    2556 scope.go:117] "RemoveContainer" containerID="dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"
Sep 12 00:51:55.715686 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:51:55.715672    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b\": container with ID starting with dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b not found: ID does not exist" containerID="dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"
Sep 12 00:51:55.715724 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.715690    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b"} err="failed to get container status \"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b\": rpc error: code = NotFound desc = could not find container \"dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b\": container with ID starting with dc73504c60ebf06f54228b8338209a813a04374cf5fefb677fc7e7b9b469006b not found: ID does not exist"
Sep 12 00:51:55.723018 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.722997    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:51:55.725815 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:55.725796    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n"]
Sep 12 00:51:57.454034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:51:57.454003    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="181e50af-fa01-4c74-9931-781b8514da6f" path="/var/lib/kubelet/pods/181e50af-fa01-4c74-9931-781b8514da6f/volumes"
Sep 12 00:52:08.784686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.784651    2556 generic.go:356] "Generic (PLEG): container finished" podID="6a86e158-8daf-455a-98c7-5d50710fc713" containerID="f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad" exitCode=0
Sep 12 00:52:08.785120 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.784721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerDied","Data":"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"}
Sep 12 00:52:08.785171 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.785141    2556 scope.go:117] "RemoveContainer" containerID="f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"
Sep 12 00:52:08.786405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.786367    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:08.786584 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.786518    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:08.786671 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:08.786614    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:09.575357 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:09.575255    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:52:09.793251 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:09.793218    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerStarted","Data":"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"}
Sep 12 00:52:09.915434 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:09.915407    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:52:09.916387 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:09.916365    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 12 00:52:09.916469 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:09.916414    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 12 00:52:10.328460 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.328360    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 00:52:10.329023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329004    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.329023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329025    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.329180 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329035    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.329180 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329041    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.329180 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329135    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.329180 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.329150    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="181e50af-fa01-4c74-9931-781b8514da6f" containerName="istio-proxy"
Sep 12 00:52:10.331717 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.331699    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.335650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.335630    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c3ca75-openshift-default-dockercfg-cwmz5\""
Sep 12 00:52:10.348985 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.348879    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 00:52:10.442995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.442734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.442995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.442821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.442995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.442872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.442995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.442927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.442995 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.442975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.443402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.443008    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.443402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.443036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxd4\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.443402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.443089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.443402 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.443183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.543842 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.543804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.543933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.543966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxd4\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544100    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544716 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544690    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.544889 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.544864    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.545038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.545020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.546742 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.546637    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.546864 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.546817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.552881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.552859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.553926 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.553896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxd4\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4\") pod \"e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") " pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.643239 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.643166    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:10.915602 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.915569    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 12 00:52:10.916050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.915630    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 12 00:52:10.961336 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.961294    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 00:52:10.965426 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:52:10.965393    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8ea4f6_bf36_4621_ab05_692de406ee11.slice/crio-f40c5093e175f9a4d2d7b75e2dd05062ce931177bb7e4f027cd648335d8fb348 WatchSource:0}: Error finding container f40c5093e175f9a4d2d7b75e2dd05062ce931177bb7e4f027cd648335d8fb348: Status 404 returned error can't find the container with id f40c5093e175f9a4d2d7b75e2dd05062ce931177bb7e4f027cd648335d8fb348
Sep 12 00:52:10.971216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.968784    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:10.971216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.968867    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:10.971216 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:10.968907    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:11.807530 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:11.807487    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerStarted","Data":"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"}
Sep 12 00:52:11.807733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:11.807550    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerStarted","Data":"f40c5093e175f9a4d2d7b75e2dd05062ce931177bb7e4f027cd648335d8fb348"}
Sep 12 00:52:11.837088 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:11.837041    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podStartSLOduration=1.837026203 podStartE2EDuration="1.837026203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:52:11.834628143 +0000 UTC m=+1384.885213750" watchObservedRunningTime="2026-09-12 00:52:11.837026203 +0000 UTC m=+1384.887611809"
Sep 12 00:52:11.915296 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:11.915267    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 12 00:52:11.915450 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:11.915318    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 12 00:52:12.643294 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.643263    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:12.648222 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.648199    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:12.814150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.814126    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:12.815109 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.815087    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:12.914666 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.914630    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 12 00:52:12.914838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:12.914698    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 12 00:52:13.915040 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:13.915009    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 12 00:52:13.915405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:13.915062    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 12 00:52:14.918780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:14.918733    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:52:14.919297 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:14.919277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:52:14.919841 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:14.919825    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:52:15.327432 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.327358    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 00:52:15.330908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.330887    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.333697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.333670    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-c3ca75-serving-cert\""
Sep 12 00:52:15.341682 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.341659    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 00:52:15.402589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.402552    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.402752 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.402610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2td9\" (UniqueName: \"kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.402752 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.402690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.402752 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.402727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.504192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.504160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.504358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.504205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2td9\" (UniqueName: \"kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.504358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.504241    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.504358 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.504270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.504880 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.504853    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.506647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.506625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.506770 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.506741    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.517720 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.517700    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2td9\" (UniqueName: \"kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9\") pod \"maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.594196 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.594114    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:52:15.644888 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.644856    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:15.929898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:15.929863    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 00:52:15.930931 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:52:15.930907    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7dbd60_60ea_40dc_b42b_50bb27408773.slice/crio-29d9e9fa4d951b89cc3dbefe7fb4f96819703ceca881579fd1e603e99099fa5a WatchSource:0}: Error finding container 29d9e9fa4d951b89cc3dbefe7fb4f96819703ceca881579fd1e603e99099fa5a: Status 404 returned error can't find the container with id 29d9e9fa4d951b89cc3dbefe7fb4f96819703ceca881579fd1e603e99099fa5a
Sep 12 00:52:16.840545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:16.840445    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" event={"ID":"dc7dbd60-60ea-40dc-b42b-50bb27408773","Type":"ContainerStarted","Data":"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"}
Sep 12 00:52:16.840545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:16.840508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" event={"ID":"dc7dbd60-60ea-40dc-b42b-50bb27408773","Type":"ContainerStarted","Data":"29d9e9fa4d951b89cc3dbefe7fb4f96819703ceca881579fd1e603e99099fa5a"}
Sep 12 00:52:16.840734 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:16.840653    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:16.863246 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:16.863193    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" podStartSLOduration=1.263130439 podStartE2EDuration="1.863178797s" totalImagesPullingTime="600.048358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:52:16.860902078 +0000 UTC m=+1389.911487685" watchObservedRunningTime="2026-09-12 00:52:16.863178797 +0000 UTC m=+1389.913764404"
Sep 12 00:52:22.852588 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:22.852560    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 00:52:37.983790 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.983739    2556 generic.go:356] "Generic (PLEG): container finished" podID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerID="39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c" exitCode=0
Sep 12 00:52:37.984178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.983794    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerDied","Data":"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"}
Sep 12 00:52:37.984221 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.984188    2556 scope.go:117] "RemoveContainer" containerID="39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"
Sep 12 00:52:37.985305 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.985276    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:37.985367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.985344    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:37.985403 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:37.985378    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:38.992343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:38.992308    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerStarted","Data":"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"}
Sep 12 00:52:39.643471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:39.643437    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:39.644812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:39.644786    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 12 00:52:39.644922 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:39.644846    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 12 00:52:40.643535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:40.643498    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 12 00:52:40.643939 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:40.643568    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 12 00:52:41.644535 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:41.644499    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 12 00:52:41.644954 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:41.644558    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 12 00:52:42.643796 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:42.643746    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 12 00:52:42.643962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:42.643827    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 12 00:52:42.815016 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:42.814967    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:43.643769 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:43.643711    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 12 00:52:43.643956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:43.643791    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 12 00:52:44.648042 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:44.648013    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:44.649111 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:44.649089    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 00:52:47.618810 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:47.618779    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:52:48.460177 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.460140    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:52:48.463768 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.463739    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.466976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.466958    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5306e6ca-openshift-default-dockercfg-qdb7v\""
Sep 12 00:52:48.487268 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.487245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:52:48.556976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.556933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.557326 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.557302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lvw\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.557481 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.557465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.557608 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.557595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.557713 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.557700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.557925 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.557906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.558039 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.558026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.558143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.558130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.558238 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.558226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lvw\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659746    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.659956 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.659901    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.660424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.660172    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.660424 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.660411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.660652 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.660631    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.661135 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.661112    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.662585 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.662555    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.662889 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.662870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.675898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.675872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.676060 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.676042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lvw\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw\") pod \"e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") " pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:48.775053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:48.774972    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:49.063239 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:52:49.063200    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbcf958_993b_47e5_9032_8f0f68bcd249.slice/crio-6936ac306a9557d4ed92549bc98410541a03d35840996b2190d525c1c897083e WatchSource:0}: Error finding container 6936ac306a9557d4ed92549bc98410541a03d35840996b2190d525c1c897083e: Status 404 returned error can't find the container with id 6936ac306a9557d4ed92549bc98410541a03d35840996b2190d525c1c897083e
Sep 12 00:52:49.063380 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:49.063298    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:52:49.065471 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:49.065442    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:49.065579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:49.065504    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:49.065579 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:49.065538    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:52:50.074103 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:50.074071    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerStarted","Data":"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"}
Sep 12 00:52:50.074490 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:50.074123    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerStarted","Data":"6936ac306a9557d4ed92549bc98410541a03d35840996b2190d525c1c897083e"}
Sep 12 00:52:50.093547 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:50.093496    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podStartSLOduration=2.093478345 podStartE2EDuration="2.093478345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:52:50.092882926 +0000 UTC m=+1423.143468544" watchObservedRunningTime="2026-09-12 00:52:50.093478345 +0000 UTC m=+1423.144063952"
Sep 12 00:52:50.775650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:50.775618    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:50.781270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:50.781245    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:51.080701 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:51.080621    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:51.081603 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:51.081584    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:52:56.303333 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.303280    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:52:56.304316 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.304279    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" podUID="c0188a33-ce01-4884-bde2-428a5d7028f2" containerName="maas-api" containerID="cri-o://751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da" gracePeriod=30
Sep 12 00:52:56.366569 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.366533    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:52:56.366851 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.366804    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" podUID="5ba285b5-d30a-40a2-a264-d9705458495f" containerName="payload-processing" containerID="cri-o://1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b" gracePeriod=30
Sep 12 00:52:56.661872 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.661841    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:52:56.696241 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.696199    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:52:56.751740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.747002    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls\") pod \"c0188a33-ce01-4884-bde2-428a5d7028f2\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") "
Sep 12 00:52:56.751740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.747506    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs\") pod \"c0188a33-ce01-4884-bde2-428a5d7028f2\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") "
Sep 12 00:52:56.751740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.747992    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca\") pod \"c0188a33-ce01-4884-bde2-428a5d7028f2\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") "
Sep 12 00:52:56.751740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.748036    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9sks\" (UniqueName: \"kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks\") pod \"c0188a33-ce01-4884-bde2-428a5d7028f2\" (UID: \"c0188a33-ce01-4884-bde2-428a5d7028f2\") "
Sep 12 00:52:56.751740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.749089    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0188a33-ce01-4884-bde2-428a5d7028f2" (UID: "c0188a33-ce01-4884-bde2-428a5d7028f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:52:56.753245 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.753164    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c0188a33-ce01-4884-bde2-428a5d7028f2" (UID: "c0188a33-ce01-4884-bde2-428a5d7028f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:52:56.754412 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.754387    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks" (OuterVolumeSpecName: "kube-api-access-m9sks") pod "c0188a33-ce01-4884-bde2-428a5d7028f2" (UID: "c0188a33-ce01-4884-bde2-428a5d7028f2"). InnerVolumeSpecName "kube-api-access-m9sks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:52:56.755493 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.755461    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0188a33-ce01-4884-bde2-428a5d7028f2" (UID: "c0188a33-ce01-4884-bde2-428a5d7028f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:52:56.848905 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.848821    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume\") pod \"5ba285b5-d30a-40a2-a264-d9705458495f\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") "
Sep 12 00:52:56.848905 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.848895    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqqg5\" (UniqueName: \"kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5\") pod \"5ba285b5-d30a-40a2-a264-d9705458495f\" (UID: \"5ba285b5-d30a-40a2-a264-d9705458495f\") "
Sep 12 00:52:56.849143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.849132    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:56.849191 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.849144    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0188a33-ce01-4884-bde2-428a5d7028f2-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:56.849191 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.849153    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0188a33-ce01-4884-bde2-428a5d7028f2-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:56.849191 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.849162    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9sks\" (UniqueName: \"kubernetes.io/projected/c0188a33-ce01-4884-bde2-428a5d7028f2-kube-api-access-m9sks\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:56.849191 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.849174    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ba285b5-d30a-40a2-a264-d9705458495f" (UID: "5ba285b5-d30a-40a2-a264-d9705458495f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:52:56.850907 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.850880    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5" (OuterVolumeSpecName: "kube-api-access-tqqg5") pod "5ba285b5-d30a-40a2-a264-d9705458495f" (UID: "5ba285b5-d30a-40a2-a264-d9705458495f"). InnerVolumeSpecName "kube-api-access-tqqg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:52:56.950662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.950629    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqqg5\" (UniqueName: \"kubernetes.io/projected/5ba285b5-d30a-40a2-a264-d9705458495f-kube-api-access-tqqg5\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:56.950662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:56.950657    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba285b5-d30a-40a2-a264-d9705458495f-plugins-config-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:52:57.120647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.120555    2556 generic.go:356] "Generic (PLEG): container finished" podID="5ba285b5-d30a-40a2-a264-d9705458495f" containerID="1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b" exitCode=0
Sep 12 00:52:57.120647 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.120602    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"
Sep 12 00:52:57.120901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.120640    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" event={"ID":"5ba285b5-d30a-40a2-a264-d9705458495f","Type":"ContainerDied","Data":"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"}
Sep 12 00:52:57.120901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.120700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p" event={"ID":"5ba285b5-d30a-40a2-a264-d9705458495f","Type":"ContainerDied","Data":"5c4fbbcf9f4340eba6383fb18ee132ca91e0ea683d692960ed1cc6fc61b40d9b"}
Sep 12 00:52:57.120901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.120728    2556 scope.go:117] "RemoveContainer" containerID="1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"
Sep 12 00:52:57.122598 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.122574    2556 generic.go:356] "Generic (PLEG): container finished" podID="c0188a33-ce01-4884-bde2-428a5d7028f2" containerID="751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da" exitCode=0
Sep 12 00:52:57.122703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.122611    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" event={"ID":"c0188a33-ce01-4884-bde2-428a5d7028f2","Type":"ContainerDied","Data":"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"}
Sep 12 00:52:57.122703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.122627    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"
Sep 12 00:52:57.122703 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.122663    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km" event={"ID":"c0188a33-ce01-4884-bde2-428a5d7028f2","Type":"ContainerDied","Data":"4a77f0f1718857e59155957da0e00aa9c52eff07c9936fa94517893e5de83663"}
Sep 12 00:52:57.133812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.133750    2556 scope.go:117] "RemoveContainer" containerID="1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"
Sep 12 00:52:57.134239 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:52:57.134220    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b\": container with ID starting with 1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b not found: ID does not exist" containerID="1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"
Sep 12 00:52:57.134304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.134248    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b"} err="failed to get container status \"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b\": rpc error: code = NotFound desc = could not find container \"1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b\": container with ID starting with 1663e010c147e16b4b4441aaa014ad755ae7473a6517cfc16facc7a2e3036b5b not found: ID does not exist"
Sep 12 00:52:57.134304 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.134264    2556 scope.go:117] "RemoveContainer" containerID="751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"
Sep 12 00:52:57.143113 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.143097    2556 scope.go:117] "RemoveContainer" containerID="751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"
Sep 12 00:52:57.143406 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:52:57.143379    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da\": container with ID starting with 751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da not found: ID does not exist" containerID="751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"
Sep 12 00:52:57.143481 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.143414    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da"} err="failed to get container status \"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da\": rpc error: code = NotFound desc = could not find container \"751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da\": container with ID starting with 751dce1c340651cc2337222769bc63ad7f581e9c89d28910b12a44de72fc00da not found: ID does not exist"
Sep 12 00:52:57.150980 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.150960    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:52:57.164327 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.164291    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-81df64-f849694fb-ff4km"]
Sep 12 00:52:57.184457 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.184429    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:52:57.195395 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.195370    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p"]
Sep 12 00:52:57.474639 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.472209    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba285b5-d30a-40a2-a264-d9705458495f" path="/var/lib/kubelet/pods/5ba285b5-d30a-40a2-a264-d9705458495f/volumes"
Sep 12 00:52:57.474639 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:52:57.472853    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0188a33-ce01-4884-bde2-428a5d7028f2" path="/var/lib/kubelet/pods/c0188a33-ce01-4884-bde2-428a5d7028f2/volumes"
Sep 12 00:53:03.442295 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:03.442211    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:53:03.442726 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:03.442415    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" containerID="cri-o://98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9" gracePeriod=30
Sep 12 00:53:07.956944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:07.956898    2556 patch_prober.go:28] interesting pod/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 00:53:07.957367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:07.956961    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:53:08.695160 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.695134    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:53:08.873659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873574    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.873855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873658    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.873855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873689    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.873855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873718    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5gn9\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.873855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873795    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.873855 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873820    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.874122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873893    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.874122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873899    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:08.874122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873962    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.874122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.873978    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:08.874122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874001    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert\") pod \"4a6957fd-6162-4202-b2b0-2a78ec730902\" (UID: \"4a6957fd-6162-4202-b2b0-2a78ec730902\") "
Sep 12 00:53:08.874365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874141    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:08.874365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874299    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:08.874466 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874415    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:53:08.874466 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874455    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.874572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874472    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.874572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874486    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.874572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.874498    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.876070 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.876039    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:08.876206 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.876138    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9" (OuterVolumeSpecName: "kube-api-access-v5gn9") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "kube-api-access-v5gn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:53:08.876206 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.876175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:53:08.876385 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.876367    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a6957fd-6162-4202-b2b0-2a78ec730902" (UID: "4a6957fd-6162-4202-b2b0-2a78ec730902"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:53:08.975746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.975714    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6957fd-6162-4202-b2b0-2a78ec730902-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.975746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.975739    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.975746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.975748    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5gn9\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-kube-api-access-v5gn9\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.976173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.975782    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:08.976173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:08.975790    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6957fd-6162-4202-b2b0-2a78ec730902-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:09.208627 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.208594    2556 generic.go:356] "Generic (PLEG): container finished" podID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerID="98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9" exitCode=0
Sep 12 00:53:09.208852 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.208644    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"
Sep 12 00:53:09.208852 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.208684    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerDied","Data":"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"}
Sep 12 00:53:09.208852 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.208749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt" event={"ID":"4a6957fd-6162-4202-b2b0-2a78ec730902","Type":"ContainerDied","Data":"34049ad532e89f2b84f6a8f29e7292a62012a31a34cb8bacdbd32cb7442eef57"}
Sep 12 00:53:09.208852 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.208809    2556 scope.go:117] "RemoveContainer" containerID="98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"
Sep 12 00:53:09.218830 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.218809    2556 scope.go:117] "RemoveContainer" containerID="4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"
Sep 12 00:53:09.227657 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.227627    2556 scope.go:117] "RemoveContainer" containerID="98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"
Sep 12 00:53:09.228270 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:53:09.228134    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9\": container with ID starting with 98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9 not found: ID does not exist" containerID="98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"
Sep 12 00:53:09.228270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.228193    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9"} err="failed to get container status \"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9\": rpc error: code = NotFound desc = could not find container \"98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9\": container with ID starting with 98c0a977613c6f045b193135c3df7f89a1baaed2fffb6540a77055fce54438e9 not found: ID does not exist"
Sep 12 00:53:09.228270 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.228217    2556 scope.go:117] "RemoveContainer" containerID="4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"
Sep 12 00:53:09.228805 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:53:09.228784    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625\": container with ID starting with 4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625 not found: ID does not exist" containerID="4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"
Sep 12 00:53:09.228881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.228810    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625"} err="failed to get container status \"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625\": rpc error: code = NotFound desc = could not find container \"4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625\": container with ID starting with 4bc0bde1b2945119e7a863de8a3afd29b778242330b761b4e2de371a2030d625 not found: ID does not exist"
Sep 12 00:53:09.231792 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.231772    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:53:09.234733 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.234702    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt"]
Sep 12 00:53:09.455052 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:09.455018    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" path="/var/lib/kubelet/pods/4a6957fd-6162-4202-b2b0-2a78ec730902/volumes"
Sep 12 00:53:10.347664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:10.347634    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:53:10.348076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:10.347866    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" podUID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" containerName="istio-proxy" containerID="cri-o://73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636" gracePeriod=30
Sep 12 00:53:14.292013 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.291970    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:53:14.292483 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.292191    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" podUID="ea527749-7daa-440c-bd47-89f4b39c0c96" containerName="maas-api" containerID="cri-o://44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845" gracePeriod=30
Sep 12 00:53:14.545731 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.545675    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:53:14.630962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.630936    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcz4f\" (UniqueName: \"kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f\") pod \"ea527749-7daa-440c-bd47-89f4b39c0c96\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") "
Sep 12 00:53:14.631159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.630970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca\") pod \"ea527749-7daa-440c-bd47-89f4b39c0c96\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") "
Sep 12 00:53:14.631159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.631111    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs\") pod \"ea527749-7daa-440c-bd47-89f4b39c0c96\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") "
Sep 12 00:53:14.631159 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.631134    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") pod \"ea527749-7daa-440c-bd47-89f4b39c0c96\" (UID: \"ea527749-7daa-440c-bd47-89f4b39c0c96\") "
Sep 12 00:53:14.631355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.631330    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea527749-7daa-440c-bd47-89f4b39c0c96" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:53:14.631469 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.631454    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea527749-7daa-440c-bd47-89f4b39c0c96-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:14.633055 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.633033    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea527749-7daa-440c-bd47-89f4b39c0c96" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:53:14.633161 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.633136    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea527749-7daa-440c-bd47-89f4b39c0c96" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:53:14.633218 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.633201    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f" (OuterVolumeSpecName: "kube-api-access-mcz4f") pod "ea527749-7daa-440c-bd47-89f4b39c0c96" (UID: "ea527749-7daa-440c-bd47-89f4b39c0c96"). InnerVolumeSpecName "kube-api-access-mcz4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:53:14.732425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.732393    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:14.732425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.732419    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea527749-7daa-440c-bd47-89f4b39c0c96-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:14.732425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:14.732428    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcz4f\" (UniqueName: \"kubernetes.io/projected/ea527749-7daa-440c-bd47-89f4b39c0c96-kube-api-access-mcz4f\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.248144 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.248109    2556 generic.go:356] "Generic (PLEG): container finished" podID="ea527749-7daa-440c-bd47-89f4b39c0c96" containerID="44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845" exitCode=0
Sep 12 00:53:15.248338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.248161    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"
Sep 12 00:53:15.248338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.248187    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" event={"ID":"ea527749-7daa-440c-bd47-89f4b39c0c96","Type":"ContainerDied","Data":"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"}
Sep 12 00:53:15.248338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.248238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm" event={"ID":"ea527749-7daa-440c-bd47-89f4b39c0c96","Type":"ContainerDied","Data":"3e93a239450db69b8ebcfc2c10bcf9788c9c363b53ff22e20034e3460c5729ef"}
Sep 12 00:53:15.248338 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.248260    2556 scope.go:117] "RemoveContainer" containerID="44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"
Sep 12 00:53:15.259551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.259533    2556 scope.go:117] "RemoveContainer" containerID="44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"
Sep 12 00:53:15.259873 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:53:15.259848    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845\": container with ID starting with 44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845 not found: ID does not exist" containerID="44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"
Sep 12 00:53:15.259945 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.259886    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845"} err="failed to get container status \"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845\": rpc error: code = NotFound desc = could not find container \"44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845\": container with ID starting with 44cadb9231920a8b922b2a619cfd23c058c7aeba2156f68106c3fbd28b572845 not found: ID does not exist"
Sep 12 00:53:15.280846 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.280819    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:53:15.283602 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.283574    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bb6e74-5768866b94-xghrm"]
Sep 12 00:53:15.454690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.454657    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea527749-7daa-440c-bd47-89f4b39c0c96" path="/var/lib/kubelet/pods/ea527749-7daa-440c-bd47-89f4b39c0c96/volumes"
Sep 12 00:53:15.606329 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.606309    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:53:15.639102 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639078    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639123    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9bpj\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639147    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639212 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639193    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639230    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639257    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639292    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639331    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639362 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639355    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:15.639622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639379    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token\") pod \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\" (UID: \"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d\") "
Sep 12 00:53:15.639622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639502    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data" (OuterVolumeSpecName: "istio-data") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:15.639622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639528    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:15.639821 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639803    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.639898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639826    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.639898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639833    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:15.639898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639840    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.640050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.639966    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:53:15.641379 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.641348    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:53:15.641692 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.641668    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj" (OuterVolumeSpecName: "kube-api-access-q9bpj") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "kube-api-access-q9bpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:53:15.641861 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.641835    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:53:15.641950 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.641862    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" (UID: "4df69ddd-c6e6-4b37-8a11-ca7fdd98197d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:53:15.740564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740531    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.740564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740559    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.740564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740568    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9bpj\" (UniqueName: \"kubernetes.io/projected/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-kube-api-access-q9bpj\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.740802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740576    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.740802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740585    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:15.740802 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:15.740592    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:53:16.255364 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.255322    2556 generic.go:356] "Generic (PLEG): container finished" podID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" containerID="73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636" exitCode=0
Sep 12 00:53:16.255572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.255401    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"
Sep 12 00:53:16.255572 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.255407    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" event={"ID":"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d","Type":"ContainerDied","Data":"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"}
Sep 12 00:53:16.255837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.255813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4" event={"ID":"4df69ddd-c6e6-4b37-8a11-ca7fdd98197d","Type":"ContainerDied","Data":"99adfa3fd4014182caae73f0b17d6c524f54888b3e718d78131e93bc569c182b"}
Sep 12 00:53:16.255930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.255860    2556 scope.go:117] "RemoveContainer" containerID="73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"
Sep 12 00:53:16.268198 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.268179    2556 scope.go:117] "RemoveContainer" containerID="73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"
Sep 12 00:53:16.268482 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:53:16.268457    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636\": container with ID starting with 73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636 not found: ID does not exist" containerID="73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"
Sep 12 00:53:16.268596 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.268488    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636"} err="failed to get container status \"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636\": rpc error: code = NotFound desc = could not find container \"73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636\": container with ID starting with 73d8baae50ed2229d1a547f2d046a7f3fb83c3e9b8f78bfbf62ace9b3e791636 not found: ID does not exist"
Sep 12 00:53:16.283715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.283687    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:53:16.289740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:16.289715    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4"]
Sep 12 00:53:17.454330 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:17.454294    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" path="/var/lib/kubelet/pods/4df69ddd-c6e6-4b37-8a11-ca7fdd98197d/volumes"
Sep 12 00:53:17.520178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:17.520144    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:53:28.339290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.339197    2556 generic.go:356] "Generic (PLEG): container finished" podID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerID="f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d" exitCode=0
Sep 12 00:53:28.339290 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.339236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerDied","Data":"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"}
Sep 12 00:53:28.339704 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.339631    2556 scope.go:117] "RemoveContainer" containerID="f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"
Sep 12 00:53:28.340700 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.340670    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:28.340831 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.340750    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:28.340831 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:28.340813    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:29.354265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:29.354228    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerStarted","Data":"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"}
Sep 12 00:53:29.776339 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:29.776304    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:53:29.776713 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:29.776627    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 12 00:53:29.776916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:29.776892    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 12 00:53:30.775409 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:30.775362    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 12 00:53:30.775929 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:30.775448    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 12 00:53:31.776059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:31.776020    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 12 00:53:31.776670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:31.776630    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 12 00:53:32.776374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:32.776339    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 12 00:53:32.776961 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:32.776926    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 12 00:53:33.776848 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:33.776363    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 12 00:53:33.776848 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:33.776442    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 12 00:53:34.779670 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:34.779639    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:53:34.780084 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:34.780014    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:53:34.780633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:34.780613    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:53:49.169597 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:49.169566    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:53:57.841235 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841198    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 00:53:57.841709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841680    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea527749-7daa-440c-bd47-89f4b39c0c96" containerName="maas-api"
Sep 12 00:53:57.841709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841695    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea527749-7daa-440c-bd47-89f4b39c0c96" containerName="maas-api"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841711    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841717    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841725    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841731    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841738    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0188a33-ce01-4884-bde2-428a5d7028f2" containerName="maas-api"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841743    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0188a33-ce01-4884-bde2-428a5d7028f2" containerName="maas-api"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841751    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841773    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" containerName="istio-proxy"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841791    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba285b5-d30a-40a2-a264-d9705458495f" containerName="payload-processing"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841798    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba285b5-d30a-40a2-a264-d9705458495f" containerName="payload-processing"
Sep 12 00:53:57.841863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841867    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0188a33-ce01-4884-bde2-428a5d7028f2" containerName="maas-api"
Sep 12 00:53:57.842421 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841875    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea527749-7daa-440c-bd47-89f4b39c0c96" containerName="maas-api"
Sep 12 00:53:57.842421 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841882    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba285b5-d30a-40a2-a264-d9705458495f" containerName="payload-processing"
Sep 12 00:53:57.842421 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841888    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:53:57.842421 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.841893    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4df69ddd-c6e6-4b37-8a11-ca7fdd98197d" containerName="istio-proxy"
Sep 12 00:53:57.845844 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.845822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.848590 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.848567    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-9511bd-openshift-default-dockercfg-l6w4z\""
Sep 12 00:53:57.856651 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.856627    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.856881 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.856860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857023 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857151 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857134    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvkc\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857332 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857315    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857458 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857574 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857801 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.857890 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.857847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.859137 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.859109    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 00:53:57.959315 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.959278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960293 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960451 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvkc\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960577 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960672 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.960909 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960894    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.961032 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.961019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.961168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.961154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.961403 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.961375    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.961964 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.960222    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.962666 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.962116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.962818 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.962427    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.962931 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.962617    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.968482 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.968454    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.968724 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.968706    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.971329 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.971305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvkc\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:57.972587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:57.972197    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token\") pod \"e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") " pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:58.160488 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.160460    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:58.434699 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.434669    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 00:53:58.435628 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:53:58.435601    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6822faeb_698c_456b_bd20_26488fc780d6.slice/crio-7b768a612dacc261c6f375e440e25915c5d67dbcd2a7f99f453ed19f56f1eed8 WatchSource:0}: Error finding container 7b768a612dacc261c6f375e440e25915c5d67dbcd2a7f99f453ed19f56f1eed8: Status 404 returned error can't find the container with id 7b768a612dacc261c6f375e440e25915c5d67dbcd2a7f99f453ed19f56f1eed8
Sep 12 00:53:58.437835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.437807    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:58.437944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.437864    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:58.437944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.437892    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:53:58.557603 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.557563    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerStarted","Data":"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"}
Sep 12 00:53:58.557775 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.557630    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerStarted","Data":"7b768a612dacc261c6f375e440e25915c5d67dbcd2a7f99f453ed19f56f1eed8"}
Sep 12 00:53:58.578656 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:58.578604    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podStartSLOduration=1.578585133 podStartE2EDuration="1.578585133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:53:58.57651393 +0000 UTC m=+1491.627099538" watchObservedRunningTime="2026-09-12 00:53:58.578585133 +0000 UTC m=+1491.629170743"
Sep 12 00:53:59.161593 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:59.161551    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:59.166709 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:59.166687    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:59.563893 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:59.563812    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:53:59.564832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:53:59.564804    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:54:04.619669 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.619633    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 00:54:04.620426 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.620410    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6957fd-6162-4202-b2b0-2a78ec730902" containerName="istio-proxy"
Sep 12 00:54:04.624405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.624381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.627375 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.627351    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-9511bd-serving-cert\""
Sep 12 00:54:04.633803 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.633783    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 00:54:04.727626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.725356    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.727626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.725426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.727626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.725515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.727626 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.725558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxbx\" (UniqueName: \"kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.826858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.826822    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.827059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.826894    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxbx\" (UniqueName: \"kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.827059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.827013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.827059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.827048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.827853 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.827822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.829505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.829478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.829505 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.829490    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.836618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.836599    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxbx\" (UniqueName: \"kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx\") pod \"maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:04.936650 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:04.936610    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:05.215150 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:05.215120    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 00:54:05.216394 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:54:05.216367    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa68bb21_6089_4317_87bf_7578a5da8358.slice/crio-114275bb2090f28d47a89dc1728d268d171979e49872383d135b20ec9b3eb3a3 WatchSource:0}: Error finding container 114275bb2090f28d47a89dc1728d268d171979e49872383d135b20ec9b3eb3a3: Status 404 returned error can't find the container with id 114275bb2090f28d47a89dc1728d268d171979e49872383d135b20ec9b3eb3a3
Sep 12 00:54:05.605847 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:05.605778    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" event={"ID":"aa68bb21-6089-4317-87bf-7578a5da8358","Type":"ContainerStarted","Data":"114275bb2090f28d47a89dc1728d268d171979e49872383d135b20ec9b3eb3a3"}
Sep 12 00:54:06.613917 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:06.613881    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" event={"ID":"aa68bb21-6089-4317-87bf-7578a5da8358","Type":"ContainerStarted","Data":"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"}
Sep 12 00:54:06.614310 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:06.613992    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:06.633614 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:06.633564    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" podStartSLOduration=2.238607923 podStartE2EDuration="2.633549516s" totalImagesPullingTime="394.941593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:54:06.631103286 +0000 UTC m=+1499.681688895" watchObservedRunningTime="2026-09-12 00:54:06.633549516 +0000 UTC m=+1499.684135174"
Sep 12 00:54:12.625072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:12.625044    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 00:54:22.224751 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:22.224716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:54:30.604977 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:30.604891    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 00:54:30.604977 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:30.604958    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 00:54:31.134826 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.134793    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 00:54:31.139977 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.139958    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.142746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.142726    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-dd25dd-openshift-default-dockercfg-g2p67\""
Sep 12 00:54:31.149365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.149342    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 00:54:31.217367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217545 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217561    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplhg\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217702 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217860 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.217860 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.217806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318495 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318495 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318499    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318535    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.318799 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.318842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vplhg\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319181 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.319077    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319333 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.319290    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319448 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.319373    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319714 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.319633    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.319835 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.319787    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.321171 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.321149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.321559 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.321540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.327346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.327252    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.328079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.328058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplhg\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg\") pod \"e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") " pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.455717 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.455683    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:31.738937 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.738909    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 00:54:31.740026 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:54:31.740004    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b555865_580a_4ba3_a532_02e1e86a9c53.slice/crio-b1d55e44fcbd6c4aa2d14d6f7aefe6cf5821e032bec9752c2aaae68bafd1c621 WatchSource:0}: Error finding container b1d55e44fcbd6c4aa2d14d6f7aefe6cf5821e032bec9752c2aaae68bafd1c621: Status 404 returned error can't find the container with id b1d55e44fcbd6c4aa2d14d6f7aefe6cf5821e032bec9752c2aaae68bafd1c621
Sep 12 00:54:31.742795 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.742736    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:31.742908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.742843    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:31.742908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.742887    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:31.771563 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:31.771540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerStarted","Data":"b1d55e44fcbd6c4aa2d14d6f7aefe6cf5821e032bec9752c2aaae68bafd1c621"}
Sep 12 00:54:32.780336 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:32.780302    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerStarted","Data":"9d3fae6b81c418b56bb506a959faadcaf713b068175e57a5058aad1a8bb44e55"}
Sep 12 00:54:32.807773 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:32.807528    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podStartSLOduration=1.807506911 podStartE2EDuration="1.807506911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:54:32.802354371 +0000 UTC m=+1525.852939993" watchObservedRunningTime="2026-09-12 00:54:32.807506911 +0000 UTC m=+1525.858092526"
Sep 12 00:54:33.456951 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.456916    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:33.462643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.462619    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:33.787962 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.787885    2556 generic.go:356] "Generic (PLEG): container finished" podID="6822faeb-698c-456b-bd20-26488fc780d6" containerID="f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5" exitCode=0
Sep 12 00:54:33.788336 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.787959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerDied","Data":"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"}
Sep 12 00:54:33.788408 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.788383    2556 scope.go:117] "RemoveContainer" containerID="f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"
Sep 12 00:54:33.788477 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.788383    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:33.789298 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.789281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:54:33.789554 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.789524    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:33.789654 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.789609    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:33.789734 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:33.789691    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:34.801547 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:34.801497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerStarted","Data":"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"}
Sep 12 00:54:35.161449 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:35.161415    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:54:35.161643 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:35.161606    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:35.161705 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:35.161653    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:36.161729 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:36.161692    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:36.162306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:36.162271    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:37.161587 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:37.161551    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:37.161905 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:37.161875    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:38.161088 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:38.161054    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:38.161369 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:38.161341    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:39.102915 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.102875    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 00:54:39.105916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.105896    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.106255 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.106226    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 00:54:39.108543 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.108524    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-dd25dd-serving-cert\""
Sep 12 00:54:39.163561 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.163129    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:39.163561 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.163194    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:39.216737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.216696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.216926 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.216747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.216976 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.216926    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.217018 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.216990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljjf\" (UniqueName: \"kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.318658 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.318567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.318658 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.318608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.318937 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.318716    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.318937 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.318739    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljjf\" (UniqueName: \"kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.319111 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:54:39.319093    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-serving-cert: secret "maas-api-e2e-shared-b-w3-dd25dd-serving-cert" not found
Sep 12 00:54:39.319274 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:54:39.319265    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls podName:c32024f4-d3a1-46a3-be45-a1176fb89cdf nodeName:}" failed. No retries permitted until 2026-09-12 00:54:39.819250603 +0000 UTC m=+1532.869836189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls") pod "maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" (UID: "c32024f4-d3a1-46a3-be45-a1176fb89cdf") : secret "maas-api-e2e-shared-b-w3-dd25dd-serving-cert" not found
Sep 12 00:54:39.319367 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.319305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.322786 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.321083    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.330197 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.330177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljjf\" (UniqueName: \"kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.826074 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.826037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:39.830695 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:39.830652    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:40.020908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.020874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:40.162780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.162138    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 12 00:54:40.162780 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.162199    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 12 00:54:40.319782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.319552    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 00:54:40.320674 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:54:40.320650    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32024f4_d3a1_46a3_be45_a1176fb89cdf.slice/crio-8be7ae4b7c1b61d25ea380511f647aa3849562e877ddf46098c324129e2d5e71 WatchSource:0}: Error finding container 8be7ae4b7c1b61d25ea380511f647aa3849562e877ddf46098c324129e2d5e71: Status 404 returned error can't find the container with id 8be7ae4b7c1b61d25ea380511f647aa3849562e877ddf46098c324129e2d5e71
Sep 12 00:54:40.846405 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.846371    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" event={"ID":"c32024f4-d3a1-46a3-be45-a1176fb89cdf","Type":"ContainerStarted","Data":"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"}
Sep 12 00:54:40.846573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.846430    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" event={"ID":"c32024f4-d3a1-46a3-be45-a1176fb89cdf","Type":"ContainerStarted","Data":"8be7ae4b7c1b61d25ea380511f647aa3849562e877ddf46098c324129e2d5e71"}
Sep 12 00:54:40.846573 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.846457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:40.864878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:40.864828    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" podStartSLOduration=1.5505059829999999 podStartE2EDuration="1.86481354s" totalImagesPullingTime="314.307557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:54:40.861896866 +0000 UTC m=+1533.912482486" watchObservedRunningTime="2026-09-12 00:54:40.86481354 +0000 UTC m=+1533.915399140"
Sep 12 00:54:41.165769 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:41.165732    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:54:41.166193 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:41.166142    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:54:41.166933 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:41.166912    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 00:54:46.858404 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:46.858372    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 00:54:49.033391 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:49.033355    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:54:59.966160 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.966121    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerID="9d3fae6b81c418b56bb506a959faadcaf713b068175e57a5058aad1a8bb44e55" exitCode=0
Sep 12 00:54:59.966618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.966188    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerDied","Data":"9d3fae6b81c418b56bb506a959faadcaf713b068175e57a5058aad1a8bb44e55"}
Sep 12 00:54:59.966618 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.966576    2556 scope.go:117] "RemoveContainer" containerID="9d3fae6b81c418b56bb506a959faadcaf713b068175e57a5058aad1a8bb44e55"
Sep 12 00:54:59.967863 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.967837    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:59.967944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.967905    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:54:59.967944 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:54:59.967936    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:55:00.979952 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:00.979906    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerStarted","Data":"afd0cb39acb218a866a5ff38b273d9101419d8d7333adae773712212508a6a3f"}
Sep 12 00:55:01.456622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:01.456584    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:55:01.457923 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:01.457891    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 12 00:55:01.458072 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:01.457948    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 12 00:55:02.456732 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:02.456687    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 12 00:55:02.457266 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:02.456810    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 12 00:55:03.456747 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:03.456714    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 12 00:55:03.457348 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:03.457318    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 12 00:55:03.788983 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:03.788903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:55:04.456987 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:04.456948    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 12 00:55:04.457478 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:04.457030    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 12 00:55:05.457332 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:05.457298    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 12 00:55:05.457930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:05.457900    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 12 00:55:06.461349 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:06.461321    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:55:06.462484 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:06.462461    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 00:55:15.313539 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:15.313502    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:55:47.243743 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:55:47.243709    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:56:22.722969 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:22.722889    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:56:46.994177 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:46.994145    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:56:46.994617 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:46.994362    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" containerID="cri-o://4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8" gracePeriod=30
Sep 12 00:56:49.781659 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:49.781623    2556 patch_prober.go:28] interesting pod/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 00:56:49.782104 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:49.781694    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:56:52.265139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.265081    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:56:52.396723 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396688    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.396901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396778    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.396901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396809    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.396901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396838    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396926    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72lvw\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.396969    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397054    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397101    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:52.397234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397130    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397234 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397155    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo\") pod \"9bbcf958-993b-47e5-9032-8f0f68bcd249\" (UID: \"9bbcf958-993b-47e5-9032-8f0f68bcd249\") "
Sep 12 00:56:52.397398 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397303    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:52.397398 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397353    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:52.397503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397396    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:56:52.397554 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397509    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:52.397697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397675    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.397789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397699    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.397789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397709    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.397789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397717    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bbcf958-993b-47e5-9032-8f0f68bcd249-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.397789 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.397725    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.399127 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.399101    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:56:52.399127 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.399108    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:56:52.399265 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.399207    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:52.399341 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.399319    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw" (OuterVolumeSpecName: "kube-api-access-72lvw") pod "9bbcf958-993b-47e5-9032-8f0f68bcd249" (UID: "9bbcf958-993b-47e5-9032-8f0f68bcd249"). InnerVolumeSpecName "kube-api-access-72lvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:56:52.498997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.498964    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.498997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.498992    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.498997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.499004    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.499226 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.499016    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72lvw\" (UniqueName: \"kubernetes.io/projected/9bbcf958-993b-47e5-9032-8f0f68bcd249-kube-api-access-72lvw\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.703478 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.703447    2556 generic.go:356] "Generic (PLEG): container finished" podID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerID="4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8" exitCode=0
Sep 12 00:56:52.703662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.703493    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"
Sep 12 00:56:52.703662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.703537    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerDied","Data":"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"}
Sep 12 00:56:52.703662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.703598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj" event={"ID":"9bbcf958-993b-47e5-9032-8f0f68bcd249","Type":"ContainerDied","Data":"6936ac306a9557d4ed92549bc98410541a03d35840996b2190d525c1c897083e"}
Sep 12 00:56:52.703662 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.703625    2556 scope.go:117] "RemoveContainer" containerID="4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"
Sep 12 00:56:52.714281 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.714265    2556 scope.go:117] "RemoveContainer" containerID="f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"
Sep 12 00:56:52.722564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.722548    2556 scope.go:117] "RemoveContainer" containerID="4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"
Sep 12 00:56:52.722826 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:56:52.722807    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8\": container with ID starting with 4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8 not found: ID does not exist" containerID="4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"
Sep 12 00:56:52.722882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.722839    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8"} err="failed to get container status \"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8\": rpc error: code = NotFound desc = could not find container \"4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8\": container with ID starting with 4398bcd6b7d1ecab5f3b0e57feaa4d54238497d9bd2b64c3e4597038b5a323f8 not found: ID does not exist"
Sep 12 00:56:52.722882 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.722859    2556 scope.go:117] "RemoveContainer" containerID="f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"
Sep 12 00:56:52.723108 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:56:52.723090    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d\": container with ID starting with f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d not found: ID does not exist" containerID="f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"
Sep 12 00:56:52.723148 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.723114    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d"} err="failed to get container status \"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d\": rpc error: code = NotFound desc = could not find container \"f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d\": container with ID starting with f3ffa67545109e73af042f145336608fb5d5d785d2720616e28a5ff79b0c3c3d not found: ID does not exist"
Sep 12 00:56:52.728673 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.728642    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:56:52.732497 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:52.732474    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj"]
Sep 12 00:56:53.455195 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:53.455161    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" path="/var/lib/kubelet/pods/9bbcf958-993b-47e5-9032-8f0f68bcd249/volumes"
Sep 12 00:56:55.623158 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:56:55.623120    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:57:27.811384 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:27.811349    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:57:43.163936 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.163895    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:57:43.164564 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.164543    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:43.164664 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.164594    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:43.164769 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.164744    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:43.164836 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.164781    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:43.168149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.168126    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.170778 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.170744    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-04f8e8-openshift-default-dockercfg-m5srq\""
Sep 12 00:57:43.176904 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.176884    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:57:43.309269 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309232    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309468 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309468 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309468 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309468 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plmd\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.309697 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.309594    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410323 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plmd\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410480 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410593    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410685 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410638    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410927 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.410927 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.411044 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.410963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.411104 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.411072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.411437 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.411414    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.412807 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.412783    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.413050 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.413029    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.419192 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.419143    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.419456 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.419438    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plmd\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd\") pod \"e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") " pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.480622 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.480593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:43.771850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.771819    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:57:43.772921 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:57:43.772894    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff22ff4e_e8bf_4759_b6b3_79b3fb96f2b1.slice/crio-be457d1fd2306937ba2acbaea7066f9eaeebf19b6b4a309cb6727a0d4dd6e626 WatchSource:0}: Error finding container be457d1fd2306937ba2acbaea7066f9eaeebf19b6b4a309cb6727a0d4dd6e626: Status 404 returned error can't find the container with id be457d1fd2306937ba2acbaea7066f9eaeebf19b6b4a309cb6727a0d4dd6e626
Sep 12 00:57:43.775116 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.775080    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:57:43.775224 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.775161    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:57:43.775224 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:43.775206    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:57:44.051175 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:44.051084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerStarted","Data":"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"}
Sep 12 00:57:44.051351 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:44.051174    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerStarted","Data":"be457d1fd2306937ba2acbaea7066f9eaeebf19b6b4a309cb6727a0d4dd6e626"}
Sep 12 00:57:44.074421 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:44.074373    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podStartSLOduration=1.0743587510000001 podStartE2EDuration="1.074358751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:57:44.071163578 +0000 UTC m=+1717.121749184" watchObservedRunningTime="2026-09-12 00:57:44.074358751 +0000 UTC m=+1717.124944358"
Sep 12 00:57:44.481069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:44.481035    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:44.485715 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:44.485692    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:45.058343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:45.058304    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:45.059328 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:45.059303    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:57:51.569079 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.569044    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:57:51.569552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.569538    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:51.569598 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.569553    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbcf958-993b-47e5-9032-8f0f68bcd249" containerName="istio-proxy"
Sep 12 00:57:51.573714 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.573225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.575963 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.575942    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-04f8e8-serving-cert\""
Sep 12 00:57:51.591324 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.591302    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:57:51.694822 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.694753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.695282 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.695188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.695584 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.695557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.695816 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.695799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xl95\" (UniqueName: \"kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.797463 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.797432    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.797614 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.797478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.797614 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.797536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xl95\" (UniqueName: \"kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.797690 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.797665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.798140 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.798120    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.800038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.800018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.800130 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.800105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.807294 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.807274    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xl95\" (UniqueName: \"kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95\") pod \"maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:51.886245 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:51.886168    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:52.167589 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:52.167557    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:57:52.168463 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:57:52.168440    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63273c5f_3b72_4605_9e3f_d9a860bb3a6c.slice/crio-c702f7189b5fde62c91ad5961639caccf0061dc4ed02b22fcf8e3e6343d8d39c WatchSource:0}: Error finding container c702f7189b5fde62c91ad5961639caccf0061dc4ed02b22fcf8e3e6343d8d39c: Status 404 returned error can't find the container with id c702f7189b5fde62c91ad5961639caccf0061dc4ed02b22fcf8e3e6343d8d39c
Sep 12 00:57:52.170277 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:52.170258    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:57:53.111097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:53.111062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" event={"ID":"63273c5f-3b72-4605-9e3f-d9a860bb3a6c","Type":"ContainerStarted","Data":"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"}
Sep 12 00:57:53.111551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:53.111124    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" event={"ID":"63273c5f-3b72-4605-9e3f-d9a860bb3a6c","Type":"ContainerStarted","Data":"c702f7189b5fde62c91ad5961639caccf0061dc4ed02b22fcf8e3e6343d8d39c"}
Sep 12 00:57:53.111551 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:53.111145    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:57:53.131900 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:53.131857    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" podStartSLOduration=1.726092463 podStartE2EDuration="2.131840667s" totalImagesPullingTime="405.748204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:57:53.129985937 +0000 UTC m=+1726.180571543" watchObservedRunningTime="2026-09-12 00:57:53.131840667 +0000 UTC m=+1726.182426273"
Sep 12 00:57:59.122580 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:57:59.122552    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:58:03.438736 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:03.438701    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:58:15.059675 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.059640    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:15.060083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.059707    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:15.257124 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.257084    2556 generic.go:356] "Generic (PLEG): container finished" podID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerID="32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3" exitCode=0
Sep 12 00:58:15.257327 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.257119    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerDied","Data":"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"}
Sep 12 00:58:15.257696 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.257675    2556 scope.go:117] "RemoveContainer" containerID="32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"
Sep 12 00:58:15.259040 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.259012    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:15.259139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.259081    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:15.259139 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:15.259113    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:16.280376 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.280332    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerStarted","Data":"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"}
Sep 12 00:58:16.482059 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.482019    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:58:16.482267 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.482159    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:16.482267 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.482209    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:16.744446 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.744415    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:58:16.747370 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.747349    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.750336 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.750308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c14a20-openshift-default-dockercfg-f76jn\""
Sep 12 00:58:16.766360 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.766329    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:58:16.884514 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.884474    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.884879 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.884854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885065 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885095    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2725\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885127    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885262 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885260    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.885526 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.885362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.986850 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.986808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.987135 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.987323 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.987486 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2725\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987837    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.988021    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.988103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.988129    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.988492    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.987689    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.988832 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.988776    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.995194 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.995113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.995370 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.995339    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:16.997982 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:16.997940    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:17.010217 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.009361    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2725\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725\") pod \"e2e-api-b-c14a20-openshift-default-b87544596-cchfr\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") " pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:17.072083 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.071833    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:17.351143 ip-10-0-131-144 kubenswrapper[2556]: W0912 00:58:17.351114    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7132b07_99b0_46b4_b51e_e44370becf19.slice/crio-a018790028c7af53646ea4268092dac1adf4b74c7aee42ea7eac243221fe7d58 WatchSource:0}: Error finding container a018790028c7af53646ea4268092dac1adf4b74c7aee42ea7eac243221fe7d58: Status 404 returned error can't find the container with id a018790028c7af53646ea4268092dac1adf4b74c7aee42ea7eac243221fe7d58
Sep 12 00:58:17.351143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.351114    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:58:17.353636 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.353601    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:17.353718 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.353663    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:17.353718 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.353691    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:58:17.482030 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.481998    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:17.482306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:17.482266    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:18.309199 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:18.309166    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerStarted","Data":"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"}
Sep 12 00:58:18.309441 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:18.309427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerStarted","Data":"a018790028c7af53646ea4268092dac1adf4b74c7aee42ea7eac243221fe7d58"}
Sep 12 00:58:18.342261 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:18.342211    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podStartSLOduration=2.342196035 podStartE2EDuration="2.342196035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:58:18.340410451 +0000 UTC m=+1751.390996060" watchObservedRunningTime="2026-09-12 00:58:18.342196035 +0000 UTC m=+1751.392781641"
Sep 12 00:58:18.481778 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:18.481128    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:18.481778 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:18.481189    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:19.073076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.073038    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:19.082244 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.082208    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:19.316028 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.315997    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:19.316878 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.316856    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:58:19.482782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.480999    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:19.482782 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:19.481101    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:20.482092 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:20.482047    2556 patch_prober.go:28] interesting pod/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 12 00:58:20.482277 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:20.482126    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 12 00:58:21.486737 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:21.486705    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:58:21.487230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:21.487146    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:58:21.487940 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:21.487917    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:58:31.402080 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:31.402046    2556 generic.go:356] "Generic (PLEG): container finished" podID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerID="ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488" exitCode=137
Sep 12 00:58:31.402444 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:31.402120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerDied","Data":"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"}
Sep 12 00:58:31.402503 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:31.402489    2556 scope.go:117] "RemoveContainer" containerID="ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"
Sep 12 00:58:32.410838 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:32.410801    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerStarted","Data":"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"}
Sep 12 00:58:32.411171 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:32.411005    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:58:43.420185 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:58:43.420154    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 00:59:02.734845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:02.734750    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:59:03.645773 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:03.645722    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:59:03.646025 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:03.645996    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" podUID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" containerName="maas-api" containerID="cri-o://e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91" gracePeriod=30
Sep 12 00:59:03.902368 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:03.902304    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:59:04.083892 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.083822    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs\") pod \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") "
Sep 12 00:59:04.083892 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.083879    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca\") pod \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") "
Sep 12 00:59:04.084182 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.083918    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls\") pod \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") "
Sep 12 00:59:04.084182 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.083943    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xl95\" (UniqueName: \"kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95\") pod \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\" (UID: \"63273c5f-3b72-4605-9e3f-d9a860bb3a6c\") "
Sep 12 00:59:04.084365 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.084329    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63273c5f-3b72-4605-9e3f-d9a860bb3a6c" (UID: "63273c5f-3b72-4605-9e3f-d9a860bb3a6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:04.086058 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.086033    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "63273c5f-3b72-4605-9e3f-d9a860bb3a6c" (UID: "63273c5f-3b72-4605-9e3f-d9a860bb3a6c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:04.086201 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.086102    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95" (OuterVolumeSpecName: "kube-api-access-5xl95") pod "63273c5f-3b72-4605-9e3f-d9a860bb3a6c" (UID: "63273c5f-3b72-4605-9e3f-d9a860bb3a6c"). InnerVolumeSpecName "kube-api-access-5xl95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:04.086673 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.086631    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63273c5f-3b72-4605-9e3f-d9a860bb3a6c" (UID: "63273c5f-3b72-4605-9e3f-d9a860bb3a6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:04.185390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.185357    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:04.185390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.185385    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:04.185390 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.185394    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:04.185641 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.185404    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xl95\" (UniqueName: \"kubernetes.io/projected/63273c5f-3b72-4605-9e3f-d9a860bb3a6c-kube-api-access-5xl95\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:04.622008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.621907    2556 generic.go:356] "Generic (PLEG): container finished" podID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" containerID="e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91" exitCode=0
Sep 12 00:59:04.622008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.621970    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"
Sep 12 00:59:04.622008 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.621990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" event={"ID":"63273c5f-3b72-4605-9e3f-d9a860bb3a6c","Type":"ContainerDied","Data":"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"}
Sep 12 00:59:04.622321 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.622035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh" event={"ID":"63273c5f-3b72-4605-9e3f-d9a860bb3a6c","Type":"ContainerDied","Data":"c702f7189b5fde62c91ad5961639caccf0061dc4ed02b22fcf8e3e6343d8d39c"}
Sep 12 00:59:04.622321 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.622062    2556 scope.go:117] "RemoveContainer" containerID="e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"
Sep 12 00:59:04.634973 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.634947    2556 scope.go:117] "RemoveContainer" containerID="e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"
Sep 12 00:59:04.635325 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:04.635302    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91\": container with ID starting with e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91 not found: ID does not exist" containerID="e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"
Sep 12 00:59:04.635414 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.635342    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91"} err="failed to get container status \"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91\": rpc error: code = NotFound desc = could not find container \"e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91\": container with ID starting with e24f21d9db43b9c7d08befea8b4ae388440e1487fde280360ebc930fadf47b91 not found: ID does not exist"
Sep 12 00:59:04.649406 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.649371    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:59:04.656818 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:04.656786    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04f8e8-68d5bfbcff-zcflh"]
Sep 12 00:59:05.455409 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:05.455373    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" path="/var/lib/kubelet/pods/63273c5f-3b72-4605-9e3f-d9a860bb3a6c/volumes"
Sep 12 00:59:10.734433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:10.734393    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:59:10.734948 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:10.734674    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy" containerID="cri-o://6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a" gracePeriod=30
Sep 12 00:59:13.694151 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.694124    2556 generic.go:356] "Generic (PLEG): container finished" podID="a7132b07-99b0-46b4-b51e-e44370becf19" containerID="8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5" exitCode=0
Sep 12 00:59:13.694576 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.694199    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerDied","Data":"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"}
Sep 12 00:59:13.694738 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.694722    2556 scope.go:117] "RemoveContainer" containerID="8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"
Sep 12 00:59:13.696060 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.696035    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:59:13.696133 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.696102    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:59:13.696171 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:13.696134    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 00:59:14.703149 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:14.703107    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerStarted","Data":"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"}
Sep 12 00:59:15.072678 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:15.072576    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:15.073916 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:15.073881    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 12 00:59:15.074053 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:15.073962    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 12 00:59:16.081502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.080716    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:59:16.081502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.081307    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 12 00:59:16.081502 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.081359    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 12 00:59:16.114908 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.114880    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.114960    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115076 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115049    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2plmd\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115100    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115148    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115200 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115184    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115209    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115244    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115285    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket\") pod \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\" (UID: \"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1\") "
Sep 12 00:59:16.115366 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115346    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115595    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115620    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115812    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115833    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115847    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115829    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:16.115901 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.115859    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:16.117808 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.117782    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd" (OuterVolumeSpecName: "kube-api-access-2plmd") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "kube-api-access-2plmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:16.117930 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.117914    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:16.118007 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.117959    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:16.118071 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.118046    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" (UID: "ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:59:16.217325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217286    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.217325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217319    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.217325 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217328    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.217552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217336    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.217552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217347    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2plmd\" (UniqueName: \"kubernetes.io/projected/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-kube-api-access-2plmd\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.217552 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.217356    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:16.719190 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.719155    2556 generic.go:356] "Generic (PLEG): container finished" podID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerID="6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a" exitCode=0
Sep 12 00:59:16.719374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.719220    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"
Sep 12 00:59:16.719374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.719236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerDied","Data":"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"}
Sep 12 00:59:16.719374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.719298    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b" event={"ID":"ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1","Type":"ContainerDied","Data":"be457d1fd2306937ba2acbaea7066f9eaeebf19b6b4a309cb6727a0d4dd6e626"}
Sep 12 00:59:16.719374 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.719320    2556 scope.go:117] "RemoveContainer" containerID="6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"
Sep 12 00:59:16.733957 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.733936    2556 scope.go:117] "RemoveContainer" containerID="32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"
Sep 12 00:59:16.744486 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.744462    2556 scope.go:117] "RemoveContainer" containerID="6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"
Sep 12 00:59:16.744780 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:16.744746    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a\": container with ID starting with 6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a not found: ID does not exist" containerID="6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"
Sep 12 00:59:16.744845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.744790    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a"} err="failed to get container status \"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a\": rpc error: code = NotFound desc = could not find container \"6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a\": container with ID starting with 6875d15632cc2583aaa53741f162b93507446f2d744b46cdb897b38ab8fdd87a not found: ID does not exist"
Sep 12 00:59:16.744845 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.744806    2556 scope.go:117] "RemoveContainer" containerID="32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"
Sep 12 00:59:16.745073 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:16.745059    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3\": container with ID starting with 32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3 not found: ID does not exist" containerID="32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"
Sep 12 00:59:16.745119 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.745079    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3"} err="failed to get container status \"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3\": rpc error: code = NotFound desc = could not find container \"32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3\": container with ID starting with 32b41715ca6c0a1bbc8fff320fef2d89b3e9c5cebff7b69a2755dcdcf4b5f6f3 not found: ID does not exist"
Sep 12 00:59:16.746041 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.746021    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:59:16.751441 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:16.751422    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b"]
Sep 12 00:59:17.073686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:17.073578    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 12 00:59:17.073686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:17.073660    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 12 00:59:17.458048 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:17.458015    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" path="/var/lib/kubelet/pods/ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1/volumes"
Sep 12 00:59:18.073252 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:18.073211    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 12 00:59:18.073546 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:18.073514    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 12 00:59:19.072621 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:19.072578    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 12 00:59:19.073230 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:19.073197    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 12 00:59:19.316597 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:19.316564    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:20.076894 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:20.076858    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:20.077933 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:20.077912    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:33.812347 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:33.812313    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:59:33.812898 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:33.812530    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" containerID="cri-o://f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d" gracePeriod=30
Sep 12 00:59:35.080140 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:35.080098    2556 patch_prober.go:28] interesting pod/e2e-api-b-c14a20-openshift-default-b87544596-cchfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 00:59:35.080515 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:35.080157    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:59:39.064489 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.064447    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:39.164038 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164006    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164227 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164056    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164227 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164105    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164228    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164270    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164346 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164307    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164364    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2725\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:39.164518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:39.164518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164485    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164518 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164511    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert\") pod \"a7132b07-99b0-46b4-b51e-e44370becf19\" (UID: \"a7132b07-99b0-46b4-b51e-e44370becf19\") "
Sep 12 00:59:39.164812 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164746    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:39.165015 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.164988    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:39.165110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.165072    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.165110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.165080    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:39.165110 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.165089    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.165284 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.165123    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.166591 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.166564    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:59:39.166686 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.166595    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:39.166800 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.166779    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:39.166865 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.166813    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725" (OuterVolumeSpecName: "kube-api-access-g2725") pod "a7132b07-99b0-46b4-b51e-e44370becf19" (UID: "a7132b07-99b0-46b4-b51e-e44370becf19"). InnerVolumeSpecName "kube-api-access-g2725". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:39.266431 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266393    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.266431 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266420    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2725\" (UniqueName: \"kubernetes.io/projected/a7132b07-99b0-46b4-b51e-e44370becf19-kube-api-access-g2725\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.266431 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266430    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7132b07-99b0-46b4-b51e-e44370becf19-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.266431 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266439    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7132b07-99b0-46b4-b51e-e44370becf19-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.266805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266447    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.266805 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.266455    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7132b07-99b0-46b4-b51e-e44370becf19-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:39.872741 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.872661    2556 generic.go:356] "Generic (PLEG): container finished" podID="a7132b07-99b0-46b4-b51e-e44370becf19" containerID="f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d" exitCode=0
Sep 12 00:59:39.872741 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.872706    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"
Sep 12 00:59:39.873017 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.872700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerDied","Data":"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"}
Sep 12 00:59:39.873017 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.872833    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr" event={"ID":"a7132b07-99b0-46b4-b51e-e44370becf19","Type":"ContainerDied","Data":"a018790028c7af53646ea4268092dac1adf4b74c7aee42ea7eac243221fe7d58"}
Sep 12 00:59:39.873017 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.872857    2556 scope.go:117] "RemoveContainer" containerID="f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"
Sep 12 00:59:39.883269 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.883249    2556 scope.go:117] "RemoveContainer" containerID="8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"
Sep 12 00:59:39.891619 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.891598    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:59:39.892530 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.892516    2556 scope.go:117] "RemoveContainer" containerID="f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"
Sep 12 00:59:39.892812 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:39.892794    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d\": container with ID starting with f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d not found: ID does not exist" containerID="f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"
Sep 12 00:59:39.892858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.892820    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d"} err="failed to get container status \"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d\": rpc error: code = NotFound desc = could not find container \"f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d\": container with ID starting with f0042c17dccdbc9dcd28651169a4a11be214ff62c05e8a17899b31d0309bf47d not found: ID does not exist"
Sep 12 00:59:39.892858 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.892836    2556 scope.go:117] "RemoveContainer" containerID="8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"
Sep 12 00:59:39.893104 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:39.893083    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5\": container with ID starting with 8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5 not found: ID does not exist" containerID="8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"
Sep 12 00:59:39.893169 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.893115    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5"} err="failed to get container status \"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5\": rpc error: code = NotFound desc = could not find container \"8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5\": container with ID starting with 8cbaf0078752562dc9c4b78b7883a3e47abffb9c4e61de68a3fc3dcc3a2aa9e5 not found: ID does not exist"
Sep 12 00:59:39.898997 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:39.898977    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr"]
Sep 12 00:59:41.454781 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:41.454737    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" path="/var/lib/kubelet/pods/a7132b07-99b0-46b4-b51e-e44370becf19/volumes"
Sep 12 00:59:43.909260 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:43.909223    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 00:59:44.943160 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:44.943069    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:59:44.943636 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:44.943337    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" podUID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" containerName="maas-api" containerID="cri-o://8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218" gracePeriod=30
Sep 12 00:59:45.197837 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.197778    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:59:45.223513 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.223486    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzg7n\" (UniqueName: \"kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n\") pod \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") "
Sep 12 00:59:45.223655 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.223546    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls\") pod \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") "
Sep 12 00:59:45.223655 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.223594    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca\") pod \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") "
Sep 12 00:59:45.223810 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.223690    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs\") pod \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\" (UID: \"f40d3671-89fb-4684-9d68-f69f9c3bdb24\") "
Sep 12 00:59:45.224031 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.224005    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f40d3671-89fb-4684-9d68-f69f9c3bdb24" (UID: "f40d3671-89fb-4684-9d68-f69f9c3bdb24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:45.224122 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.224076    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f40d3671-89fb-4684-9d68-f69f9c3bdb24-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.225806 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.225741    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f40d3671-89fb-4684-9d68-f69f9c3bdb24" (UID: "f40d3671-89fb-4684-9d68-f69f9c3bdb24"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:45.226021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.225992    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f40d3671-89fb-4684-9d68-f69f9c3bdb24" (UID: "f40d3671-89fb-4684-9d68-f69f9c3bdb24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:45.226021 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.225978    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n" (OuterVolumeSpecName: "kube-api-access-xzg7n") pod "f40d3671-89fb-4684-9d68-f69f9c3bdb24" (UID: "f40d3671-89fb-4684-9d68-f69f9c3bdb24"). InnerVolumeSpecName "kube-api-access-xzg7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:45.325069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.325037    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.325069 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.325068    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzg7n\" (UniqueName: \"kubernetes.io/projected/f40d3671-89fb-4684-9d68-f69f9c3bdb24-kube-api-access-xzg7n\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.325275 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.325081    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f40d3671-89fb-4684-9d68-f69f9c3bdb24-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.914049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.914015    2556 generic.go:356] "Generic (PLEG): container finished" podID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" containerID="8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218" exitCode=0
Sep 12 00:59:45.914232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.914063    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"
Sep 12 00:59:45.914232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.914079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" event={"ID":"f40d3671-89fb-4684-9d68-f69f9c3bdb24","Type":"ContainerDied","Data":"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"}
Sep 12 00:59:45.914232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.914130    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l" event={"ID":"f40d3671-89fb-4684-9d68-f69f9c3bdb24","Type":"ContainerDied","Data":"3def13c9cb3d844f6e3256484dc294252cdd6c9dec833fc577993d8ea889f3f1"}
Sep 12 00:59:45.914232 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.914161    2556 scope.go:117] "RemoveContainer" containerID="8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"
Sep 12 00:59:45.924096 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.924064    2556 scope.go:117] "RemoveContainer" containerID="8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"
Sep 12 00:59:45.924400 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:45.924376    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218\": container with ID starting with 8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218 not found: ID does not exist" containerID="8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"
Sep 12 00:59:45.924492 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.924408    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218"} err="failed to get container status \"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218\": rpc error: code = NotFound desc = could not find container \"8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218\": container with ID starting with 8423b02c61052ad463a41123a01cec165a23e7b9ded60c012a711708bf685218 not found: ID does not exist"
Sep 12 00:59:45.936051 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.936029    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:59:45.944042 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:45.944019    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-088c83-7cbb5c4ff5-5xk7l"]
Sep 12 00:59:46.932193 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:46.932158    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:59:46.932391 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:46.932367    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" podUID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" containerName="maas-api" containerID="cri-o://8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3" gracePeriod=30
Sep 12 00:59:47.206400 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.206076    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:59:47.245740 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.245711    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs\") pod \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") "
Sep 12 00:59:47.245953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.245806    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") pod \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") "
Sep 12 00:59:47.245953 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.245917    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca\") pod \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") "
Sep 12 00:59:47.246168 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.245960    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mclnb\" (UniqueName: \"kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb\") pod \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\" (UID: \"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec\") "
Sep 12 00:59:47.246306 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.246278    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" (UID: "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:47.246433 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.246413    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:47.248034 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.248005    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" (UID: "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:47.248178 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.248136    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" (UID: "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:59:47.248425 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.248407    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb" (OuterVolumeSpecName: "kube-api-access-mclnb") pod "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" (UID: "786b6a58-2b9d-4bf3-8318-07b9db9ad2ec"). InnerVolumeSpecName "kube-api-access-mclnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:47.350741 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.350697    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:47.350970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.350743    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mclnb\" (UniqueName: \"kubernetes.io/projected/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-kube-api-access-mclnb\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:47.350970 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.350793    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:47.455904 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.455830    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" path="/var/lib/kubelet/pods/f40d3671-89fb-4684-9d68-f69f9c3bdb24/volumes"
Sep 12 00:59:47.933536 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.933502    2556 generic.go:356] "Generic (PLEG): container finished" podID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" containerID="8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3" exitCode=0
Sep 12 00:59:47.933725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.933552    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"
Sep 12 00:59:47.933725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.933586    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" event={"ID":"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec","Type":"ContainerDied","Data":"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"}
Sep 12 00:59:47.933725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.933646    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb" event={"ID":"786b6a58-2b9d-4bf3-8318-07b9db9ad2ec","Type":"ContainerDied","Data":"5c858b97cada96f5deba983494ff1664cb53bd6717ab3bd8e981cae26e7799ad"}
Sep 12 00:59:47.933725 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.933670    2556 scope.go:117] "RemoveContainer" containerID="8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"
Sep 12 00:59:47.943326 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.943310    2556 scope.go:117] "RemoveContainer" containerID="8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"
Sep 12 00:59:47.943596 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:47.943578    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3\": container with ID starting with 8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3 not found: ID does not exist" containerID="8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"
Sep 12 00:59:47.943644 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.943602    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3"} err="failed to get container status \"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3\": rpc error: code = NotFound desc = could not find container \"8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3\": container with ID starting with 8ffadaa7b46f10e38ec23661022d29da60df74e9beee9d6cfc6a90d923d406d3 not found: ID does not exist"
Sep 12 00:59:47.952441 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.952397    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:59:47.955459 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:47.955431    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4d485e-c4ccd6788-r8zjb"]
Sep 12 00:59:49.455876 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:49.455813    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" path="/var/lib/kubelet/pods/786b6a58-2b9d-4bf3-8318-07b9db9ad2ec/volumes"
Sep 12 00:59:52.274352 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:52.274319    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:59:52.274718 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:52.274551    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy" containerID="cri-o://022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a" gracePeriod=30
Sep 12 00:59:54.500102 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:54.500062    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 00:59:54.500517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:54.500266    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy" containerID="cri-o://5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984" gracePeriod=30
Sep 12 00:59:57.537818 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.537719    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:59:57.660136 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660104    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660387 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660145    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-669sb\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660387 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660190    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660387 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660730 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660700    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:57.660854 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660854 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660849    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660984 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660875    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.660984 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.660919    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.661097 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661007    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket\") pod \"6a86e158-8daf-455a-98c7-5d50710fc713\" (UID: \"6a86e158-8daf-455a-98c7-5d50710fc713\") "
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661378    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661451    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661557    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661601    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a86e158-8daf-455a-98c7-5d50710fc713-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661616    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:57.661633 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661619    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.662049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.661659    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.662620 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.662592    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:57.663098 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.663078    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:59:57.663188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.663078    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb" (OuterVolumeSpecName: "kube-api-access-669sb") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "kube-api-access-669sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:57.663188 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.663097    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a86e158-8daf-455a-98c7-5d50710fc713" (UID: "6a86e158-8daf-455a-98c7-5d50710fc713"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:57.763001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.762967    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.763001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.762996    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.763208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.763007    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-669sb\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-kube-api-access-669sb\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.763208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.763018    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a86e158-8daf-455a-98c7-5d50710fc713-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.763208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.763027    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a86e158-8daf-455a-98c7-5d50710fc713-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:57.763208 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:57.763036    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a86e158-8daf-455a-98c7-5d50710fc713-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:58.003174 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.003137    2556 generic.go:356] "Generic (PLEG): container finished" podID="6a86e158-8daf-455a-98c7-5d50710fc713" containerID="022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a" exitCode=0
Sep 12 00:59:58.003355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.003190    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"
Sep 12 00:59:58.003355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.003199    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerDied","Data":"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"}
Sep 12 00:59:58.003355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.003252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5" event={"ID":"6a86e158-8daf-455a-98c7-5d50710fc713","Type":"ContainerDied","Data":"92aaf8361d356a950db3a51d2dbe80b10b07ee97b7bd2383fe28043a5746f164"}
Sep 12 00:59:58.003355 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.003273    2556 scope.go:117] "RemoveContainer" containerID="022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"
Sep 12 00:59:58.013960 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.013938    2556 scope.go:117] "RemoveContainer" containerID="f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"
Sep 12 00:59:58.022517 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.022493    2556 scope.go:117] "RemoveContainer" containerID="022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"
Sep 12 00:59:58.022800 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:58.022780    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a\": container with ID starting with 022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a not found: ID does not exist" containerID="022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"
Sep 12 00:59:58.022862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.022808    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a"} err="failed to get container status \"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a\": rpc error: code = NotFound desc = could not find container \"022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a\": container with ID starting with 022e8a5728d3a267f16e02bfa3d2cbb9fac75a5f680dbc11241cba799a33b21a not found: ID does not exist"
Sep 12 00:59:58.022862 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.022826    2556 scope.go:117] "RemoveContainer" containerID="f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"
Sep 12 00:59:58.023104 ip-10-0-131-144 kubenswrapper[2556]: E0912 00:59:58.023087    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad\": container with ID starting with f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad not found: ID does not exist" containerID="f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"
Sep 12 00:59:58.023143 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.023110    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad"} err="failed to get container status \"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad\": rpc error: code = NotFound desc = could not find container \"f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad\": container with ID starting with f756e1c6e4c8cba153f0908a52b29bec92bc14c4a0feca197a10177773ff8cad not found: ID does not exist"
Sep 12 00:59:58.028049 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.028027    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:59:58.035075 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:58.035050    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5"]
Sep 12 00:59:59.457706 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.457669    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" path="/var/lib/kubelet/pods/6a86e158-8daf-455a-98c7-5d50710fc713/volumes"
Sep 12 00:59:59.759581 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.759524    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 00:59:59.882004 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.881973    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882012    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882047    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882070    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882173 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882135    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882180    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882204    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882240    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882283    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nmlt\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt\") pod \"ec3f2947-7af1-41fb-ab15-180891263b55\" (UID: \"ec3f2947-7af1-41fb-ab15-180891263b55\") "
Sep 12 00:59:59.882381 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882348    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:59.882638 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:59.882839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882807    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.882839 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882832    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.883001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882804    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:59.883001 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.882811    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:59.883094 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.883035    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:59.884422 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.884397    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:59.884746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.884723    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:59:59.884746 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.884731    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:59.884902 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.884866    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt" (OuterVolumeSpecName: "kube-api-access-7nmlt") pod "ec3f2947-7af1-41fb-ab15-180891263b55" (UID: "ec3f2947-7af1-41fb-ab15-180891263b55"). InnerVolumeSpecName "kube-api-access-7nmlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984272    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec3f2947-7af1-41fb-ab15-180891263b55-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984298    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984306    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984313    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984322    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec3f2947-7af1-41fb-ab15-180891263b55-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984329    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec3f2947-7af1-41fb-ab15-180891263b55-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 00:59:59.984343 ip-10-0-131-144 kubenswrapper[2556]: I0912 00:59:59.984337    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nmlt\" (UniqueName: \"kubernetes.io/projected/ec3f2947-7af1-41fb-ab15-180891263b55-kube-api-access-7nmlt\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:00.018922 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.018895    2556 generic.go:356] "Generic (PLEG): container finished" podID="ec3f2947-7af1-41fb-ab15-180891263b55" containerID="5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984" exitCode=0
Sep 12 01:00:00.019073 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.018953    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"
Sep 12 01:00:00.019073 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.018979    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerDied","Data":"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"}
Sep 12 01:00:00.019073 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.019058    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv" event={"ID":"ec3f2947-7af1-41fb-ab15-180891263b55","Type":"ContainerDied","Data":"c8c19f10cacca0d1018aa8a15d26b41b69da1cfa5759400177fc133efbd8f15b"}
Sep 12 01:00:00.019250 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.019081    2556 scope.go:117] "RemoveContainer" containerID="5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"
Sep 12 01:00:00.029870 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.029853    2556 scope.go:117] "RemoveContainer" containerID="ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"
Sep 12 01:00:00.038243 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.038225    2556 scope.go:117] "RemoveContainer" containerID="5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"
Sep 12 01:00:00.038504 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:00:00.038485    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984\": container with ID starting with 5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984 not found: ID does not exist" containerID="5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"
Sep 12 01:00:00.038579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.038512    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984"} err="failed to get container status \"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984\": rpc error: code = NotFound desc = could not find container \"5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984\": container with ID starting with 5e7a573da9ac5b78e02f0fea44fe7f1da7fe58669eb1611a566fc419de018984 not found: ID does not exist"
Sep 12 01:00:00.038579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.038528    2556 scope.go:117] "RemoveContainer" containerID="ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"
Sep 12 01:00:00.038867 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:00:00.038849    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6\": container with ID starting with ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6 not found: ID does not exist" containerID="ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"
Sep 12 01:00:00.038915 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.038874    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6"} err="failed to get container status \"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6\": rpc error: code = NotFound desc = could not find container \"ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6\": container with ID starting with ad00ef4dc725eca94ea31873ea33e351c1e6c33e13d2c7d15bfe0df6ac99f0c6 not found: ID does not exist"
Sep 12 01:00:00.043997 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.043976    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 01:00:00.050017 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.049999    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv"]
Sep 12 01:00:00.142617 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.142585    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"]
Sep 12 01:00:00.143053 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143055    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143066    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143072    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143086    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143091    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:00:00.143103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143103    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143108    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143118    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143123    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143129    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143134    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143140    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143145    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143159    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143165    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143243    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40d3671-89fb-4684-9d68-f69f9c3bdb24" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143249    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143257    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143263    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143269    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143276    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="786b6a58-2b9d-4bf3-8318-07b9db9ad2ec" containerName="maas-api"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143281    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143287    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:00:00.143287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143292    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:00:00.143839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.143297    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="63273c5f-3b72-4605-9e3f-d9a860bb3a6c" containerName="maas-api"
Sep 12 01:00:00.148103 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.148086    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"
Sep 12 01:00:00.150816 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.150792    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sj5jt\""
Sep 12 01:00:00.165811 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.161322    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"]
Sep 12 01:00:00.165811 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.162270    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"
Sep 12 01:00:00.436738 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:00.436713    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"]
Sep 12 01:00:00.439538 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:00:00.439512    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60f7a56_6b82_4847_8564_19c37843b3ff.slice/crio-e64b25747ae4da9bdc5829a01bf4020d2f9c9c0a2f513dbabaa98b2a5ddaf772 WatchSource:0}: Error finding container e64b25747ae4da9bdc5829a01bf4020d2f9c9c0a2f513dbabaa98b2a5ddaf772: Status 404 returned error can't find the container with id e64b25747ae4da9bdc5829a01bf4020d2f9c9c0a2f513dbabaa98b2a5ddaf772
Sep 12 01:00:01.027337 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:01.027300    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn" event={"ID":"c60f7a56-6b82-4847-8564-19c37843b3ff","Type":"ContainerStarted","Data":"609ccdf72148e91f51126c688553eaba1d243ae2fd699506f908cd88766bf5c4"}
Sep 12 01:00:01.027789 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:01.027363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn" event={"ID":"c60f7a56-6b82-4847-8564-19c37843b3ff","Type":"ContainerStarted","Data":"e64b25747ae4da9bdc5829a01bf4020d2f9c9c0a2f513dbabaa98b2a5ddaf772"}
Sep 12 01:00:01.049194 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:01.049141    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn" podStartSLOduration=1.049125462 podStartE2EDuration="1.049125462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:00:01.046206019 +0000 UTC m=+1854.096791628" watchObservedRunningTime="2026-09-12 01:00:01.049125462 +0000 UTC m=+1854.099711069"
Sep 12 01:00:01.454699 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:01.454665    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" path="/var/lib/kubelet/pods/ec3f2947-7af1-41fb-ab15-180891263b55/volumes"
Sep 12 01:00:02.035983 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:02.035944    2556 generic.go:356] "Generic (PLEG): container finished" podID="c60f7a56-6b82-4847-8564-19c37843b3ff" containerID="609ccdf72148e91f51126c688553eaba1d243ae2fd699506f908cd88766bf5c4" exitCode=0
Sep 12 01:00:02.036423 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:02.036030    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn" event={"ID":"c60f7a56-6b82-4847-8564-19c37843b3ff","Type":"ContainerDied","Data":"609ccdf72148e91f51126c688553eaba1d243ae2fd699506f908cd88766bf5c4"}
Sep 12 01:00:03.183343 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.183315    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"
Sep 12 01:00:03.286859 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.286623    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 01:00:03.287057 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.286919    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" podUID="dc7dbd60-60ea-40dc-b42b-50bb27408773" containerName="maas-api" containerID="cri-o://74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9" gracePeriod=30
Sep 12 01:00:03.334536 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.334490    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"]
Sep 12 01:00:03.339509 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.339479    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"]
Sep 12 01:00:03.455217 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.455151    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c60f7a56-6b82-4847-8564-19c37843b3ff" path="/var/lib/kubelet/pods/c60f7a56-6b82-4847-8564-19c37843b3ff/volumes"
Sep 12 01:00:03.555212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.555136    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 01:00:03.724007 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.723969    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls\") pod \"dc7dbd60-60ea-40dc-b42b-50bb27408773\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") "
Sep 12 01:00:03.724186 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.724057    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca\") pod \"dc7dbd60-60ea-40dc-b42b-50bb27408773\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") "
Sep 12 01:00:03.724186 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.724119    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs\") pod \"dc7dbd60-60ea-40dc-b42b-50bb27408773\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") "
Sep 12 01:00:03.724186 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.724153    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2td9\" (UniqueName: \"kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9\") pod \"dc7dbd60-60ea-40dc-b42b-50bb27408773\" (UID: \"dc7dbd60-60ea-40dc-b42b-50bb27408773\") "
Sep 12 01:00:03.724495 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.724464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc7dbd60-60ea-40dc-b42b-50bb27408773" (UID: "dc7dbd60-60ea-40dc-b42b-50bb27408773"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:00:03.726264 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.726238    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc7dbd60-60ea-40dc-b42b-50bb27408773" (UID: "dc7dbd60-60ea-40dc-b42b-50bb27408773"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:00:03.726372 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.726267    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc7dbd60-60ea-40dc-b42b-50bb27408773" (UID: "dc7dbd60-60ea-40dc-b42b-50bb27408773"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:00:03.726372 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.726287    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9" (OuterVolumeSpecName: "kube-api-access-x2td9") pod "dc7dbd60-60ea-40dc-b42b-50bb27408773" (UID: "dc7dbd60-60ea-40dc-b42b-50bb27408773"). InnerVolumeSpecName "kube-api-access-x2td9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:00:03.825132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.825027    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:03.825132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.825061    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7dbd60-60ea-40dc-b42b-50bb27408773-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:03.825132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.825072    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc7dbd60-60ea-40dc-b42b-50bb27408773-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:03.825132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:03.825081    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2td9\" (UniqueName: \"kubernetes.io/projected/dc7dbd60-60ea-40dc-b42b-50bb27408773-kube-api-access-x2td9\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:04.049841 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.049804    2556 generic.go:356] "Generic (PLEG): container finished" podID="dc7dbd60-60ea-40dc-b42b-50bb27408773" containerID="74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9" exitCode=0
Sep 12 01:00:04.050046 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.049849    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"
Sep 12 01:00:04.050046 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.049892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" event={"ID":"dc7dbd60-60ea-40dc-b42b-50bb27408773","Type":"ContainerDied","Data":"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"}
Sep 12 01:00:04.050046 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.049994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj" event={"ID":"dc7dbd60-60ea-40dc-b42b-50bb27408773","Type":"ContainerDied","Data":"29d9e9fa4d951b89cc3dbefe7fb4f96819703ceca881579fd1e603e99099fa5a"}
Sep 12 01:00:04.050046 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.050025    2556 scope.go:117] "RemoveContainer" containerID="74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"
Sep 12 01:00:04.051517 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.051319    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c3ca75-29819580-8lvfn"
Sep 12 01:00:04.073234 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.071466    2556 scope.go:117] "RemoveContainer" containerID="74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"
Sep 12 01:00:04.073924 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:00:04.073885    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9\": container with ID starting with 74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9 not found: ID does not exist" containerID="74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"
Sep 12 01:00:04.074058 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.073933    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9"} err="failed to get container status \"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9\": rpc error: code = NotFound desc = could not find container \"74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9\": container with ID starting with 74149af0bb392448417f8545047a5c4cd4760535ac59c7012419a6395b3630e9 not found: ID does not exist"
Sep 12 01:00:04.074058 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.073959    2556 scope.go:117] "RemoveContainer" containerID="609ccdf72148e91f51126c688553eaba1d243ae2fd699506f908cd88766bf5c4"
Sep 12 01:00:04.076246 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.076224    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 01:00:04.080431 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:04.080403    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c3ca75-fc4b4459d-75sdj"]
Sep 12 01:00:05.454677 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:05.454643    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7dbd60-60ea-40dc-b42b-50bb27408773" path="/var/lib/kubelet/pods/dc7dbd60-60ea-40dc-b42b-50bb27408773/volumes"
Sep 12 01:00:10.130290 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:10.130246    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 01:00:10.131589 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:10.131371    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" containerID="cri-o://fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d" gracePeriod=30
Sep 12 01:00:14.650456 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:14.650418    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:00:14.650945 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:14.650491    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:00:15.394040 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.394010    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 01:00:15.438688 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438653    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.438878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438694    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.438878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438724    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.438878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438752    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hxd4\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.438878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438803    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.438878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438831    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.439170 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438925    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.439170 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.438952    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.439170 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439020    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket\") pod \"3e8ea4f6-bf36-4621-ab05-692de406ee11\" (UID: \"3e8ea4f6-bf36-4621-ab05-692de406ee11\") "
Sep 12 01:00:15.439170 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439062    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:00:15.439372 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439170    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:00:15.439372 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439243    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:00:15.439480 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439406    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:00:15.439480 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439410    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:00:15.439480 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439431    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.439480 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439452    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.439480 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.439468    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.440892 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.440872    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:00:15.441422 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.441397    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4" (OuterVolumeSpecName: "kube-api-access-4hxd4") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "kube-api-access-4hxd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:00:15.441500 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.441410    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:00:15.441500 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.441454    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e8ea4f6-bf36-4621-ab05-692de406ee11" (UID: "3e8ea4f6-bf36-4621-ab05-692de406ee11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:00:15.540146 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540108    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.540146 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540141    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.540343 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540154    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.540343 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540169    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8ea4f6-bf36-4621-ab05-692de406ee11-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.540343 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540181    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8ea4f6-bf36-4621-ab05-692de406ee11-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:15.540343 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:15.540193    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hxd4\" (UniqueName: \"kubernetes.io/projected/3e8ea4f6-bf36-4621-ab05-692de406ee11-kube-api-access-4hxd4\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:00:16.131748 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.131708    2556 generic.go:356] "Generic (PLEG): container finished" podID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerID="fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d" exitCode=0
Sep 12 01:00:16.132172 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.131791    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerDied","Data":"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"}
Sep 12 01:00:16.132172 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.131810    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"
Sep 12 01:00:16.132172 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.131874    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd" event={"ID":"3e8ea4f6-bf36-4621-ab05-692de406ee11","Type":"ContainerDied","Data":"f40c5093e175f9a4d2d7b75e2dd05062ce931177bb7e4f027cd648335d8fb348"}
Sep 12 01:00:16.132172 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.131888    2556 scope.go:117] "RemoveContainer" containerID="fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"
Sep 12 01:00:16.141687 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.141659    2556 scope.go:117] "RemoveContainer" containerID="39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"
Sep 12 01:00:16.150961 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.150942    2556 scope.go:117] "RemoveContainer" containerID="fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"
Sep 12 01:00:16.151253 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:00:16.151231    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d\": container with ID starting with fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d not found: ID does not exist" containerID="fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"
Sep 12 01:00:16.151305 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.151263    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d"} err="failed to get container status \"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d\": rpc error: code = NotFound desc = could not find container \"fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d\": container with ID starting with fbf3c256a1cc7c3dcf96f2e4e2e7de39fa259b88dfaa70209f71fb9588c05f8d not found: ID does not exist"
Sep 12 01:00:16.151305 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.151281    2556 scope.go:117] "RemoveContainer" containerID="39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"
Sep 12 01:00:16.151548 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:00:16.151520    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c\": container with ID starting with 39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c not found: ID does not exist" containerID="39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"
Sep 12 01:00:16.151651 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.151558    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c"} err="failed to get container status \"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c\": rpc error: code = NotFound desc = could not find container \"39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c\": container with ID starting with 39935d201f07fa87af15d07e0edf3ef712a05565a3a7df530ac28b79455c128c not found: ID does not exist"
Sep 12 01:00:16.152445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.152427    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 01:00:16.156361 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:16.156341    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd"]
Sep 12 01:00:17.315304 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:17.315273    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:00:17.457208 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:17.457176    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" path="/var/lib/kubelet/pods/3e8ea4f6-bf36-4621-ab05-692de406ee11/volumes"
Sep 12 01:00:38.909223 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:38.909191    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:00:57.717357 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:00:57.717319    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:01:07.909297 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:01:07.909264    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:01:33.211736 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:01:33.211701    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:01:49.918345 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:01:49.918315    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:02:02.611930 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:02:02.611849    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:02:13.217884 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:02:13.217847    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:02:22.722134 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:02:22.722091    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:02:44.818253 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:02:44.818219    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:02:59.012348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:02:59.012311    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:03:09.634859 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:09.634826    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:03:16.345804 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.345766    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:03:16.346777 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.346740    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7dbd60-60ea-40dc-b42b-50bb27408773" containerName="maas-api"
Sep 12 01:03:16.346955 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.346941    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7dbd60-60ea-40dc-b42b-50bb27408773" containerName="maas-api"
Sep 12 01:03:16.347062 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347044    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:03:16.347062 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347061    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff22ff4e-e8bf-4759-b6b3-79b3fb96f2b1" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347078    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347087    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347099    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60f7a56-6b82-4847-8564-19c37843b3ff" containerName="cleanup"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347107    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60f7a56-6b82-4847-8564-19c37843b3ff" containerName="cleanup"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347130    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347138    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347167    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347175    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a86e158-8daf-455a-98c7-5d50710fc713" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347187    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:03:16.347212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347195    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3f2947-7af1-41fb-ab15-180891263b55" containerName="istio-proxy"
Sep 12 01:03:16.347606 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347310    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60f7a56-6b82-4847-8564-19c37843b3ff" containerName="cleanup"
Sep 12 01:03:16.347606 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347322    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.347606 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347332    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7132b07-99b0-46b4-b51e-e44370becf19" containerName="istio-proxy"
Sep 12 01:03:16.347606 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347343    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7dbd60-60ea-40dc-b42b-50bb27408773" containerName="maas-api"
Sep 12 01:03:16.347606 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.347353    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8ea4f6-bf36-4621-ab05-692de406ee11" containerName="istio-proxy"
Sep 12 01:03:16.350821 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.350800    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.354151 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.354129    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9a2657-openshift-default-dockercfg-2npf4\""
Sep 12 01:03:16.364087 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.364066    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:03:16.426212 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426391 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426391 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426391 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426312    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlh5\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426499    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.426579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.426574    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528090 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528090 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528093    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlh5\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528229    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528348 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528698 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528367    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528698 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528698 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528644    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528903 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.528903 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.528894    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.529196 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.529177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.530965 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.530934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.531160 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.531145    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.536389 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.536365    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlh5\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.536839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.536824    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token\") pod \"e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") " pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.663689 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.663658    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:16.944471 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.944442    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:03:16.946284 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:03:16.946249    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7efa17_27dd_46ec_a3be_be4c0aee6f31.slice/crio-0ecffcbea4be194f878c9f47cd4b6308caa91b568f417d99527cdce66f23f21f WatchSource:0}: Error finding container 0ecffcbea4be194f878c9f47cd4b6308caa91b568f417d99527cdce66f23f21f: Status 404 returned error can't find the container with id 0ecffcbea4be194f878c9f47cd4b6308caa91b568f417d99527cdce66f23f21f
Sep 12 01:03:16.948883 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.948850    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:16.949000 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.948957    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:16.949066 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:16.949002    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:17.267315 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:17.267235    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerStarted","Data":"0c9c122f4af2657eb227ed1ac9d0c9574215c52931390ec4524e8279db572d06"}
Sep 12 01:03:17.267315 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:17.267293    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerStarted","Data":"0ecffcbea4be194f878c9f47cd4b6308caa91b568f417d99527cdce66f23f21f"}
Sep 12 01:03:17.289405 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:17.289357    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podStartSLOduration=1.289342035 podStartE2EDuration="1.289342035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:17.286175143 +0000 UTC m=+2050.336760753" watchObservedRunningTime="2026-09-12 01:03:17.289342035 +0000 UTC m=+2050.339927647"
Sep 12 01:03:17.664074 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:17.664043    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:18.669387 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:18.669349    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:19.281057 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:19.281013    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:19.282401 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:19.282378    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:21.023199 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.023166    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:03:21.029725 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.029698    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.034204 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.034169    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-9a2657-serving-cert\""
Sep 12 01:03:21.036781 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.036730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:03:21.072854 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.072825    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.072959 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.072887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blkx2\" (UniqueName: \"kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.073052 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.073027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.073090 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.073069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.173737 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.173694    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.173737 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.173740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.174006 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.173788    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.174006 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.173828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blkx2\" (UniqueName: \"kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.174006 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:03:21.173944    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-serving-cert: secret "maas-api-e2e-ipp-a-9a2657-serving-cert" not found
Sep 12 01:03:21.174166 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:03:21.174038    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls podName:b8390537-054f-4cd3-87c2-42b313b8b4ad nodeName:}" failed. No retries permitted until 2026-09-12 01:03:21.674015851 +0000 UTC m=+2054.724601441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls") pod "maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" (UID: "b8390537-054f-4cd3-87c2-42b313b8b4ad") : secret "maas-api-e2e-ipp-a-9a2657-serving-cert" not found
Sep 12 01:03:21.174509 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.174485    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.176297 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.176275    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.182496 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.182474    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blkx2\" (UniqueName: \"kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.678458 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.678177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.681457 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.681430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:21.944452 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:21.944367    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:22.229780 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:22.229729    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:03:22.232222 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:03:22.232185    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8390537_054f_4cd3_87c2_42b313b8b4ad.slice/crio-2fe82c276f30cff04ad709524c874f710eb6fa54659c0b8f1cfc59e8894288cf WatchSource:0}: Error finding container 2fe82c276f30cff04ad709524c874f710eb6fa54659c0b8f1cfc59e8894288cf: Status 404 returned error can't find the container with id 2fe82c276f30cff04ad709524c874f710eb6fa54659c0b8f1cfc59e8894288cf
Sep 12 01:03:22.233821 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:22.233800    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 01:03:22.304349 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:22.304314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" event={"ID":"b8390537-054f-4cd3-87c2-42b313b8b4ad","Type":"ContainerStarted","Data":"2fe82c276f30cff04ad709524c874f710eb6fa54659c0b8f1cfc59e8894288cf"}
Sep 12 01:03:23.312329 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:23.312285    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" event={"ID":"b8390537-054f-4cd3-87c2-42b313b8b4ad","Type":"ContainerStarted","Data":"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"}
Sep 12 01:03:23.312716 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:23.312352    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:23.331110 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:23.331069    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" podStartSLOduration=2.918886352 podStartE2EDuration="3.331056258s" totalImagesPullingTime="412.169906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:23.329712688 +0000 UTC m=+2056.380298332" watchObservedRunningTime="2026-09-12 01:03:23.331056258 +0000 UTC m=+2056.381641866"
Sep 12 01:03:25.526661 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:25.526625    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:03:29.323905 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:29.323875    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:03:35.324886 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:35.324855    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 01:03:35.326729 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:35.324917    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 01:03:36.406598 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.406564    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerID="0c9c122f4af2657eb227ed1ac9d0c9574215c52931390ec4524e8279db572d06" exitCode=0
Sep 12 01:03:36.406976 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.406636    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerDied","Data":"0c9c122f4af2657eb227ed1ac9d0c9574215c52931390ec4524e8279db572d06"}
Sep 12 01:03:36.407063 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.407048    2556 scope.go:117] "RemoveContainer" containerID="0c9c122f4af2657eb227ed1ac9d0c9574215c52931390ec4524e8279db572d06"
Sep 12 01:03:36.408204 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.408180    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:36.408291 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.408276    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:36.408335 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:36.408311    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 12 01:03:37.414975 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:37.414938    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerStarted","Data":"35d13e3f78e7b06bc06dc9fd764eb2e09266ebc72b8e089d9e871e6c8d4b39a1"}
Sep 12 01:03:37.665445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:37.665351    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:37.665792 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:37.665750    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 12 01:03:37.665999 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:37.665972    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 12 01:03:38.664291 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:38.664248    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 12 01:03:38.664891 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:38.664856    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 12 01:03:39.665085 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:39.664610    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 12 01:03:39.665085 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:39.664671    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 12 01:03:40.664589 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:40.664538    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 12 01:03:40.664849 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:40.664614    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 12 01:03:41.665011 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:41.664974    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 12 01:03:41.665589 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:41.665558    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 12 01:03:42.743475 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:42.743442    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:42.743972 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:42.743813    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:42.744583 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:42.744561    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:03:55.551778 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:03:55.551720    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:04:23.310203 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:04:23.310171    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"
Sep 12 01:04:40.033116 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:04:40.033078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:05:03.133014 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:03.132928    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:05:09.566509 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:09.566476    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"
Sep 12 01:05:16.904344 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.904302    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:16.907131 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.907107    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:16.909777 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.909741    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-783804-serving-cert\""
Sep 12 01:05:16.919839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.919818    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:16.983793 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.983748    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfttp\" (UniqueName: \"kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:16.983956 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.983872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:16.983956 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.983947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:16.984037 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:16.983993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.084785 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.084730    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.084983 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.084792    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.084983 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.084824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfttp\" (UniqueName: \"kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.084983 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.084902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.085512 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.085488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.087155 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.087129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.087245 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.087166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.093946 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.093926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfttp\" (UniqueName: \"kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp\") pod \"maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.224922 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.224884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:17.503076 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:17.503044    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:17.504906 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:05:17.504878    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35578f2_c88b_4ee7_a4a9_563626f1024e.slice/crio-bbe961fba203005a3fb590bac3a8c3457888253a10fb72dbd05c1947c85f1f27 WatchSource:0}: Error finding container bbe961fba203005a3fb590bac3a8c3457888253a10fb72dbd05c1947c85f1f27: Status 404 returned error can't find the container with id bbe961fba203005a3fb590bac3a8c3457888253a10fb72dbd05c1947c85f1f27
Sep 12 01:05:18.030168 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:18.030129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" event={"ID":"a35578f2-c88b-4ee7-a4a9-563626f1024e","Type":"ContainerStarted","Data":"bbe961fba203005a3fb590bac3a8c3457888253a10fb72dbd05c1947c85f1f27"}
Sep 12 01:05:19.039243 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:19.039201    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" event={"ID":"a35578f2-c88b-4ee7-a4a9-563626f1024e","Type":"ContainerStarted","Data":"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"}
Sep 12 01:05:19.039683 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:19.039426    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:19.072195 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:19.072134    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" podStartSLOduration=2.36622921 podStartE2EDuration="3.072112433s" totalImagesPullingTime="705.883223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:05:19.068653002 +0000 UTC m=+2172.119238610" watchObservedRunningTime="2026-09-12 01:05:19.072112433 +0000 UTC m=+2172.122698045"
Sep 12 01:05:21.514364 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:21.514323    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:05:25.052158 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:25.052128    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:45.639483 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:45.639439    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:45.640220 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:45.639693    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" podUID="a35578f2-c88b-4ee7-a4a9-563626f1024e" containerName="maas-api" containerID="cri-o://30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054" gracePeriod=30
Sep 12 01:05:45.906753 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:45.906724    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:46.084800 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.084746    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls\") pod \"a35578f2-c88b-4ee7-a4a9-563626f1024e\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") "
Sep 12 01:05:46.085156 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.084838    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs\") pod \"a35578f2-c88b-4ee7-a4a9-563626f1024e\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") "
Sep 12 01:05:46.085156 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.084929    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca\") pod \"a35578f2-c88b-4ee7-a4a9-563626f1024e\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") "
Sep 12 01:05:46.085156 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.084978    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfttp\" (UniqueName: \"kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp\") pod \"a35578f2-c88b-4ee7-a4a9-563626f1024e\" (UID: \"a35578f2-c88b-4ee7-a4a9-563626f1024e\") "
Sep 12 01:05:46.085353 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.085311    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a35578f2-c88b-4ee7-a4a9-563626f1024e" (UID: "a35578f2-c88b-4ee7-a4a9-563626f1024e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:05:46.087102 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.087067    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a35578f2-c88b-4ee7-a4a9-563626f1024e" (UID: "a35578f2-c88b-4ee7-a4a9-563626f1024e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:05:46.087236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.087135    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a35578f2-c88b-4ee7-a4a9-563626f1024e" (UID: "a35578f2-c88b-4ee7-a4a9-563626f1024e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:05:46.087380 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.087356    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp" (OuterVolumeSpecName: "kube-api-access-tfttp") pod "a35578f2-c88b-4ee7-a4a9-563626f1024e" (UID: "a35578f2-c88b-4ee7-a4a9-563626f1024e"). InnerVolumeSpecName "kube-api-access-tfttp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:05:46.186661 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.186617    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:05:46.186661 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.186651    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35578f2-c88b-4ee7-a4a9-563626f1024e-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:05:46.186661 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.186662    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a35578f2-c88b-4ee7-a4a9-563626f1024e-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:05:46.186971 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.186672    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfttp\" (UniqueName: \"kubernetes.io/projected/a35578f2-c88b-4ee7-a4a9-563626f1024e-kube-api-access-tfttp\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:05:46.222731 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.222695    2556 generic.go:356] "Generic (PLEG): container finished" podID="a35578f2-c88b-4ee7-a4a9-563626f1024e" containerID="30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054" exitCode=0
Sep 12 01:05:46.222731 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.222770    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"
Sep 12 01:05:46.223023 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.222789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" event={"ID":"a35578f2-c88b-4ee7-a4a9-563626f1024e","Type":"ContainerDied","Data":"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"}
Sep 12 01:05:46.223023 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.222852    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948" event={"ID":"a35578f2-c88b-4ee7-a4a9-563626f1024e","Type":"ContainerDied","Data":"bbe961fba203005a3fb590bac3a8c3457888253a10fb72dbd05c1947c85f1f27"}
Sep 12 01:05:46.223023 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.222880    2556 scope.go:117] "RemoveContainer" containerID="30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"
Sep 12 01:05:46.233371 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.233349    2556 scope.go:117] "RemoveContainer" containerID="30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"
Sep 12 01:05:46.233713 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:05:46.233688    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054\": container with ID starting with 30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054 not found: ID does not exist" containerID="30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"
Sep 12 01:05:46.233819 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.233723    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054"} err="failed to get container status \"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054\": rpc error: code = NotFound desc = could not find container \"30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054\": container with ID starting with 30aabec64747426358f7a4cd652d3be0c2be8f8b232a9dedd38e1e08c7436054 not found: ID does not exist"
Sep 12 01:05:46.246229 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.246190    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:46.248954 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:46.248931    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-783804-b68c84f4b-g8948"]
Sep 12 01:05:47.456900 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:47.456866    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35578f2-c88b-4ee7-a4a9-563626f1024e" path="/var/lib/kubelet/pods/a35578f2-c88b-4ee7-a4a9-563626f1024e/volumes"
Sep 12 01:05:50.513882 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:05:50.513846    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:06:09.224628 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:09.224588    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:06:11.706885 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:11.706818    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:06:11.707752 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:11.707711    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" podUID="b8390537-054f-4cd3-87c2-42b313b8b4ad" containerName="maas-api" containerID="cri-o://36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461" gracePeriod=30
Sep 12 01:06:11.987362 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:11.987325    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:06:12.055951 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.055901    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs\") pod \"b8390537-054f-4cd3-87c2-42b313b8b4ad\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") "
Sep 12 01:06:12.056158 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.055978    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blkx2\" (UniqueName: \"kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2\") pod \"b8390537-054f-4cd3-87c2-42b313b8b4ad\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") "
Sep 12 01:06:12.056158 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.056034    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") pod \"b8390537-054f-4cd3-87c2-42b313b8b4ad\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") "
Sep 12 01:06:12.056158 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.056086    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca\") pod \"b8390537-054f-4cd3-87c2-42b313b8b4ad\" (UID: \"b8390537-054f-4cd3-87c2-42b313b8b4ad\") "
Sep 12 01:06:12.056857 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.056787    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8390537-054f-4cd3-87c2-42b313b8b4ad" (UID: "b8390537-054f-4cd3-87c2-42b313b8b4ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:06:12.058698 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.058657    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8390537-054f-4cd3-87c2-42b313b8b4ad" (UID: "b8390537-054f-4cd3-87c2-42b313b8b4ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:06:12.058980 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.058963    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b8390537-054f-4cd3-87c2-42b313b8b4ad" (UID: "b8390537-054f-4cd3-87c2-42b313b8b4ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:06:12.059172 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.059136    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2" (OuterVolumeSpecName: "kube-api-access-blkx2") pod "b8390537-054f-4cd3-87c2-42b313b8b4ad" (UID: "b8390537-054f-4cd3-87c2-42b313b8b4ad"). InnerVolumeSpecName "kube-api-access-blkx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:06:12.157899 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.157862    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8390537-054f-4cd3-87c2-42b313b8b4ad-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:06:12.157899 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.157894    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:06:12.157899 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.157904    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blkx2\" (UniqueName: \"kubernetes.io/projected/b8390537-054f-4cd3-87c2-42b313b8b4ad-kube-api-access-blkx2\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:06:12.157899 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.157914    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8390537-054f-4cd3-87c2-42b313b8b4ad-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:06:12.397646 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.397546    2556 generic.go:356] "Generic (PLEG): container finished" podID="b8390537-054f-4cd3-87c2-42b313b8b4ad" containerID="36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461" exitCode=0
Sep 12 01:06:12.397646 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.397594    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"
Sep 12 01:06:12.397646 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.397631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" event={"ID":"b8390537-054f-4cd3-87c2-42b313b8b4ad","Type":"ContainerDied","Data":"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"}
Sep 12 01:06:12.397950 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.397696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm" event={"ID":"b8390537-054f-4cd3-87c2-42b313b8b4ad","Type":"ContainerDied","Data":"2fe82c276f30cff04ad709524c874f710eb6fa54659c0b8f1cfc59e8894288cf"}
Sep 12 01:06:12.398808 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.397723    2556 scope.go:117] "RemoveContainer" containerID="36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"
Sep 12 01:06:12.409998 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.409972    2556 scope.go:117] "RemoveContainer" containerID="36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"
Sep 12 01:06:12.410337 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:06:12.410317    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461\": container with ID starting with 36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461 not found: ID does not exist" containerID="36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"
Sep 12 01:06:12.410414 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.410346    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461"} err="failed to get container status \"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461\": rpc error: code = NotFound desc = could not find container \"36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461\": container with ID starting with 36f076a826cdff2cf7cfaf55dda1ec013306792e03ace5773b2cccf45ec08461 not found: ID does not exist"
Sep 12 01:06:12.421242 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.421204    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:06:12.427476 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:12.427444    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a2657-97775c74c-mzmmm"]
Sep 12 01:06:13.455166 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:13.455123    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8390537-054f-4cd3-87c2-42b313b8b4ad" path="/var/lib/kubelet/pods/b8390537-054f-4cd3-87c2-42b313b8b4ad/volumes"
Sep 12 01:06:23.015979 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:06:23.015938    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:07:00.605835 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:00.605797    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:07:00.606554 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:00.606514    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy" containerID="cri-o://35d13e3f78e7b06bc06dc9fd764eb2e09266ebc72b8e089d9e871e6c8d4b39a1" gracePeriod=30
Sep 12 01:07:05.745018 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.744984    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerID="35d13e3f78e7b06bc06dc9fd764eb2e09266ebc72b8e089d9e871e6c8d4b39a1" exitCode=0
Sep 12 01:07:05.745519 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.745064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerDied","Data":"35d13e3f78e7b06bc06dc9fd764eb2e09266ebc72b8e089d9e871e6c8d4b39a1"}
Sep 12 01:07:05.745519 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.745143    2556 scope.go:117] "RemoveContainer" containerID="0c9c122f4af2657eb227ed1ac9d0c9574215c52931390ec4524e8279db572d06"
Sep 12 01:07:05.884204 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.884133    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:07:05.904608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904570    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.904839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904671    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.904839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904697    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.904839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904781    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.904839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904807    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.904839 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904834    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.905111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904860    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.905111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904889    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwlh5\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.905111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904922    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy\") pod \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\" (UID: \"3d7efa17-27dd-46ec-a3be-be4c0aee6f31\") "
Sep 12 01:07:05.905111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.904936    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:05.905111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.905007    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:05.905411 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.905180    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:05.905411 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.905341    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:05.905411 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.905358    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:05.905411 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.905371    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:05.906366 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.906014    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:05.906366 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.906241    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:07:05.908325 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.907968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:05.908325 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.907994    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5" (OuterVolumeSpecName: "kube-api-access-nwlh5") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "kube-api-access-nwlh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:05.908639 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.908404    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:05.909433 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:05.909408    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d7efa17-27dd-46ec-a3be-be4c0aee6f31" (UID: "3d7efa17-27dd-46ec-a3be-be4c0aee6f31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:07:06.006935 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006899    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.006935 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006931    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.006935 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006941    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.007196 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006949    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwlh5\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-kube-api-access-nwlh5\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.007196 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006958    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.007196 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.006968    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7efa17-27dd-46ec-a3be-be4c0aee6f31-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:06.753138 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.753102    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b" event={"ID":"3d7efa17-27dd-46ec-a3be-be4c0aee6f31","Type":"ContainerDied","Data":"0ecffcbea4be194f878c9f47cd4b6308caa91b568f417d99527cdce66f23f21f"}
Sep 12 01:07:06.753138 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.753142    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"
Sep 12 01:07:06.753659 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.753165    2556 scope.go:117] "RemoveContainer" containerID="35d13e3f78e7b06bc06dc9fd764eb2e09266ebc72b8e089d9e871e6c8d4b39a1"
Sep 12 01:07:06.776574 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.776534    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:07:06.780640 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:06.780609    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b"]
Sep 12 01:07:07.455197 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:07.455163    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" path="/var/lib/kubelet/pods/3d7efa17-27dd-46ec-a3be-be4c0aee6f31/volumes"
Sep 12 01:07:15.012583 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:15.012533    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:07:30.197093 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.197047    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 01:07:30.197578 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.197357    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" podUID="aa68bb21-6089-4317-87bf-7578a5da8358" containerName="maas-api" containerID="cri-o://a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21" gracePeriod=30
Sep 12 01:07:30.462576 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.462503    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 01:07:30.556797 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.556712    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca\") pod \"aa68bb21-6089-4317-87bf-7578a5da8358\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") "
Sep 12 01:07:30.556797 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.556804    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fxbx\" (UniqueName: \"kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx\") pod \"aa68bb21-6089-4317-87bf-7578a5da8358\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") "
Sep 12 01:07:30.557100 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.556850    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls\") pod \"aa68bb21-6089-4317-87bf-7578a5da8358\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") "
Sep 12 01:07:30.557100 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.556878    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs\") pod \"aa68bb21-6089-4317-87bf-7578a5da8358\" (UID: \"aa68bb21-6089-4317-87bf-7578a5da8358\") "
Sep 12 01:07:30.557276 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.557248    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa68bb21-6089-4317-87bf-7578a5da8358" (UID: "aa68bb21-6089-4317-87bf-7578a5da8358"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:07:30.557448 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.557407    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa68bb21-6089-4317-87bf-7578a5da8358-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:30.560458 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.560314    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa68bb21-6089-4317-87bf-7578a5da8358" (UID: "aa68bb21-6089-4317-87bf-7578a5da8358"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:07:30.560458 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.560411    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aa68bb21-6089-4317-87bf-7578a5da8358" (UID: "aa68bb21-6089-4317-87bf-7578a5da8358"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:07:30.560708 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.560511    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx" (OuterVolumeSpecName: "kube-api-access-7fxbx") pod "aa68bb21-6089-4317-87bf-7578a5da8358" (UID: "aa68bb21-6089-4317-87bf-7578a5da8358"). InnerVolumeSpecName "kube-api-access-7fxbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:30.658630 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.658571    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fxbx\" (UniqueName: \"kubernetes.io/projected/aa68bb21-6089-4317-87bf-7578a5da8358-kube-api-access-7fxbx\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:30.658630 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.658617    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:30.658630 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.658631    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa68bb21-6089-4317-87bf-7578a5da8358-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:30.905237 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.905140    2556 generic.go:356] "Generic (PLEG): container finished" podID="aa68bb21-6089-4317-87bf-7578a5da8358" containerID="a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21" exitCode=0
Sep 12 01:07:30.905237 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.905190    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" event={"ID":"aa68bb21-6089-4317-87bf-7578a5da8358","Type":"ContainerDied","Data":"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"}
Sep 12 01:07:30.905237 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.905229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt" event={"ID":"aa68bb21-6089-4317-87bf-7578a5da8358","Type":"ContainerDied","Data":"114275bb2090f28d47a89dc1728d268d171979e49872383d135b20ec9b3eb3a3"}
Sep 12 01:07:30.905559 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.905252    2556 scope.go:117] "RemoveContainer" containerID="a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"
Sep 12 01:07:30.905559 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.905191    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"
Sep 12 01:07:30.915811 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.915790    2556 scope.go:117] "RemoveContainer" containerID="a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"
Sep 12 01:07:30.916150 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:07:30.916126    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21\": container with ID starting with a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21 not found: ID does not exist" containerID="a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"
Sep 12 01:07:30.916249 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.916161    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21"} err="failed to get container status \"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21\": rpc error: code = NotFound desc = could not find container \"a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21\": container with ID starting with a3d9cf321173d2c23c2a156e9081e5fa40bc49c52def01f673d9d639b92b4d21 not found: ID does not exist"
Sep 12 01:07:30.928043 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.928012    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 01:07:30.934411 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:30.934385    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-9511bd-789c4fcd58-zwznt"]
Sep 12 01:07:31.455072 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:31.455035    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa68bb21-6089-4317-87bf-7578a5da8358" path="/var/lib/kubelet/pods/aa68bb21-6089-4317-87bf-7578a5da8358/volumes"
Sep 12 01:07:33.419704 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:33.419669    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:07:37.243308 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:37.243268    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 01:07:37.243888 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:37.243506    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" containerID="cri-o://b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2" gracePeriod=30
Sep 12 01:07:41.168915 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:41.168873    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:07:41.169319 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:41.168949    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:07:42.492261 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.492230    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 01:07:42.570835 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570710    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570839    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hvkc\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570865    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570888    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570906    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570927    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570971    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571021 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.570995    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571035    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket\") pod \"6822faeb-698c-456b-bd20-26488fc780d6\" (UID: \"6822faeb-698c-456b-bd20-26488fc780d6\") "
Sep 12 01:07:42.571445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571146    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:07:42.571445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571415    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6822faeb-698c-456b-bd20-26488fc780d6-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.571445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571249    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:42.571445 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571441    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:42.571645 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571460    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:42.571645 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.571583    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:42.573267 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.573239    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc" (OuterVolumeSpecName: "kube-api-access-2hvkc") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "kube-api-access-2hvkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:42.573267 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.573251    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:07:42.573576 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.573556    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:07:42.573633 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.573588    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "6822faeb-698c-456b-bd20-26488fc780d6" (UID: "6822faeb-698c-456b-bd20-26488fc780d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:42.672852 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672811    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hvkc\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-kube-api-access-2hvkc\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.672852 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672847    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.672852 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672856    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6822faeb-698c-456b-bd20-26488fc780d6-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.672852 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672865    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.673149 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672873    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.673149 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672881    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6822faeb-698c-456b-bd20-26488fc780d6-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.673149 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672889    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.673149 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.672897    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6822faeb-698c-456b-bd20-26488fc780d6-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:42.984114 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.984077    2556 generic.go:356] "Generic (PLEG): container finished" podID="6822faeb-698c-456b-bd20-26488fc780d6" containerID="b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2" exitCode=0
Sep 12 01:07:42.984309 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.984125    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"
Sep 12 01:07:42.984309 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.984160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerDied","Data":"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"}
Sep 12 01:07:42.984309 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.984216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc" event={"ID":"6822faeb-698c-456b-bd20-26488fc780d6","Type":"ContainerDied","Data":"7b768a612dacc261c6f375e440e25915c5d67dbcd2a7f99f453ed19f56f1eed8"}
Sep 12 01:07:42.984309 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.984241    2556 scope.go:117] "RemoveContainer" containerID="b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"
Sep 12 01:07:42.994623 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:42.994604    2556 scope.go:117] "RemoveContainer" containerID="f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"
Sep 12 01:07:43.003507 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.003486    2556 scope.go:117] "RemoveContainer" containerID="b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"
Sep 12 01:07:43.003917 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:07:43.003896    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2\": container with ID starting with b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2 not found: ID does not exist" containerID="b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"
Sep 12 01:07:43.003984 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.003927    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2"} err="failed to get container status \"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2\": rpc error: code = NotFound desc = could not find container \"b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2\": container with ID starting with b892a684e0a70abff62fb394c24de5d08affa4dbf4183a6eac8d6e826e8bb8f2 not found: ID does not exist"
Sep 12 01:07:43.003984 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.003946    2556 scope.go:117] "RemoveContainer" containerID="f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"
Sep 12 01:07:43.004362 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:07:43.004307    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5\": container with ID starting with f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5 not found: ID does not exist" containerID="f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"
Sep 12 01:07:43.004600 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.004570    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5"} err="failed to get container status \"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5\": rpc error: code = NotFound desc = could not find container \"f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5\": container with ID starting with f0159e89a3708450df89412ea13e93ca9e49b13f8b9772a98741ddf809ac2dc5 not found: ID does not exist"
Sep 12 01:07:43.007905 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.007883    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 01:07:43.011953 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.011926    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc"]
Sep 12 01:07:43.455199 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:43.455163    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6822faeb-698c-456b-bd20-26488fc780d6" path="/var/lib/kubelet/pods/6822faeb-698c-456b-bd20-26488fc780d6/volumes"
Sep 12 01:07:48.161893 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.161843    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 01:07:48.162555 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.162174    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" podUID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" containerName="maas-api" containerID="cri-o://fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c" gracePeriod=30
Sep 12 01:07:48.422614 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.422535    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 01:07:48.530718 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.530683    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tljjf\" (UniqueName: \"kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf\") pod \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") "
Sep 12 01:07:48.530915 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.530744    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") pod \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") "
Sep 12 01:07:48.530915 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.530786    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs\") pod \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") "
Sep 12 01:07:48.530915 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.530839    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca\") pod \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\" (UID: \"c32024f4-d3a1-46a3-be45-a1176fb89cdf\") "
Sep 12 01:07:48.531236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.531207    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c32024f4-d3a1-46a3-be45-a1176fb89cdf" (UID: "c32024f4-d3a1-46a3-be45-a1176fb89cdf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:07:48.533079 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.533051    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c32024f4-d3a1-46a3-be45-a1176fb89cdf" (UID: "c32024f4-d3a1-46a3-be45-a1176fb89cdf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:07:48.533192 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.533082    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf" (OuterVolumeSpecName: "kube-api-access-tljjf") pod "c32024f4-d3a1-46a3-be45-a1176fb89cdf" (UID: "c32024f4-d3a1-46a3-be45-a1176fb89cdf"). InnerVolumeSpecName "kube-api-access-tljjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:07:48.533192 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.533109    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c32024f4-d3a1-46a3-be45-a1176fb89cdf" (UID: "c32024f4-d3a1-46a3-be45-a1176fb89cdf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:07:48.632365 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.632317    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tljjf\" (UniqueName: \"kubernetes.io/projected/c32024f4-d3a1-46a3-be45-a1176fb89cdf-kube-api-access-tljjf\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:48.632365 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.632356    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:48.632365 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.632369    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c32024f4-d3a1-46a3-be45-a1176fb89cdf-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:48.632625 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:48.632382    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c32024f4-d3a1-46a3-be45-a1176fb89cdf-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:07:49.022986 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.022948    2556 generic.go:356] "Generic (PLEG): container finished" podID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" containerID="fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c" exitCode=0
Sep 12 01:07:49.023188 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.023000    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"
Sep 12 01:07:49.023188 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.023041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" event={"ID":"c32024f4-d3a1-46a3-be45-a1176fb89cdf","Type":"ContainerDied","Data":"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"}
Sep 12 01:07:49.023188 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.023102    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk" event={"ID":"c32024f4-d3a1-46a3-be45-a1176fb89cdf","Type":"ContainerDied","Data":"8be7ae4b7c1b61d25ea380511f647aa3849562e877ddf46098c324129e2d5e71"}
Sep 12 01:07:49.023188 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.023132    2556 scope.go:117] "RemoveContainer" containerID="fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"
Sep 12 01:07:49.034045 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.034025    2556 scope.go:117] "RemoveContainer" containerID="fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"
Sep 12 01:07:49.034356 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:07:49.034338    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c\": container with ID starting with fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c not found: ID does not exist" containerID="fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"
Sep 12 01:07:49.034404 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.034364    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c"} err="failed to get container status \"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c\": rpc error: code = NotFound desc = could not find container \"fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c\": container with ID starting with fdba028b789ee710a55e4b143b6c506e51d7cc644cc9924c9510b7b9ea52f11c not found: ID does not exist"
Sep 12 01:07:49.055351 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.055312    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 01:07:49.064452 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.064418    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-dd25dd-6d6d8f9bd8-bzgqk"]
Sep 12 01:07:49.455320 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:49.455283    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" path="/var/lib/kubelet/pods/c32024f4-d3a1-46a3-be45-a1176fb89cdf/volumes"
Sep 12 01:07:50.718244 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:50.718203    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:07:54.956548 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:54.956511    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 01:07:54.957332 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:07:54.957295    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy" containerID="cri-o://afd0cb39acb218a866a5ff38b273d9101419d8d7333adae773712212508a6a3f" gracePeriod=30
Sep 12 01:08:00.013610 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.013559    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:08:00.102287 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.102244    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerID="afd0cb39acb218a866a5ff38b273d9101419d8d7333adae773712212508a6a3f" exitCode=0
Sep 12 01:08:00.102484 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.102322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerDied","Data":"afd0cb39acb218a866a5ff38b273d9101419d8d7333adae773712212508a6a3f"}
Sep 12 01:08:00.102484 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.102406    2556 scope.go:117] "RemoveContainer" containerID="9d3fae6b81c418b56bb506a959faadcaf713b068175e57a5058aad1a8bb44e55"
Sep 12 01:08:00.219678 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.219644    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 01:08:00.345259 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345152    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345259 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345200    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345259 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345233    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345259 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345262    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345306    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345340    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345398    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vplhg\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345421    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345445    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy\") pod \"6b555865-580a-4ba3-a532-02e1e86a9c53\" (UID: \"6b555865-580a-4ba3-a532-02e1e86a9c53\") "
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345495    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:08:00.345608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345565    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345724    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345750    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345647    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345839    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-data\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345857    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345872    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-credential-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.345993 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.345905    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-workload-socket\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.347830 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.347800    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:08:00.347958 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.347906    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg" (OuterVolumeSpecName: "kube-api-access-vplhg") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "kube-api-access-vplhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:08:00.347958 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.347906    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:08:00.347958 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.347913    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b555865-580a-4ba3-a532-02e1e86a9c53" (UID: "6b555865-580a-4ba3-a532-02e1e86a9c53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:08:00.447338 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.447293    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b555865-580a-4ba3-a532-02e1e86a9c53-istiod-ca-cert\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.447338 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.447332    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-token\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.447338 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.447341    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-podinfo\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.447338 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.447350    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vplhg\" (UniqueName: \"kubernetes.io/projected/6b555865-580a-4ba3-a532-02e1e86a9c53-kube-api-access-vplhg\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:00.447635 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:00.447359    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b555865-580a-4ba3-a532-02e1e86a9c53-istio-envoy\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:08:01.109999 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.109965    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"
Sep 12 01:08:01.110464 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.110007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf" event={"ID":"6b555865-580a-4ba3-a532-02e1e86a9c53","Type":"ContainerDied","Data":"b1d55e44fcbd6c4aa2d14d6f7aefe6cf5821e032bec9752c2aaae68bafd1c621"}
Sep 12 01:08:01.110464 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.110068    2556 scope.go:117] "RemoveContainer" containerID="afd0cb39acb218a866a5ff38b273d9101419d8d7333adae773712212508a6a3f"
Sep 12 01:08:01.134233 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.134197    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 01:08:01.137999 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.137967    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf"]
Sep 12 01:08:01.454752 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:08:01.454713    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" path="/var/lib/kubelet/pods/6b555865-580a-4ba3-a532-02e1e86a9c53/volumes"
Sep 12 01:09:19.232238 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:09:19.232198    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:09:45.226064 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:09:45.226027    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:09:52.312712 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:09:52.312675    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:09:58.613089 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:09:58.613049    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:10:06.625236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:06.625195    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:10:21.013614 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:21.013570    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:10:29.226842 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:29.226800    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:10:36.078276 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.078240    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 01:10:36.078792 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.078479    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager" containerID="cri-o://ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c" gracePeriod=10
Sep 12 01:10:36.337600 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.337529    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 01:10:36.339678 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.339656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume\") pod \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") "
Sep 12 01:10:36.339748 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.339714    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpvc7\" (UniqueName: \"kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7\") pod \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\" (UID: \"c85fa46e-bd84-4026-8424-7de26e7bb0b3\") "
Sep 12 01:10:36.340105 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.340081    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c85fa46e-bd84-4026-8424-7de26e7bb0b3" (UID: "c85fa46e-bd84-4026-8424-7de26e7bb0b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:36.341879 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.341854    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7" (OuterVolumeSpecName: "kube-api-access-lpvc7") pod "c85fa46e-bd84-4026-8424-7de26e7bb0b3" (UID: "c85fa46e-bd84-4026-8424-7de26e7bb0b3"). InnerVolumeSpecName "kube-api-access-lpvc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:10:36.440966 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.440930    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpvc7\" (UniqueName: \"kubernetes.io/projected/c85fa46e-bd84-4026-8424-7de26e7bb0b3-kube-api-access-lpvc7\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:10:36.440966 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:36.440963    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85fa46e-bd84-4026-8424-7de26e7bb0b3-extensions-socket-volume\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:10:37.046125 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.046084    2556 generic.go:356] "Generic (PLEG): container finished" podID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerID="ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c" exitCode=0
Sep 12 01:10:37.046326 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.046141    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"
Sep 12 01:10:37.046326 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.046160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerDied","Data":"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"}
Sep 12 01:10:37.046326 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.046217    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr" event={"ID":"c85fa46e-bd84-4026-8424-7de26e7bb0b3","Type":"ContainerDied","Data":"e14fe80e2072090ac64534b2752b426d5919dcf70baac8d96ef4cb3035330974"}
Sep 12 01:10:37.046326 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.046240    2556 scope.go:117] "RemoveContainer" containerID="ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"
Sep 12 01:10:37.056524 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.056504    2556 scope.go:117] "RemoveContainer" containerID="ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"
Sep 12 01:10:37.065569 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.065546    2556 scope.go:117] "RemoveContainer" containerID="ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"
Sep 12 01:10:37.065948 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:10:37.065925    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c\": container with ID starting with ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c not found: ID does not exist" containerID="ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"
Sep 12 01:10:37.065996 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.065958    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c"} err="failed to get container status \"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c\": rpc error: code = NotFound desc = could not find container \"ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c\": container with ID starting with ca065956f7547c39efe10f05382551e8ff484610ad36d33c16ace2057158a00c not found: ID does not exist"
Sep 12 01:10:37.065996 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.065978    2556 scope.go:117] "RemoveContainer" containerID="ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"
Sep 12 01:10:37.066292 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:10:37.066226    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488\": container with ID starting with ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488 not found: ID does not exist" containerID="ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"
Sep 12 01:10:37.066363 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.066301    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488"} err="failed to get container status \"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488\": rpc error: code = NotFound desc = could not find container \"ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488\": container with ID starting with ea67f9c0c6d699cf0a7093106244c39bf360aed2a3b7c31430ae6e3ba6169488 not found: ID does not exist"
Sep 12 01:10:37.070398 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.070368    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 01:10:37.075263 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.075239    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d5ktr"]
Sep 12 01:10:37.455811 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:10:37.455777    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" path="/var/lib/kubelet/pods/c85fa46e-bd84-4026-8424-7de26e7bb0b3/volumes"
Sep 12 01:11:36.762482 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762444    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"]
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762885    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8390537-054f-4cd3-87c2-42b313b8b4ad" containerName="maas-api"
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762898    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8390537-054f-4cd3-87c2-42b313b8b4ad" containerName="maas-api"
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762909    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762914    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762931    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:11:36.762937 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762939    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762952    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762958    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762964    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762969    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762977    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa68bb21-6089-4317-87bf-7578a5da8358" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762982    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa68bb21-6089-4317-87bf-7578a5da8358" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762990    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.762995    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763001    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35578f2-c88b-4ee7-a4a9-563626f1024e" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763006    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35578f2-c88b-4ee7-a4a9-563626f1024e" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763014    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763020    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763025    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763030    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763087    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763094    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763101    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa68bb21-6089-4317-87bf-7578a5da8358" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763106    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763110    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35578f2-c88b-4ee7-a4a9-563626f1024e" containerName="maas-api"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763115    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763120    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763125    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7efa17-27dd-46ec-a3be-be4c0aee6f31" containerName="istio-proxy"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763132    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:11:36.763132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763139    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8390537-054f-4cd3-87c2-42b313b8b4ad" containerName="maas-api"
Sep 12 01:11:36.763863 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.763144    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c32024f4-d3a1-46a3-be45-a1176fb89cdf" containerName="maas-api"
Sep 12 01:11:36.766253 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.766234    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.769168 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.769143    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2tmjk\""
Sep 12 01:11:36.782852 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.782813    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"]
Sep 12 01:11:36.797454 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.797398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzzj\" (UniqueName: \"kubernetes.io/projected/8323c00d-e5c1-4542-97a6-aed2bb70442b-kube-api-access-rgzzj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.797740 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.797505    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8323c00d-e5c1-4542-97a6-aed2bb70442b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.898528 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.898481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8323c00d-e5c1-4542-97a6-aed2bb70442b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.898739 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.898613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzzj\" (UniqueName: \"kubernetes.io/projected/8323c00d-e5c1-4542-97a6-aed2bb70442b-kube-api-access-rgzzj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.899020 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.898993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8323c00d-e5c1-4542-97a6-aed2bb70442b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:36.909149 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:36.909109    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzzj\" (UniqueName: \"kubernetes.io/projected/8323c00d-e5c1-4542-97a6-aed2bb70442b-kube-api-access-rgzzj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-pcwbf\" (UID: \"8323c00d-e5c1-4542-97a6-aed2bb70442b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:37.077369 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:37.077277    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:37.386967 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:37.386926    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"]
Sep 12 01:11:37.387299 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:11:37.387275    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8323c00d_e5c1_4542_97a6_aed2bb70442b.slice/crio-fc412fc498d55a70c9b2d4309887f5409d2aa8acf48cf2fe61c6d674a42202fd WatchSource:0}: Error finding container fc412fc498d55a70c9b2d4309887f5409d2aa8acf48cf2fe61c6d674a42202fd: Status 404 returned error can't find the container with id fc412fc498d55a70c9b2d4309887f5409d2aa8acf48cf2fe61c6d674a42202fd
Sep 12 01:11:38.395859 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:38.395731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf" event={"ID":"8323c00d-e5c1-4542-97a6-aed2bb70442b","Type":"ContainerStarted","Data":"3c1c8e81740a516e4ac6b6c87b4b6f4073ab8274ba282570f1695ad74ac55374"}
Sep 12 01:11:38.396342 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:38.395890    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:38.396342 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:38.395916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf" event={"ID":"8323c00d-e5c1-4542-97a6-aed2bb70442b","Type":"ContainerStarted","Data":"fc412fc498d55a70c9b2d4309887f5409d2aa8acf48cf2fe61c6d674a42202fd"}
Sep 12 01:11:38.428608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:38.428526    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf" podStartSLOduration=2.428503865 podStartE2EDuration="2.428503865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:11:38.423336776 +0000 UTC m=+2551.473922384" watchObservedRunningTime="2026-09-12 01:11:38.428503865 +0000 UTC m=+2551.479089474"
Sep 12 01:11:49.404584 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:49.404548    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-pcwbf"
Sep 12 01:11:57.813834 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:11:57.813793    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:12:02.819860 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:12:02.819817    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:12:10.219825 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:12:10.219783    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:12:16.211064 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:12:16.211024    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:12:29.309419 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:12:29.309368    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:12:45.217412 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:12:45.217375    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:08.609674 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:08.609638    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:17.518505 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:17.518466    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:26.740291 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.740254    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:26.903239 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903199    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:26.903620 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903606    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:13:26.903680 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903621    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b555865-580a-4ba3-a532-02e1e86a9c53" containerName="istio-proxy"
Sep 12 01:13:26.903680 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903639    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:13:26.903680 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903645    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85fa46e-bd84-4026-8424-7de26e7bb0b3" containerName="manager"
Sep 12 01:13:26.903827 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.903716    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6822faeb-698c-456b-bd20-26488fc780d6" containerName="istio-proxy"
Sep 12 01:13:26.906994 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.906975    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:26.911093 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.911063    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 12 01:13:26.911261 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.911068    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9r9zt\""
Sep 12 01:13:26.911261 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.911190    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:13:26.911261 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.911218    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 12 01:13:26.912144 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.912127    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 12 01:13:26.927006 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.926976    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:26.935975 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.935944    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"]
Sep 12 01:13:26.939867 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.939841    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:26.958995 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:26.958965    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"]
Sep 12 01:13:27.036831 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.036713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.036831 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.036784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-maas-api-tls\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.036831 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.036816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.037140 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.036841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxd4p\" (UniqueName: \"kubernetes.io/projected/efb36a9e-f125-4c58-a6ea-0dce88569ebc-kube-api-access-dxd4p\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.037140 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.036965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-metrics-certs\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.037140 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.037051    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb36a9e-f125-4c58-a6ea-0dce88569ebc-openshift-service-ca\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.037140 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.037083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8np9\" (UniqueName: \"kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.037140 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.037119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.138055 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-metrics-certs\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb36a9e-f125-4c58-a6ea-0dce88569ebc-openshift-service-ca\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8np9\" (UniqueName: \"kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-maas-api-tls\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.138236 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxd4p\" (UniqueName: \"kubernetes.io/projected/efb36a9e-f125-4c58-a6ea-0dce88569ebc-kube-api-access-dxd4p\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.139016 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.138990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb36a9e-f125-4c58-a6ea-0dce88569ebc-openshift-service-ca\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.139132 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.139025    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.140859 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.140843    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-metrics-certs\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.140946 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.140927    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.140989 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.140956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.141027 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.141001    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb36a9e-f125-4c58-a6ea-0dce88569ebc-maas-api-tls\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.148111 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.148088    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxd4p\" (UniqueName: \"kubernetes.io/projected/efb36a9e-f125-4c58-a6ea-0dce88569ebc-kube-api-access-dxd4p\") pod \"maas-api-65b566db79-8bcqc\" (UID: \"efb36a9e-f125-4c58-a6ea-0dce88569ebc\") " pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.148481 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.148457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8np9\" (UniqueName: \"kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9\") pod \"maas-api-84484d59ff-wvb86\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") " pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.218583 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.218551    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:27.250080 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.250045    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:27.498878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.498832    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:27.499477 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:13:27.499442    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e44356_841a_44e9_82f0_90775a525ff4.slice/crio-a219021a606ee6e992a03b7f73b0f694afa37ddc6a6b670da59a945ac6f0aafd WatchSource:0}: Error finding container a219021a606ee6e992a03b7f73b0f694afa37ddc6a6b670da59a945ac6f0aafd: Status 404 returned error can't find the container with id a219021a606ee6e992a03b7f73b0f694afa37ddc6a6b670da59a945ac6f0aafd
Sep 12 01:13:27.501042 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.501025    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 01:13:27.535688 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:27.535661    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"]
Sep 12 01:13:27.536435 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:13:27.536412    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb36a9e_f125_4c58_a6ea_0dce88569ebc.slice/crio-d8e57f2eea1f37d56acc26cb9fcadec5b8be0bdce05213381a1b2e65966517f2 WatchSource:0}: Error finding container d8e57f2eea1f37d56acc26cb9fcadec5b8be0bdce05213381a1b2e65966517f2: Status 404 returned error can't find the container with id d8e57f2eea1f37d56acc26cb9fcadec5b8be0bdce05213381a1b2e65966517f2
Sep 12 01:13:28.064921 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.064882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" event={"ID":"31e44356-841a-44e9-82f0-90775a525ff4","Type":"ContainerStarted","Data":"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"}
Sep 12 01:13:28.065397 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.064960    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" event={"ID":"31e44356-841a-44e9-82f0-90775a525ff4","Type":"ContainerStarted","Data":"a219021a606ee6e992a03b7f73b0f694afa37ddc6a6b670da59a945ac6f0aafd"}
Sep 12 01:13:28.065397 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.064992    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:28.066905 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.066876    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc" event={"ID":"efb36a9e-f125-4c58-a6ea-0dce88569ebc","Type":"ContainerStarted","Data":"7c952e8493746d88473a25d364cbb02c7adadfaf0246628cc923bdd99c38d065"}
Sep 12 01:13:28.067053 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.066928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc" event={"ID":"efb36a9e-f125-4c58-a6ea-0dce88569ebc","Type":"ContainerStarted","Data":"d8e57f2eea1f37d56acc26cb9fcadec5b8be0bdce05213381a1b2e65966517f2"}
Sep 12 01:13:28.067053 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.066956    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:28.086258 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.086203    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" podStartSLOduration=1.6118717839999999 podStartE2EDuration="2.086187023s" totalImagesPullingTime="474.315239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:13:28.083198296 +0000 UTC m=+2661.133783903" watchObservedRunningTime="2026-09-12 01:13:28.086187023 +0000 UTC m=+2661.136772631"
Sep 12 01:13:28.108878 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:28.108820    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc" podStartSLOduration=1.658354926 podStartE2EDuration="2.108802149s" totalImagesPullingTime="450.447223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:13:28.106542727 +0000 UTC m=+2661.157128336" watchObservedRunningTime="2026-09-12 01:13:28.108802149 +0000 UTC m=+2661.159387761"
Sep 12 01:13:34.079302 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.079268    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65b566db79-8bcqc"
Sep 12 01:13:34.079720 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.079574    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:34.147772 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.147705    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:34.148004 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.147974    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" podUID="31e44356-841a-44e9-82f0-90775a525ff4" containerName="maas-api" containerID="cri-o://1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e" gracePeriod=30
Sep 12 01:13:34.322185 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.322154    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:34.398856 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.398832    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:34.503879 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.503848    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca\") pod \"31e44356-841a-44e9-82f0-90775a525ff4\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") "
Sep 12 01:13:34.504040 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.503952    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls\") pod \"31e44356-841a-44e9-82f0-90775a525ff4\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") "
Sep 12 01:13:34.504040 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.503985    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs\") pod \"31e44356-841a-44e9-82f0-90775a525ff4\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") "
Sep 12 01:13:34.504040 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.504010    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8np9\" (UniqueName: \"kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9\") pod \"31e44356-841a-44e9-82f0-90775a525ff4\" (UID: \"31e44356-841a-44e9-82f0-90775a525ff4\") "
Sep 12 01:13:34.504259 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.504213    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31e44356-841a-44e9-82f0-90775a525ff4" (UID: "31e44356-841a-44e9-82f0-90775a525ff4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:13:34.504378 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.504352    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e44356-841a-44e9-82f0-90775a525ff4-openshift-service-ca\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:13:34.506174 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.506144    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31e44356-841a-44e9-82f0-90775a525ff4" (UID: "31e44356-841a-44e9-82f0-90775a525ff4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:13:34.506174 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.506152    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9" (OuterVolumeSpecName: "kube-api-access-g8np9") pod "31e44356-841a-44e9-82f0-90775a525ff4" (UID: "31e44356-841a-44e9-82f0-90775a525ff4"). InnerVolumeSpecName "kube-api-access-g8np9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:13:34.506328 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.506272    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31e44356-841a-44e9-82f0-90775a525ff4" (UID: "31e44356-841a-44e9-82f0-90775a525ff4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:13:34.605035 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.605007    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-maas-api-tls\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:13:34.605035 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.605029    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e44356-841a-44e9-82f0-90775a525ff4-metrics-certs\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:13:34.605035 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:34.605038    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8np9\" (UniqueName: \"kubernetes.io/projected/31e44356-841a-44e9-82f0-90775a525ff4-kube-api-access-g8np9\") on node \"ip-10-0-131-144.ec2.internal\" DevicePath \"\""
Sep 12 01:13:35.108138 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.108105    2556 generic.go:356] "Generic (PLEG): container finished" podID="31e44356-841a-44e9-82f0-90775a525ff4" containerID="1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e" exitCode=0
Sep 12 01:13:35.108618 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.108163    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"
Sep 12 01:13:35.108618 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.108178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" event={"ID":"31e44356-841a-44e9-82f0-90775a525ff4","Type":"ContainerDied","Data":"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"}
Sep 12 01:13:35.108618 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.108221    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84484d59ff-wvb86" event={"ID":"31e44356-841a-44e9-82f0-90775a525ff4","Type":"ContainerDied","Data":"a219021a606ee6e992a03b7f73b0f694afa37ddc6a6b670da59a945ac6f0aafd"}
Sep 12 01:13:35.108618 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.108241    2556 scope.go:117] "RemoveContainer" containerID="1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"
Sep 12 01:13:35.117998 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.117975    2556 scope.go:117] "RemoveContainer" containerID="1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"
Sep 12 01:13:35.118266 ip-10-0-131-144 kubenswrapper[2556]: E0912 01:13:35.118246    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e\": container with ID starting with 1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e not found: ID does not exist" containerID="1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"
Sep 12 01:13:35.118319 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.118277    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e"} err="failed to get container status \"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e\": rpc error: code = NotFound desc = could not find container \"1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e\": container with ID starting with 1f8faf23696804e76ad228ece7ac604ce85a7be9aceee29b1337f767cbb9818e not found: ID does not exist"
Sep 12 01:13:35.130112 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.130090    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:35.135244 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.135224    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84484d59ff-wvb86"]
Sep 12 01:13:35.453581 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:35.453549    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e44356-841a-44e9-82f0-90775a525ff4" path="/var/lib/kubelet/pods/31e44356-841a-44e9-82f0-90775a525ff4/volumes"
Sep 12 01:13:41.311092 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:41.311057    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:47.010573 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:47.010535    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:13:53.914800 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:13:53.914752    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xxslp"]
Sep 12 01:14:01.790775 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:01.790679    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fn2n7_b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc/manager/0.log"
Sep 12 01:14:02.242316 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:02.242286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67b7744c54-knqn7_734fe9de-dd3a-49fe-8470-2af0d0e60371/copy-manifests/0.log"
Sep 12 01:14:02.254444 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:02.254416    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67b7744c54-knqn7_734fe9de-dd3a-49fe-8470-2af0d0e60371/manager/0.log"
Sep 12 01:14:02.809947 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:02.809922    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65b566db79-8bcqc_efb36a9e-f125-4c58-a6ea-0dce88569ebc/maas-api/0.log"
Sep 12 01:14:03.022579 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:03.022553    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819565-xjhgd_2511b109-ded5-470f-8bae-34e3ffeba78e/cleanup/0.log"
Sep 12 01:14:04.152088 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:04.152057    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-f56zl_bba4be01-d6af-462a-af2e-eee16272f073/manager/0.log"
Sep 12 01:14:04.262468 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:04.262439    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dwpk4_5f1c59bb-3b03-4302-8e7f-864bc0b679e0/manager/0.log"
Sep 12 01:14:04.510256 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:04.510231    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-pcwbf_8323c00d-e5c1-4542-97a6-aed2bb70442b/manager/0.log"
Sep 12 01:14:04.634797 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:04.634746    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xxslp_5c77c24a-ee36-4816-861b-8deaa0d10f60/limitador/0.log"
Sep 12 01:14:05.233491 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:05.233464    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c7zdh_244d3419-40a0-47da-b086-f85d45d8c026/discovery/0.log"
Sep 12 01:14:05.493223 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:05.493146    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797549bd89-twhcg_4eb0fa34-10a4-42d6-b521-43d731755f22/kube-auth-proxy/0.log"
Sep 12 01:14:05.846519 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:05.846442    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"
Sep 12 01:14:12.937948 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.937902    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fp67s/must-gather-zzrsk"]
Sep 12 01:14:12.938364 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.938350    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e44356-841a-44e9-82f0-90775a525ff4" containerName="maas-api"
Sep 12 01:14:12.938409 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.938367    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e44356-841a-44e9-82f0-90775a525ff4" containerName="maas-api"
Sep 12 01:14:12.938454 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.938443    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e44356-841a-44e9-82f0-90775a525ff4" containerName="maas-api"
Sep 12 01:14:12.943042 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.943025    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:12.946792 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.946741    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fp67s\"/\"openshift-service-ca.crt\""
Sep 12 01:14:12.946920 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.946847    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fp67s\"/\"kube-root-ca.crt\""
Sep 12 01:14:12.946920 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.946846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fp67s\"/\"default-dockercfg-wb842\""
Sep 12 01:14:12.966333 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:12.966306    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fp67s/must-gather-zzrsk"]
Sep 12 01:14:13.051401 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.051362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-must-gather-output\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.051576 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.051479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgcs4\" (UniqueName: \"kubernetes.io/projected/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-kube-api-access-bgcs4\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.152877 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.152846    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgcs4\" (UniqueName: \"kubernetes.io/projected/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-kube-api-access-bgcs4\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.153049 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.152914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-must-gather-output\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.153200 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.153181    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-must-gather-output\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.167358 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.167324    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgcs4\" (UniqueName: \"kubernetes.io/projected/cf96e38e-4e8b-47cf-afc1-ea7278bf8883-kube-api-access-bgcs4\") pod \"must-gather-zzrsk\" (UID: \"cf96e38e-4e8b-47cf-afc1-ea7278bf8883\") " pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.252180 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.252108    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fp67s/must-gather-zzrsk"
Sep 12 01:14:13.545696 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:13.545672    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fp67s/must-gather-zzrsk"]
Sep 12 01:14:13.548080 ip-10-0-131-144 kubenswrapper[2556]: W0912 01:14:13.548055    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf96e38e_4e8b_47cf_afc1_ea7278bf8883.slice/crio-5fa744f51d367f271373db4459cf3f0cc17447e9f36ca5ac9e2c368740dc841b WatchSource:0}: Error finding container 5fa744f51d367f271373db4459cf3f0cc17447e9f36ca5ac9e2c368740dc841b: Status 404 returned error can't find the container with id 5fa744f51d367f271373db4459cf3f0cc17447e9f36ca5ac9e2c368740dc841b
Sep 12 01:14:14.340363 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:14.340333    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fp67s/must-gather-zzrsk" event={"ID":"cf96e38e-4e8b-47cf-afc1-ea7278bf8883","Type":"ContainerStarted","Data":"5fa744f51d367f271373db4459cf3f0cc17447e9f36ca5ac9e2c368740dc841b"}
Sep 12 01:14:15.348143 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:15.348113    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fp67s/must-gather-zzrsk" event={"ID":"cf96e38e-4e8b-47cf-afc1-ea7278bf8883","Type":"ContainerStarted","Data":"0604c70e280267a8478c315ab0979b4a1ac5cb9bee53edc38edbb3cd0d9e097c"}
Sep 12 01:14:15.348630 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:15.348155    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fp67s/must-gather-zzrsk" event={"ID":"cf96e38e-4e8b-47cf-afc1-ea7278bf8883","Type":"ContainerStarted","Data":"7d82b4f050244d5e51087f1e9104f6f239868d891d4c127ca2b2b78f34a380c8"}
Sep 12 01:14:15.373815 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:15.373720    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fp67s/must-gather-zzrsk" podStartSLOduration=2.5827846340000002 podStartE2EDuration="3.373700321s" totalImagesPullingTime="790.915687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:14:15.368684681 +0000 UTC m=+2708.419270290" watchObservedRunningTime="2026-09-12 01:14:15.373700321 +0000 UTC m=+2708.424285929"
Sep 12 01:14:16.222200 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:16.222170    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dnht5_ca0297dd-65be-4b61-a9b0-00440e3b3c7e/global-pull-secret-syncer/0.log"
Sep 12 01:14:16.361645 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:16.361603    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xx6lg_b7c4bb38-69e6-4a6d-ae60-4ed1006a88d7/konnectivity-agent/0.log"
Sep 12 01:14:16.495997 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:16.495915    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-144.ec2.internal_a47f42f55d416d8df95854740c396787/haproxy/0.log"
Sep 12 01:14:21.450383 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:21.450345    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-f56zl_bba4be01-d6af-462a-af2e-eee16272f073/manager/0.log"
Sep 12 01:14:21.488181 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:21.488147    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dwpk4_5f1c59bb-3b03-4302-8e7f-864bc0b679e0/manager/0.log"
Sep 12 01:14:21.572184 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:21.572140    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-pcwbf_8323c00d-e5c1-4542-97a6-aed2bb70442b/manager/0.log"
Sep 12 01:14:21.612644 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:21.612611    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xxslp_5c77c24a-ee36-4816-861b-8deaa0d10f60/limitador/0.log"
Sep 12 01:14:23.371741 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.371661    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/alertmanager/0.log"
Sep 12 01:14:23.422927 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.422891    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/config-reloader/0.log"
Sep 12 01:14:23.459544 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.459494    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/kube-rbac-proxy-web/0.log"
Sep 12 01:14:23.483150 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.483097    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/kube-rbac-proxy/0.log"
Sep 12 01:14:23.513804 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.513777    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/kube-rbac-proxy-metric/0.log"
Sep 12 01:14:23.543650 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.543624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/prom-label-proxy/0.log"
Sep 12 01:14:23.574893 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.574828    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dbfea1e-e944-4f8f-ac64-0eb1f0867866/init-config-reloader/0.log"
Sep 12 01:14:23.655465 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.655381    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-w9x96_4086172f-a0c3-4b51-a235-1d849583afe4/cluster-monitoring-operator/0.log"
Sep 12 01:14:23.705082 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.705054    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wfhsv_5783b4cc-d9c2-46f0-a0f5-ca1870fc811e/kube-state-metrics/0.log"
Sep 12 01:14:23.745396 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.745370    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wfhsv_5783b4cc-d9c2-46f0-a0f5-ca1870fc811e/kube-rbac-proxy-main/0.log"
Sep 12 01:14:23.778787 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.778732    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wfhsv_5783b4cc-d9c2-46f0-a0f5-ca1870fc811e/kube-rbac-proxy-self/0.log"
Sep 12 01:14:23.861320 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:23.861278    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-4thj7_24b69f9f-5f94-4849-bbbc-932ad1197272/monitoring-plugin/0.log"
Sep 12 01:14:24.519098 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.518548    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xchll_1936775f-3d01-41b2-a888-ffeff3f631f2/node-exporter/0.log"
Sep 12 01:14:24.542144 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.542119    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xchll_1936775f-3d01-41b2-a888-ffeff3f631f2/kube-rbac-proxy/0.log"
Sep 12 01:14:24.565107 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.565080    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xchll_1936775f-3d01-41b2-a888-ffeff3f631f2/init-textfile/0.log"
Sep 12 01:14:24.606651 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.606626    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tz7vx_0a960586-0337-4040-b0df-80e6d69136f1/kube-rbac-proxy-main/0.log"
Sep 12 01:14:24.635384 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.635354    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tz7vx_0a960586-0337-4040-b0df-80e6d69136f1/kube-rbac-proxy-self/0.log"
Sep 12 01:14:24.663646 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.663602    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tz7vx_0a960586-0337-4040-b0df-80e6d69136f1/openshift-state-metrics/0.log"
Sep 12 01:14:24.989883 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:24.989850    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f766b69f7-s5xcx_af26812a-4a14-4df0-a0bc-80a50368bdd3/telemeter-client/0.log"
Sep 12 01:14:25.013306 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:25.013193    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f766b69f7-s5xcx_af26812a-4a14-4df0-a0bc-80a50368bdd3/reload/0.log"
Sep 12 01:14:25.035608 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:25.035522    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f766b69f7-s5xcx_af26812a-4a14-4df0-a0bc-80a50368bdd3/kube-rbac-proxy/0.log"
Sep 12 01:14:26.099864 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.099826    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"]
Sep 12 01:14:26.105324 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.105298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.125889 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.125859    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"]
Sep 12 01:14:26.201869 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.201827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-proc\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.202063 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.201886    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-lib-modules\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.202063 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.201971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-podres\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.202063 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.202024    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9q69\" (UniqueName: \"kubernetes.io/projected/2356f295-005f-4b66-9f7d-ebd377aa961b-kube-api-access-l9q69\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.202237 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.202102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-sys\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.303341 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303299    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-proc\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.303613 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303594    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-lib-modules\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.303779 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-podres\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.303943 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303928    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9q69\" (UniqueName: \"kubernetes.io/projected/2356f295-005f-4b66-9f7d-ebd377aa961b-kube-api-access-l9q69\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.304094 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.304080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-sys\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.304269 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-proc\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.304367 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.304341    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-sys\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.304541 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303836    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-podres\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.304652 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.303747    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2356f295-005f-4b66-9f7d-ebd377aa961b-lib-modules\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.318019 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.317969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9q69\" (UniqueName: \"kubernetes.io/projected/2356f295-005f-4b66-9f7d-ebd377aa961b-kube-api-access-l9q69\") pod \"perf-node-gather-daemonset-kktrd\" (UID: \"2356f295-005f-4b66-9f7d-ebd377aa961b\") " pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.420442 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.420416    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:26.625696 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.625667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-58gb8_c6d612af-d795-4448-857d-b3e4701fa822/networking-console-plugin/0.log"
Sep 12 01:14:26.741597 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:26.741513    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"]
Sep 12 01:14:27.476799 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:27.476733    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd" event={"ID":"2356f295-005f-4b66-9f7d-ebd377aa961b","Type":"ContainerStarted","Data":"28a4ee68d48ff5b7d58eb95450399ea68c36fb223e573ad640e034046a8abc8d"}
Sep 12 01:14:27.477356 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:27.477321    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd" event={"ID":"2356f295-005f-4b66-9f7d-ebd377aa961b","Type":"ContainerStarted","Data":"0f46029b7a90a4b6df0009ae9886693bb1d0f89e71d1dbd26e62b25b4aee14e2"}
Sep 12 01:14:27.477727 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:27.477681    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:27.504491 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:27.504433    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd" podStartSLOduration=1.5044122789999999 podStartE2EDuration="1.504412279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 01:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:14:27.500956725 +0000 UTC m=+2720.551542336" watchObservedRunningTime="2026-09-12 01:14:27.504412279 +0000 UTC m=+2720.554997887"
Sep 12 01:14:27.982595 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:27.982568    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79cd88dfc4-nq5sp_2436ccbc-9d10-4405-a642-0e44875de69f/console/0.log"
Sep 12 01:14:28.713268 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:28.713241    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-t9fxl_fa33384c-a120-4b9c-9070-d1651f399f38/volume-data-source-validator/0.log"
Sep 12 01:14:29.976403 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:29.976377    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fpfxg_302a6863-e7f2-402f-bc90-b760c2a65e64/dns/0.log"
Sep 12 01:14:29.998704 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:29.998677    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fpfxg_302a6863-e7f2-402f-bc90-b760c2a65e64/kube-rbac-proxy/0.log"
Sep 12 01:14:30.143661 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:30.143634    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxhkp_908b6f7e-9883-454c-bebc-b886a46c0390/dns-node-resolver/0.log"
Sep 12 01:14:30.898814 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:30.898787    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhh8h_a56f9274-d259-4961-98bc-cd25c221822c/node-ca/0.log"
Sep 12 01:14:32.405865 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:32.405836    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c7zdh_244d3419-40a0-47da-b086-f85d45d8c026/discovery/0.log"
Sep 12 01:14:32.572352 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:32.572317    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797549bd89-twhcg_4eb0fa34-10a4-42d6-b521-43d731755f22/kube-auth-proxy/0.log"
Sep 12 01:14:32.744406 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:32.744370    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"
Sep 12 01:14:33.495988 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:33.495952    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fp67s/perf-node-gather-daemonset-kktrd"
Sep 12 01:14:33.804045 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:33.803973    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vhjf_107cd56e-3c34-48ba-a37b-354d080ad04a/serve-healthcheck-canary/0.log"
Sep 12 01:14:34.670635 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:34.670599    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r44pq_d0a24344-9f40-4b7a-a3cc-56bae20bf25b/kube-rbac-proxy/0.log"
Sep 12 01:14:34.736434 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:34.736408    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r44pq_d0a24344-9f40-4b7a-a3cc-56bae20bf25b/exporter/0.log"
Sep 12 01:14:34.784288 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:34.784262    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r44pq_d0a24344-9f40-4b7a-a3cc-56bae20bf25b/extractor/0.log"
Sep 12 01:14:37.487414 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:37.487380    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c7zdh_244d3419-40a0-47da-b086-f85d45d8c026/discovery/0.log"
Sep 12 01:14:37.529881 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:37.529848    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797549bd89-twhcg_4eb0fa34-10a4-42d6-b521-43d731755f22/kube-auth-proxy/0.log"
Sep 12 01:14:37.633328 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:37.633294    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"
Sep 12 01:14:38.041432 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:38.041391    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fn2n7_b2f52dcd-819b-4ae3-8b4c-b91aaa9e96fc/manager/0.log"
Sep 12 01:14:38.451975 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:38.451935    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67b7744c54-knqn7_734fe9de-dd3a-49fe-8470-2af0d0e60371/manager/0.log"
Sep 12 01:14:38.470582 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:38.470552    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67b7744c54-knqn7_734fe9de-dd3a-49fe-8470-2af0d0e60371/copy-manifests/0.log"
Sep 12 01:14:39.759647 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:39.759600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c7zdh_244d3419-40a0-47da-b086-f85d45d8c026/discovery/0.log"
Sep 12 01:14:39.861218 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:39.861115    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797549bd89-twhcg_4eb0fa34-10a4-42d6-b521-43d731755f22/kube-auth-proxy/0.log"
Sep 12 01:14:39.969568 ip-10-0-131-144 kubenswrapper[2556]: I0912 01:14:39.969541    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-p4mlv_5691c147-e9ef-4611-ad61-f70a23b92017/payload-processing/0.log"