Sep 11 18:08:22.077131 ip-10-0-131-186 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 18:08:22.077140 ip-10-0-131-186 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 18:08:22.077147 ip-10-0-131-186 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 18:08:22.077283 ip-10-0-131-186 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 18:08:32.278549 ip-10-0-131-186 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 18:08:32.278566 ip-10-0-131-186 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f26d5289c5b347699ec6695de302c901 --
Sep 11 18:10:22.468104 ip-10-0-131-186 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 18:10:22.850249 ip-10-0-131-186 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:10:22.850249 ip-10-0-131-186 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 18:10:22.850249 ip-10-0-131-186 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:10:22.850249 ip-10-0-131-186 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 18:10:22.850249 ip-10-0-131-186 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:10:22.851097 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.851014    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 18:10:22.855747 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855730    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.855747 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855747    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855752    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855755    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855759    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855762    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855765    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855768    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855771    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855774    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855777    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855780    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855782    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855796    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855799    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855802    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855805    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855808    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855810    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855821    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.855837 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855825    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855829    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855833    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855835    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855838    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855841    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855845    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855847    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855850    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855853    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855857    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855859    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855862    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855865    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855867    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855870    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855873    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855875    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855879    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855881    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.856320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855884    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855887    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855891    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855893    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855895    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855898    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855900    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855903    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855905    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855908    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855910    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855913    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855915    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855917    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855920    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855923    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855925    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855927    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855930    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855932    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.856800 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855935    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855937    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855939    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855942    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855944    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855946    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855949    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855951    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855954    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855956    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855958    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855961    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855963    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855966    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855968    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855972    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855974    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855976    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855979    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855981    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.857283 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855985    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855987    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855990    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855993    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855995    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.855997    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856000    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856003    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856006    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856008    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856011    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856014    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856018    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856021    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856023    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856026    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856028    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856031    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856033    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.857753 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856710    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856716    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856719    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856722    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856724    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856727    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856730    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856733    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856735    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856738    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856741    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856743    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856746    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856749    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856752    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856755    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856758    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856760    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856762    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.858205 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856766    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856768    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856771    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856773    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856776    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856778    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856781    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856798    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856801    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856804    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856806    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856809    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856812    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856816    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856820    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856822    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856825    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856828    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856831    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.858706 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856834    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856837    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856840    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856843    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856845    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856848    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856850    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856853    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856855    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856858    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856860    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856863    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856865    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856868    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856871    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856873    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856876    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856878    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856881    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856883    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.859189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856886    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856890    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856894    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856897    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856900    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856903    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856905    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856908    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856910    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856913    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856916    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856918    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856921    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856925    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856927    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856930    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856932    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856935    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856937    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856940    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.859684 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856942    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856945    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856949    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856952    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856954    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856957    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856960    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856963    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856965    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856968    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856970    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856973    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856975    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856978    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856980    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856983    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856986    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856989    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856991    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856993    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.860195 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.856996    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857361    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857366    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857369    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857372    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857376    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857379    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857381    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857384    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857387    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857390    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857392    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857395    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857398    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857400    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857403    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857405    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857408    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857411    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857414    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.860676 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857416    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857419    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857423    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857427    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857430    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857432    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857435    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857437    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857440    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857442    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857444    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857447    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857450    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857452    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857455    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857458    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857461    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857463    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857466    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.861174 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857469    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857471    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857474    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857476    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857479    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857481    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857484    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857486    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857488    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857491    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857494    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857497    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857499    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857502    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857504    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857506    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857509    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857512    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857514    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857516    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.861630 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857519    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857521    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857524    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857526    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857528    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857531    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857534    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857536    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857539    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857543    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857546    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857549    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857552    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857554    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857556    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857559    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857561    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857563    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857566    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.862101 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857569    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857572    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857575    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857580    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857582    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857585    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857587    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857590    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857592    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857595    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857597    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857600    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857602    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857605    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857607    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857610    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857612    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857616    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857618    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857620    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.862560 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857623    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.857625    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857698    2566 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857740    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857747    2566 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857751    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857756    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857759    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857763    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857768    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857771    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857774    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857777    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857780    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857797    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857802    2566 flags.go:64] FLAG: --cgroup-root=""
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857805    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857808    2566 flags.go:64] FLAG: --client-ca-file=""
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857811    2566 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857814    2566 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857818    2566 flags.go:64] FLAG: --cluster-domain=""
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857821    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857825    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857828    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 18:10:22.863033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857831    2566 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857835    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857838    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857843    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857846    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857850    2566 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857853    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857856    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857859    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857861    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857865    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857868    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857871    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857874    2566 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857877    2566 flags.go:64] FLAG: --enable-server="true"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857880    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857884    2566 flags.go:64] FLAG: --event-burst="100"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857887    2566 flags.go:64] FLAG: --event-qps="50"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857890    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857893    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857896    2566 flags.go:64] FLAG: --eviction-hard=""
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857900    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857903    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857907    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857910    2566 flags.go:64] FLAG: --eviction-soft=""
Sep 11 18:10:22.863609 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857913    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857916    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857919    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857922    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857924    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857928    2566 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857931    2566 flags.go:64] FLAG: --feature-gates=""
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857935    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857938    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857941    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857945    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857948    2566 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857951    2566 flags.go:64] FLAG: --help="false"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857954    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-131-186.ec2.internal"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857957    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857960    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857963    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857966    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857969    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857972    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857974    2566 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857977    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857980    2566 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 18:10:22.864251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857983    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857986    2566 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857989    2566 flags.go:64] FLAG: --kube-reserved=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857992    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857995    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.857998    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858000    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858004    2566 flags.go:64] FLAG: --lock-file=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858007    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858010    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858013    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858018    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858021    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858024    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858026    2566 flags.go:64] FLAG: --logging-format="text"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858029    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858032    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858035    2566 flags.go:64] FLAG: --manifest-url=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858038    2566 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858043    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858046    2566 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858050    2566 flags.go:64] FLAG: --max-pods="110"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858052    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858055    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858058    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 18:10:22.864919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858061    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858064    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858066    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858069    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858077    2566 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858079    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858082    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858085    2566 flags.go:64] FLAG: --pod-cidr=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858088    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858094    2566 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858097    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858100    2566 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858102    2566 flags.go:64] FLAG: --port="10250"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858105    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858108    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060978bcb560de451"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858112    2566 flags.go:64] FLAG: --qos-reserved=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858115    2566 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858118    2566 flags.go:64] FLAG: --register-node="true"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858121    2566 flags.go:64] FLAG: --register-with-taints=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858125    2566 flags.go:64] FLAG: --registry-burst="10"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858128    2566 flags.go:64] FLAG: --registry-qps="5"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858130    2566 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858133    2566 flags.go:64] FLAG: --reserved-memory=""
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858139    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858142    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 18:10:22.865531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858145    2566 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858150    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858153    2566 flags.go:64] FLAG: --runonce="false"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858156    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858159    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858162    2566 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858165    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858168    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858171    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858174    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858177    2566 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858179    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858182    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858185    2566 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858188    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858191    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858194    2566 flags.go:64] FLAG: --system-cgroups=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858197    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858202    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858204    2566 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858207    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858212    2566 flags.go:64] FLAG: --tls-min-version=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858216    2566 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858219    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858222    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 18:10:22.866161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858225    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858228    2566 flags.go:64] FLAG: --v="2"
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858232    2566 flags.go:64] FLAG: --version="false"
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858236    2566 flags.go:64] FLAG: --vmodule=""
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858239    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.858242    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858354    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858357    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858362    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858365    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858369    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858373    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858376    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858378    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858381    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858383    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858386    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858389    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858391    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858394    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858396    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.866763 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858399    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858402    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858404    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858407    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858410    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858412    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858415    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858417    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858423    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858425    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858428    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858430    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858433    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858435    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858438    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858441    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858443    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858445    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858448    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858452    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.867284 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858454    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858458    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858462    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858465    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858468    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858470    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858473    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858476    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858478    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858481    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858483    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858486    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858489    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858491    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858494    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858496    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858499    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858502    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858504    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.868021 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858506    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858510    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858513    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858515    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858517    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858520    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858523    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858525    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858528    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858530    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858533    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858535    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858539    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858541    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858544    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858546    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858548    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858551    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858553    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.868699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858557    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858560    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858563    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858566    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858569    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858572    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858574    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858577    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858579    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858582    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858584    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858587    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858589    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858592    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858596    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858598    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858601    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858603    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858606    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858608    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.869193 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858611    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858613    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858616    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858618    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858621    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.858624    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.859271    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.866908    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.866926    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.866940    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.866946    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867001    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867006    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867009    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.869675 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867013    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867016    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867019    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867022    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867025    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867027    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867032    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867036    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867039    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867042    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867046    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867048    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867051    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867054    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867056    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867059    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867062    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867065    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867067    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.870044 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867070    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867074    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867077    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867080    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867082    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867085    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867087    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867095    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867098    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867101    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867103    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867106    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867109    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867111    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867114    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867116    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867119    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867121    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867124    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.870488 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867126    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867129    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867132    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867134    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867136    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867139    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867142    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867144    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867147    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867149    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867152    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867155    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867157    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867160    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867162    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867164    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867167    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867169    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867172    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867174    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.870967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867178    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867181    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867185    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867188    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867190    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867193    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867195    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867198    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867200    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867202    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867205    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867207    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867210    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867212    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867215    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867218    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867220    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867222    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867225    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867228    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.871476 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867230    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867233    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867235    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867238    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867240    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867243    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867246    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867248    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867251    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867254    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867256    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867259    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867262    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867265    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867268    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867270    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867273    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.871978 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867276    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.867282    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867663    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867677    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867682    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867686    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867691    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867696    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867700    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867704    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867709    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867713    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867717    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867722    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:10:22.872374 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867732    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867735    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867741    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867747    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867752    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867756    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867760    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867764    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867768    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867773    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867777    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867781    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867804    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867809    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867814    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867819    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867823    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867828    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867833    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:10:22.872717 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867837    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867841    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867845    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867849    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867853    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867857    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867866    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867870    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867874    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867878    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867883    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867887    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867891    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867897    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867903    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867908    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867912    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867916    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867926    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:10:22.873179 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867930    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867935    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867939    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867943    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867947    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867951    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867955    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867959    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867963    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867968    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867972    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867982    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867987    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867991    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867995    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.867999    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868003    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868007    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868012    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868016    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:10:22.873622 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868021    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868025    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868029    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868034    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868042    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868046    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868051    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868055    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868059    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868063    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868068    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868071    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868076    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868080    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868086    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868092    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868102    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868111    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868116    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868123    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:10:22.874186 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868128    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868132    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868138    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868142    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868150    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868154    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868160    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868165    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:22.868170    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.868183    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.868500    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.870857    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.871746    2566 server.go:1019] "Starting client certificate rotation"
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.871844    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:10:22.874650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.871871    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:10:22.875001 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.873938    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:10:22.875105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.875088    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:10:22.884183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.884165    2566 log.go:25] "Validated CRI v1 runtime API"
Sep 11 18:10:22.886992 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.886979    2566 log.go:25] "Validated CRI v1 image API"
Sep 11 18:10:22.887692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.887679    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 18:10:22.889855 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.889829    2566 fs.go:135] Filesystem UUIDs: map[06f4545c-67a4-41b8-90d8-3e35a303dcbf:/dev/nvme0n1p3 4ee0bc41-86fb-483d-9767-c118f8c7cbe0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 11 18:10:22.889912 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.889855    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 18:10:22.895852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.895713    2566 manager.go:216] Machine: {Timestamp:2026-09-11 18:10:22.894418179 +0000 UTC m=+0.315192573 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200165 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23cbfa0303aca0e235a85e198f4aa1 SystemUUID:ec23cbfa-0303-aca0-e235-a85e198f4aa1 BootID:f26d5289-c5b3-4769-9ec6-695de302c901 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:74:d4:cd:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:74:d4:cd:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:b9:0a:0d:fa:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 18:10:22.895852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.895845    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 18:10:22.895974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.895934    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 18:10:22.899153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.899128    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 18:10:22.899302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.899157    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 18:10:22.900760 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.900749    2566 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 18:10:22.900820 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.900762    2566 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 18:10:22.900820 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.900771    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:10:22.901500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.901489    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:10:22.903118 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.903107    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 18:10:22.907383 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907370    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:10:22.907511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907502    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 18:10:22.907544 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907530    2566 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 18:10:22.907544 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907543    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 18:10:22.907620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907562    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 18:10:22.907620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907571    2566 kubelet.go:398] "Adding apiserver pod source"
Sep 11 18:10:22.907620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907579    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 18:10:22.907839 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.907821    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:10:22.908198 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.908184    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:10:22.908255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.908204    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:10:22.911865 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.911847    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 18:10:22.914429 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.914417    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 18:10:22.914481 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.914446    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 18:10:22.916039 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916027    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 18:10:22.916073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916048    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 18:10:22.916073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916057    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 18:10:22.916073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916065    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916078    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916086    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916105    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916113    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916122    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916129    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916141    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 18:10:22.916151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916151    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 18:10:22.916903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916891    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 18:10:22.916940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.916907    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 18:10:22.919385 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.919343    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 18:10:22.919426 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.919380    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 18:10:22.920726 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.920713    2566 server.go:1268] "Started kubelet"
Sep 11 18:10:22.920866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.920838    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 18:10:22.920866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.920800    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 18:10:22.920968 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.920897    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 18:10:22.921642 ip-10-0-131-186 systemd[1]: Started Kubernetes Kubelet.
Sep 11 18:10:22.922870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.922843    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 18:10:22.925836 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.925724    2566 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 18:10:22.925836 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.925740    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 18:10:22.929216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.929196    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 18:10:22.929594 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.929575    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 18:10:22.929683 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.929665    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:22.930230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930210    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 18:10:22.930230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930230    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 18:10:22.930373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930213    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 18:10:22.930373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930363    2566 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 18:10:22.930373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930373    2566 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 18:10:22.930696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930684    2566 factory.go:55] Registering systemd factory
Sep 11 18:10:22.930696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930698    2566 factory.go:223] Registration of the systemd container factory successfully
Sep 11 18:10:22.930940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930926    2566 factory.go:153] Registering CRI-O factory
Sep 11 18:10:22.930983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930947    2566 factory.go:223] Registration of the crio container factory successfully
Sep 11 18:10:22.931013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.930997    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 18:10:22.931042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.931019    2566 factory.go:103] Registering Raw factory
Sep 11 18:10:22.931042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.931035    2566 manager.go:1196] Started watching for new ooms in manager
Sep 11 18:10:22.931423 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.931407    2566 manager.go:349] Starting recovery of all containers
Sep 11 18:10:22.939332 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.939181    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 18:10:22.939332 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.939197    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 18:10:22.939486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.939427    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 18:10:22.940220 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.939240    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-186.ec2.internal.18d456a5feff90ee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-186.ec2.internal,UID:ip-10-0-131-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-186.ec2.internal,},FirstTimestamp:2026-09-11 18:10:22.920683758 +0000 UTC m=+0.341458151,LastTimestamp:2026-09-11 18:10:22.920683758 +0000 UTC m=+0.341458151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-186.ec2.internal,}"
Sep 11 18:10:22.943998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.943973    2566 manager.go:354] Recovery completed
Sep 11 18:10:22.945562 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.945544    2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 18:10:22.949038 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.949022    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:22.950622 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.950590    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86z6z"
Sep 11 18:10:22.950943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.950925    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:22.951027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.950956    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:22.951027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.950965    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:22.951573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.951553    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 18:10:22.951573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.951571    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 18:10:22.951725 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.951581    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:22.951725 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.951590    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:10:22.952250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.952232    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:22.952323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.952267    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:22.952323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.952286    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:22.953000 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.952923    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-186.ec2.internal.18d456a600cd468b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-186.ec2.internal,UID:ip-10-0-131-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-186.ec2.internal,},FirstTimestamp:2026-09-11 18:10:22.950942347 +0000 UTC m=+0.371716740,LastTimestamp:2026-09-11 18:10:22.950942347 +0000 UTC m=+0.371716740,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-186.ec2.internal,}"
Sep 11 18:10:22.953392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.953375    2566 policy_none.go:49] "None policy: Start"
Sep 11 18:10:22.953392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.953394    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 18:10:22.953509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.953404    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 18:10:22.954467 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.954455    2566 policy_none.go:47] "Start"
Sep 11 18:10:22.955945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.955929    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86z6z"
Sep 11 18:10:22.982381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.982365    2566 manager.go:337] "Starting Device Plugin manager"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.982416    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.982431    2566 server.go:87] "Starting device plugin registration server"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.982758    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.982768    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.982915    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.983065    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:22.983075    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.983547    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 18:10:22.998319 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:22.983598    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.052716 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.052678    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 18:10:23.053948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.053931    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 18:10:23.054057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.053988    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 18:10:23.054057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.054012    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 18:10:23.054150 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.054101    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 18:10:23.057023 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.057000    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:23.083852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.083825    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:23.085689 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.085674    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:23.085771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.085703    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:23.085771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.085721    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:23.085771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.085742    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.095800 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.095763    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.095800 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.095802    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-186.ec2.internal\": node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.121818 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.121732    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.154369 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.154342    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"]
Sep 11 18:10:23.154504 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.154408    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:23.155459 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.155441    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:23.155527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.155478    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:23.155527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.155490    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:23.157847 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.157835    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:23.157964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.157949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.158000 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.157980    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:23.158643 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158625    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:23.158745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158651    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:23.158745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158627    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:23.158745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158678    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:23.158745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158688    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:23.158745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.158660    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:23.160967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.160949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.161060 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.160977    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:10:23.162058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.162046    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:10:23.162124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.162068    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:10:23.162124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.162079    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:10:23.183382 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.183359    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-186.ec2.internal\" not found" node="ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.187656 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.187639    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-186.ec2.internal\" not found" node="ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.222044 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.222023    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.232420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.232396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.232518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.232428    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.232518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.232465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44737a15fc3a4f6f2edf4c5240f6b8ab-config\") pod \"kube-apiserver-proxy-ip-10-0-131-186.ec2.internal\" (UID: \"44737a15fc3a4f6f2edf4c5240f6b8ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.323121 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.323089    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.333540 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44737a15fc3a4f6f2edf4c5240f6b8ab-config\") pod \"kube-apiserver-proxy-ip-10-0-131-186.ec2.internal\" (UID: \"44737a15fc3a4f6f2edf4c5240f6b8ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.333621 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.333621 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333564    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.333621 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44737a15fc3a4f6f2edf4c5240f6b8ab-config\") pod \"kube-apiserver-proxy-ip-10-0-131-186.ec2.internal\" (UID: \"44737a15fc3a4f6f2edf4c5240f6b8ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.333711 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333619    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.333711 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.333601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843cd73d600d6cc7d5c22a27b6134fec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal\" (UID: \"843cd73d600d6cc7d5c22a27b6134fec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.423282 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.423200    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.486164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.486117    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.491749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.491727    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:23.524354 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.524320    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.627646 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.627600    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.727888 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.727774    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.776241 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.776214    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:23.831849 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.831815    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.873282 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.873254    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 18:10:23.873684 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.873395    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:10:23.873684 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.873426    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:10:23.933028 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:23.932979    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:23.958808 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.958767    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 18:05:23 +0000 UTC" deadline="2028-02-26 23:46:05.08208567 +0000 UTC"
Sep 11 18:10:23.958808 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:23.958813    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12797h35m41.123279106s"
Sep 11 18:10:24.033261 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:24.033237    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:24.133933 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:24.133896    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-186.ec2.internal\" not found"
Sep 11 18:10:24.168456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.168424    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:24.202209 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:24.202158    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44737a15fc3a4f6f2edf4c5240f6b8ab.slice/crio-dcb991fad60e6cdc9f7dc0a095f57dccb91a2059e21745196982453ce41f7ca4 WatchSource:0}: Error finding container dcb991fad60e6cdc9f7dc0a095f57dccb91a2059e21745196982453ce41f7ca4: Status 404 returned error can't find the container with id dcb991fad60e6cdc9f7dc0a095f57dccb91a2059e21745196982453ce41f7ca4
Sep 11 18:10:24.202506 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:24.202473    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843cd73d600d6cc7d5c22a27b6134fec.slice/crio-6900444216a3775084932537d1e5489682cf0e6b9c03fe1321ee28762b4bab77 WatchSource:0}: Error finding container 6900444216a3775084932537d1e5489682cf0e6b9c03fe1321ee28762b4bab77: Status 404 returned error can't find the container with id 6900444216a3775084932537d1e5489682cf0e6b9c03fe1321ee28762b4bab77
Sep 11 18:10:24.209391 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.209370    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:10:24.230804 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.230775    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:24.248351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.248329    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:10:24.250282 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.250265    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal"
Sep 11 18:10:24.261257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.261238    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:10:24.305505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.305427    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:24.910903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.910866    2566 apiserver.go:52] "Watching apiserver"
Sep 11 18:10:24.922407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.922378    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 18:10:24.922851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.922828    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9976f","openshift-network-operator/iptables-alerter-dz4w2","openshift-ovn-kubernetes/ovnkube-node-dkqhp","kube-system/global-pull-secret-syncer-k2nk7","kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8","openshift-image-registry/node-ca-8svnl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-q5f4t","openshift-network-diagnostics/network-check-target-tgthz","kube-system/konnectivity-agent-glzd4","openshift-cluster-node-tuning-operator/tuned-78qwt","openshift-dns/node-resolver-vmrk8","openshift-multus/multus-ghwdc"]
Sep 11 18:10:24.925486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.925463    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:24.927747 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.927720    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:24.930253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.930231    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.930994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.930971    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 18:10:24.932575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.932545    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:24.932682 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:24.932629    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:24.934460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.934070    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 18:10:24.934460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.934070    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.934460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.934345    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gbqvz\""
Sep 11 18:10:24.934610 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.934478    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.934987 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.934967    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:24.937367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.937345    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:24.939850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.939828    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:24.940539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.940519    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942212    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovn-node-metrics-cert\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee6e557e-06e1-4070-9103-d3f635df8d2f-agent-certs\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd093e6-fb9a-4a65-a98d-901dc9654778-host\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-log-socket\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942330    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-systemd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942372 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-bin\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-script-lib\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-dbus\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee6e557e-06e1-4070-9103-d3f635df8d2f-konnectivity-ca\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-ovn\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942498    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-kubelet-config\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpz58\" (UniqueName: \"kubernetes.io/projected/2dd093e6-fb9a-4a65-a98d-901dc9654778-kube-api-access-mpz58\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-netd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-env-overrides\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.942707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd093e6-fb9a-4a65-a98d-901dc9654778-serviceca\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txctx\" (UniqueName: \"kubernetes.io/projected/3137ec06-7b3a-4987-a7ac-7cce905a97b2-kube-api-access-txctx\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942777    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942783    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-kubelet\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-netns\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942880    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-etc-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942907    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-config\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-systemd-units\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942947    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.942973    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-slash\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.943000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-var-lib-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.943026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-node-log\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:24.943321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.943297    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 18:10:24.943936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.943670    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 18:10:24.944407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.944391    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 18:10:24.944860 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.944827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:24.946210 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.946191    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.947426 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.947398    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.947522 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.947475    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.948645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.947818    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7k9mq\""
Sep 11 18:10:24.948645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.947426    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 18:10:24.948645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.948385    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.948645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.947845    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:24.948645 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:24.948542    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.948994    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949105    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949346    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949469    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949480    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.949827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949763    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.950180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.949854    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.950180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.950088    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.950180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.950141    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bt7x\""
Sep 11 18:10:24.951443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.950677    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 18:10:24.951443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.951048    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fmtn9\""
Sep 11 18:10:24.951443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.951261    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mh8lm\""
Sep 11 18:10:24.951754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.951731    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nqxnw\""
Sep 11 18:10:24.951898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.951829    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w5vnr\""
Sep 11 18:10:24.951898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.951852    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 18:10:24.952063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.952041    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 18:10:24.952257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.952139    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zjdn5\""
Sep 11 18:10:24.952483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.952466    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:24.952585 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:24.952549    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:24.955604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.955581    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:24.956256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.956233    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:10:24.959328 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.959307    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:10:24.959424 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.959316    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 18:10:24.959695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.959673    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nbp5d\""
Sep 11 18:10:24.987267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:24.987240    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qllzm"
Sep 11 18:10:25.001265 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.001230    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qllzm"
Sep 11 18:10:25.032461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.032428    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 18:10:25.043831 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tsw\" (UniqueName: \"kubernetes.io/projected/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-kube-api-access-t5tsw\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-log-socket\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-script-lib\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-dbus\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee6e557e-06e1-4070-9103-d3f635df8d2f-konnectivity-ca\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-log-socket\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.043958    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-multus-daemon-config\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-dbus\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drg25\" (UniqueName: \"kubernetes.io/projected/c357a1d0-6518-449a-9122-f76af153fb12-kube-api-access-drg25\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ndc\" (UniqueName: \"kubernetes.io/projected/7c68290e-6a0d-42af-856a-a125def872d1-kube-api-access-v8ndc\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044138    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-lib-modules\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-hostroot\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044218    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-multus-certs\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044243    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-sys-fs\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044254    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce812a6a-26b1-441c-a1a5-b0b24bc51724-iptables-alerter-script\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-var-lib-kubelet\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044385    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpz58\" (UniqueName: \"kubernetes.io/projected/2dd093e6-fb9a-4a65-a98d-901dc9654778-kube-api-access-mpz58\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee6e557e-06e1-4070-9103-d3f635df8d2f-konnectivity-ca\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-cni-binary-copy\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044650    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-k8s-cni-cncf-io\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-etc-selinux\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb61546a-127f-4a22-b9de-e233a1307427-tmp-dir\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044738    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-modprobe-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-env-overrides\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-device-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txctx\" (UniqueName: \"kubernetes.io/projected/3137ec06-7b3a-4987-a7ac-7cce905a97b2-kube-api-access-txctx\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.044945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.044977    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-system-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-netns\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-cnibin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045086    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-systemd-units\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045129    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-systemd-units\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.045204    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.045309    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:25.545285911 +0000 UTC m=+2.966060312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:25.045456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045412    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-script-lib\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045467    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-run-netns\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045491    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-env-overrides\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045536    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovn-node-metrics-cert\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee6e557e-06e1-4070-9103-d3f635df8d2f-agent-certs\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-socket-dir-parent\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-conf\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-systemd\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-conf-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045693    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysconfig\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.045772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045760    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-systemd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-bin\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045826    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-ovn\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-kubelet-config\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-etc-kubernetes\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045951    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb61546a-127f-4a22-b9de-e233a1307427-hosts-file\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-sys\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.045998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cnibin\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046049    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2jz\" (UniqueName: \"kubernetes.io/projected/bb61546a-127f-4a22-b9de-e233a1307427-kube-api-access-7p2jz\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046104    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-tmp\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046128    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-netd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046196    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-kubelet\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046222    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-system-cni-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.046291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046257    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046325    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-systemd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd093e6-fb9a-4a65-a98d-901dc9654778-serviceca\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046374    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-kubelet-config\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046417    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-netd\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-netns\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-cni-bin\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046468    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-run-ovn\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046499    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-tuned\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-kubelet\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-etc-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-config\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046690    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-bin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd093e6-fb9a-4a65-a98d-901dc9654778-serviceca\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.047134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-registration-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbtm\" (UniqueName: \"kubernetes.io/projected/52b21de6-5da9-4f93-8af2-fe5ca293f836-kube-api-access-hdbtm\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046807    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-slash\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-var-lib-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046912    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-node-log\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-socket-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.046968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce812a6a-26b1-441c-a1a5-b0b24bc51724-host-slash\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-286xp\" (UniqueName: \"kubernetes.io/projected/ce812a6a-26b1-441c-a1a5-b0b24bc51724-kube-api-access-286xp\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047247    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd093e6-fb9a-4a65-a98d-901dc9654778-host\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-multus\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-kubelet\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-host-slash\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047344    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-kubernetes\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047370    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-var-lib-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047211    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovnkube-config\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd093e6-fb9a-4a65-a98d-901dc9654778-host\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047432    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-run\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-host\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047476    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-etc-openvswitch\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047492    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbwv\" (UniqueName: \"kubernetes.io/projected/3a05722f-67eb-4849-8fd0-78e71bc34f97-kube-api-access-kfbwv\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.048753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.047519    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3137ec06-7b3a-4987-a7ac-7cce905a97b2-node-log\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.051984 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.051951    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3137ec06-7b3a-4987-a7ac-7cce905a97b2-ovn-node-metrics-cert\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.052240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.052220    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee6e557e-06e1-4070-9103-d3f635df8d2f-agent-certs\") pod \"konnectivity-agent-glzd4\" (UID: \"ee6e557e-06e1-4070-9103-d3f635df8d2f\") " pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:25.061579 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.061524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal" event={"ID":"44737a15fc3a4f6f2edf4c5240f6b8ab","Type":"ContainerStarted","Data":"dcb991fad60e6cdc9f7dc0a095f57dccb91a2059e21745196982453ce41f7ca4"}
Sep 11 18:10:25.063848 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.063756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal" event={"ID":"843cd73d600d6cc7d5c22a27b6134fec","Type":"ContainerStarted","Data":"6900444216a3775084932537d1e5489682cf0e6b9c03fe1321ee28762b4bab77"}
Sep 11 18:10:25.067235 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.067161    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txctx\" (UniqueName: \"kubernetes.io/projected/3137ec06-7b3a-4987-a7ac-7cce905a97b2-kube-api-access-txctx\") pod \"ovnkube-node-dkqhp\" (UID: \"3137ec06-7b3a-4987-a7ac-7cce905a97b2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.068763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.068731    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpz58\" (UniqueName: \"kubernetes.io/projected/2dd093e6-fb9a-4a65-a98d-901dc9654778-kube-api-access-mpz58\") pod \"node-ca-8svnl\" (UID: \"2dd093e6-fb9a-4a65-a98d-901dc9654778\") " pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.133450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.133406    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:25.147801 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147747    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-socket-dir-parent\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147810    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-conf\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147838    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-systemd\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-conf-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysconfig\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147891    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-socket-dir-parent\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147951    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.147982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.147978    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-etc-kubernetes\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb61546a-127f-4a22-b9de-e233a1307427-hosts-file\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148034    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-sys\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cnibin\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148101    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-conf-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148116    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb61546a-127f-4a22-b9de-e233a1307427-hosts-file\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148005    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-conf\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-etc-kubernetes\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148178    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-sys\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-systemd\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148245    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cnibin\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2jz\" (UniqueName: \"kubernetes.io/projected/bb61546a-127f-4a22-b9de-e233a1307427-kube-api-access-7p2jz\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148281    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-tmp\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148305    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-kubelet\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-system-cni-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148427    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysconfig\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148437    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-multus-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148485    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-kubelet\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148509    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-system-cni-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148566    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-netns\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148621    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-tuned\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148648    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-bin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148701    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-registration-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148727    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbtm\" (UniqueName: \"kubernetes.io/projected/52b21de6-5da9-4f93-8af2-fe5ca293f836-kube-api-access-hdbtm\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.148817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148772    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-bin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-socket-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148824    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-registration-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce812a6a-26b1-441c-a1a5-b0b24bc51724-host-slash\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce812a6a-26b1-441c-a1a5-b0b24bc51724-host-slash\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-286xp\" (UniqueName: \"kubernetes.io/projected/ce812a6a-26b1-441c-a1a5-b0b24bc51724-kube-api-access-286xp\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148925    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-sysctl-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.148965    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-netns\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-multus\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149070    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-kubernetes\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149088    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-var-lib-cni-multus\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149095    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-run\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-host\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.149780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-socket-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149137    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-host\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-run\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.149230    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149259    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-kubernetes\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbwv\" (UniqueName: \"kubernetes.io/projected/3a05722f-67eb-4849-8fd0-78e71bc34f97-kube-api-access-kfbwv\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.149286    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:25.649267632 +0000 UTC m=+3.070042030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tsw\" (UniqueName: \"kubernetes.io/projected/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-kube-api-access-t5tsw\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-multus-daemon-config\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drg25\" (UniqueName: \"kubernetes.io/projected/c357a1d0-6518-449a-9122-f76af153fb12-kube-api-access-drg25\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ndc\" (UniqueName: \"kubernetes.io/projected/7c68290e-6a0d-42af-856a-a125def872d1-kube-api-access-v8ndc\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-lib-modules\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149460    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-hostroot\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149484    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-multus-certs\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-sys-fs\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.150709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce812a6a-26b1-441c-a1a5-b0b24bc51724-iptables-alerter-script\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149570    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-var-lib-kubelet\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-multus-certs\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-lib-modules\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-hostroot\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149631    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-var-lib-kubelet\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-sys-fs\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-cni-binary-copy\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-k8s-cni-cncf-io\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-etc-selinux\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb61546a-127f-4a22-b9de-e233a1307427-tmp-dir\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-modprobe-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-host-run-k8s-cni-cncf-io\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-device-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149907    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-multus-daemon-config\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-system-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-cnibin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.149969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-etc-selinux\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.151566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-cnibin\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52b21de6-5da9-4f93-8af2-fe5ca293f836-device-dir\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c357a1d0-6518-449a-9122-f76af153fb12-system-cni-dir\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce812a6a-26b1-441c-a1a5-b0b24bc51724-iptables-alerter-script\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-modprobe-d\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.150308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb61546a-127f-4a22-b9de-e233a1307427-tmp-dir\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.151070    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c357a1d0-6518-449a-9122-f76af153fb12-cni-binary-copy\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.152479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.151784    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-etc-tuned\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.153113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.153085    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a05722f-67eb-4849-8fd0-78e71bc34f97-tmp\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.161216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.161151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2jz\" (UniqueName: \"kubernetes.io/projected/bb61546a-127f-4a22-b9de-e233a1307427-kube-api-access-7p2jz\") pod \"node-resolver-vmrk8\" (UID: \"bb61546a-127f-4a22-b9de-e233a1307427\") " pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.161604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.161573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbwv\" (UniqueName: \"kubernetes.io/projected/3a05722f-67eb-4849-8fd0-78e71bc34f97-kube-api-access-kfbwv\") pod \"tuned-78qwt\" (UID: \"3a05722f-67eb-4849-8fd0-78e71bc34f97\") " pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.163174 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.163127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drg25\" (UniqueName: \"kubernetes.io/projected/c357a1d0-6518-449a-9122-f76af153fb12-kube-api-access-drg25\") pod \"multus-ghwdc\" (UID: \"c357a1d0-6518-449a-9122-f76af153fb12\") " pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.163305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.163280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tsw\" (UniqueName: \"kubernetes.io/projected/a51e2dc1-3280-48a0-91c3-e8827fdbc3e0-kube-api-access-t5tsw\") pod \"multus-additional-cni-plugins-q5f4t\" (UID: \"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0\") " pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.164177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.164140    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-286xp\" (UniqueName: \"kubernetes.io/projected/ce812a6a-26b1-441c-a1a5-b0b24bc51724-kube-api-access-286xp\") pod \"iptables-alerter-dz4w2\" (UID: \"ce812a6a-26b1-441c-a1a5-b0b24bc51724\") " pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.165535 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.165513    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:25.165631 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.165541    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:25.165631 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.165555    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:25.165631 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.165619    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:25.665598896 +0000 UTC m=+3.086373294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:25.170173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.169937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ndc\" (UniqueName: \"kubernetes.io/projected/7c68290e-6a0d-42af-856a-a125def872d1-kube-api-access-v8ndc\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.170173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.170128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbtm\" (UniqueName: \"kubernetes.io/projected/52b21de6-5da9-4f93-8af2-fe5ca293f836-kube-api-access-hdbtm\") pod \"aws-ebs-csi-driver-node-pkzw8\" (UID: \"52b21de6-5da9-4f93-8af2-fe5ca293f836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.237222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.237179    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8svnl"
Sep 11 18:10:25.245782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.245756    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:25.259910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.259659    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:25.260116 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.259655    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6e557e_06e1_4070_9103_d3f635df8d2f.slice/crio-52aa0809b978e06231f597585bb70bb4f606805ea470558b52f0804d42a4d758 WatchSource:0}: Error finding container 52aa0809b978e06231f597585bb70bb4f606805ea470558b52f0804d42a4d758: Status 404 returned error can't find the container with id 52aa0809b978e06231f597585bb70bb4f606805ea470558b52f0804d42a4d758
Sep 11 18:10:25.264674 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.264653    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghwdc"
Sep 11 18:10:25.274276 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.274246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8"
Sep 11 18:10:25.278494 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.278461    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3137ec06_7b3a_4987_a7ac_7cce905a97b2.slice/crio-698345a7042246b860110bc7421ef5dcc741841ead686ddf2938f7907f69927d WatchSource:0}: Error finding container 698345a7042246b860110bc7421ef5dcc741841ead686ddf2938f7907f69927d: Status 404 returned error can't find the container with id 698345a7042246b860110bc7421ef5dcc741841ead686ddf2938f7907f69927d
Sep 11 18:10:25.281934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.281676    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q5f4t"
Sep 11 18:10:25.290273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.290245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmrk8"
Sep 11 18:10:25.290592 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.290569    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b21de6_5da9_4f93_8af2_fe5ca293f836.slice/crio-e4ce941455fd50e1866228eff87b6642b90ec728656d3917a34c2436d39b0871 WatchSource:0}: Error finding container e4ce941455fd50e1866228eff87b6642b90ec728656d3917a34c2436d39b0871: Status 404 returned error can't find the container with id e4ce941455fd50e1866228eff87b6642b90ec728656d3917a34c2436d39b0871
Sep 11 18:10:25.293846 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.293784    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51e2dc1_3280_48a0_91c3_e8827fdbc3e0.slice/crio-3cea40288aad9aa1d500d32c3fcda895f38a21b20807ae6c11730fa8ebac56c9 WatchSource:0}: Error finding container 3cea40288aad9aa1d500d32c3fcda895f38a21b20807ae6c11730fa8ebac56c9: Status 404 returned error can't find the container with id 3cea40288aad9aa1d500d32c3fcda895f38a21b20807ae6c11730fa8ebac56c9
Sep 11 18:10:25.298851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.298828    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dz4w2"
Sep 11 18:10:25.305226 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.304951    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-78qwt"
Sep 11 18:10:25.309550 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.309504    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce812a6a_26b1_441c_a1a5_b0b24bc51724.slice/crio-4559c88482e659a5d7ca6f87516e41e4168f5b48b4053793620f7232df6c5dde WatchSource:0}: Error finding container 4559c88482e659a5d7ca6f87516e41e4168f5b48b4053793620f7232df6c5dde: Status 404 returned error can't find the container with id 4559c88482e659a5d7ca6f87516e41e4168f5b48b4053793620f7232df6c5dde
Sep 11 18:10:25.316467 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:25.316414    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a05722f_67eb_4849_8fd0_78e71bc34f97.slice/crio-4c4bee281b6a619443443c77290ba804e87bdfec382d5d83efb5440a0410f1a4 WatchSource:0}: Error finding container 4c4bee281b6a619443443c77290ba804e87bdfec382d5d83efb5440a0410f1a4: Status 404 returned error can't find the container with id 4c4bee281b6a619443443c77290ba804e87bdfec382d5d83efb5440a0410f1a4
Sep 11 18:10:25.552933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.552832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:25.553088 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.552973    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:25.553088 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.553054    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:26.553033104 +0000 UTC m=+3.973807486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:25.590269 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.590237    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:10:25.653975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.653923    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:25.654182 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.654106    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:25.654249 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.654188    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:26.654164617 +0000 UTC m=+4.074939019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:25.754920 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:25.754885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:25.755111 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.755074    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:25.755111 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.755100    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:25.755111 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.755111    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:25.755230 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:25.755180    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:26.755158849 +0000 UTC m=+4.175933250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:26.005335 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.005207    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:05:25 +0000 UTC" deadline="2028-06-27 20:44:12.78884217 +0000 UTC"
Sep 11 18:10:26.005335 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.005275    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15722h33m46.783571461s"
Sep 11 18:10:26.055091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.055055    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:26.055275 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.055242    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:26.055697 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.055676    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:26.055803 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.055782    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:26.069159 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.069108    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8" event={"ID":"52b21de6-5da9-4f93-8af2-fe5ca293f836","Type":"ContainerStarted","Data":"e4ce941455fd50e1866228eff87b6642b90ec728656d3917a34c2436d39b0871"}
Sep 11 18:10:26.073012 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.072970    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"698345a7042246b860110bc7421ef5dcc741841ead686ddf2938f7907f69927d"}
Sep 11 18:10:26.075585 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.075554    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8svnl" event={"ID":"2dd093e6-fb9a-4a65-a98d-901dc9654778","Type":"ContainerStarted","Data":"69408b083039cfa0ca3f8ffdf3c4bcee451dacce733c092d5690510238d1865b"}
Sep 11 18:10:26.078616 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.078587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dz4w2" event={"ID":"ce812a6a-26b1-441c-a1a5-b0b24bc51724","Type":"ContainerStarted","Data":"4559c88482e659a5d7ca6f87516e41e4168f5b48b4053793620f7232df6c5dde"}
Sep 11 18:10:26.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.080840    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghwdc" event={"ID":"c357a1d0-6518-449a-9122-f76af153fb12","Type":"ContainerStarted","Data":"6ccb31ab27a6228b15f5fc660b457c1d1e24f2dcfd4702ce290c82b7e3fc6ca1"}
Sep 11 18:10:26.082859 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.082782    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glzd4" event={"ID":"ee6e557e-06e1-4070-9103-d3f635df8d2f","Type":"ContainerStarted","Data":"52aa0809b978e06231f597585bb70bb4f606805ea470558b52f0804d42a4d758"}
Sep 11 18:10:26.085522 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.085453    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-78qwt" event={"ID":"3a05722f-67eb-4849-8fd0-78e71bc34f97","Type":"ContainerStarted","Data":"4c4bee281b6a619443443c77290ba804e87bdfec382d5d83efb5440a0410f1a4"}
Sep 11 18:10:26.087995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.087926    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmrk8" event={"ID":"bb61546a-127f-4a22-b9de-e233a1307427","Type":"ContainerStarted","Data":"dd92cb018d6ee805ecf3c95c8b66e4b4928af330948b90da6e14ff3b2d2c97af"}
Sep 11 18:10:26.090274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.090193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerStarted","Data":"3cea40288aad9aa1d500d32c3fcda895f38a21b20807ae6c11730fa8ebac56c9"}
Sep 11 18:10:26.561918 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.561247    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:26.561918 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.561431    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:26.561918 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.561499    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:28.561479525 +0000 UTC m=+5.982253929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:26.662508 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.662468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:26.662694 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.662658    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:26.662785 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.662741    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:28.66271912 +0000 UTC m=+6.083493519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:26.763914 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:26.763873    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:26.764120 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.764058    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:26.764120 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.764082    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:26.764120 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.764095    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:26.764336 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:26.764160    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:28.76414184 +0000 UTC m=+6.184916241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:27.006001 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:27.005953    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:05:25 +0000 UTC" deadline="2028-05-02 20:11:01.340134803 +0000 UTC"
Sep 11 18:10:27.006001 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:27.005995    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14378h0m34.334143367s"
Sep 11 18:10:27.057280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:27.057249    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:27.057452 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:27.057400    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:28.055105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:28.054368    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:28.055105 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.054509    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:28.055105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:28.054954    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:28.055105 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.055053    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:28.582101 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:28.581384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:28.582101 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.581599    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:28.582101 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.581669    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:32.581649595 +0000 UTC m=+10.002423985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:28.683029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:28.682346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:28.683029 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.682560    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:28.683029 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.682628    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:32.682610145 +0000 UTC m=+10.103384530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:28.783943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:28.783263    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:28.783943 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.783475    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:28.783943 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.783498    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:28.783943 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.783512    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:28.783943 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:28.783569    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:32.783551264 +0000 UTC m=+10.204325653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:29.054716 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:29.054632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:29.054912 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:29.054814    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:30.055091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:30.054737    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:30.055091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:30.054758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:30.055091 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:30.054898    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:30.055091 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:30.054980    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:31.055278 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:31.055247    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:31.055733 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:31.055397    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:32.055162 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:32.054728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:32.055162 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:32.054761    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:32.055162 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.054856    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:32.055162 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.055007    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:32.616618 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:32.616049    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:32.616618 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.616199    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:32.616618 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.616267    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:40.61624791 +0000 UTC m=+18.037022294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:32.717094 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:32.716845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:32.717094 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.716995    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:32.717094 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.717060    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:40.717040157 +0000 UTC m=+18.137814539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:32.817952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:32.817912    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:32.818130 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.818097    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:32.818207 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.818152    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:32.818207 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.818166    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:32.818312 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:32.818229    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:40.818215796 +0000 UTC m=+18.238990181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:33.056110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:33.056040    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:33.056645 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:33.056154    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:34.054918 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:34.054883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:34.055103 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:34.054881    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:34.055103 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:34.055017    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:34.055103 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:34.055075    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:35.055247 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:35.055212    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:35.055694 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:35.055357    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:36.054503 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:36.054466    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:36.054668 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:36.054617    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:36.054715 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:36.054675    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:36.054822 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:36.054803    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:37.055265 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:37.055224    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:37.055720 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:37.055362    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:38.054661 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:38.054623    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:38.054661 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:38.054659    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:38.054892 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:38.054749    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:38.054892 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:38.054870    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:39.054903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:39.054879    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:39.055267 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:39.054982    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:40.054255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:40.054220    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:40.054255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:40.054245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:40.054523 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.054343    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:40.054523 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.054487    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:40.675674 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:40.675636    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:40.676215 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.675776    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:40.676215 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.675846    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:10:56.675831514 +0000 UTC m=+34.096605895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:40.776899 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:40.776865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:40.777071 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.777051    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:40.777152 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.777140    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:56.777120893 +0000 UTC m=+34.197895276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:40.877216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:40.877182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:40.877403 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.877383    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:40.877453 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.877407    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:40.877453 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.877417    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:40.877526 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:40.877466    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:10:56.877453474 +0000 UTC m=+34.298227855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:41.055318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:41.055236    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:41.055465 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:41.055373    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:42.055222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:42.055184    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:42.055686 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:42.055192    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:42.055686 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:42.055341    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:42.055686 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:42.055445    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:43.055268 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.055026    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:43.055829 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:43.055285    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:43.126111 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.126070    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghwdc" event={"ID":"c357a1d0-6518-449a-9122-f76af153fb12","Type":"ContainerStarted","Data":"7f19b9e4e3da41ce372feb62a2b2b3395483ac1b208f5db56024c782ff5c8911"}
Sep 11 18:10:43.128470 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.128444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal" event={"ID":"44737a15fc3a4f6f2edf4c5240f6b8ab","Type":"ContainerStarted","Data":"ca013f31b0cd877f796fafdbd3fad6d81c098ad6b536f043a69b1c0e56fdcd54"}
Sep 11 18:10:43.130027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.130005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-78qwt" event={"ID":"3a05722f-67eb-4849-8fd0-78e71bc34f97","Type":"ContainerStarted","Data":"5702a12f0ebd519be526f7af97269feba8fb10617879b2aa91580fc1d74d5847"}
Sep 11 18:10:43.145390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.145349    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ghwdc" podStartSLOduration=2.692848721 podStartE2EDuration="20.145337365s" totalImagesPullingTime="17.452488644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:43.145044793 +0000 UTC m=+20.565819205" watchObservedRunningTime="2026-09-11 18:10:43.145337365 +0000 UTC m=+20.566111767"
Sep 11 18:10:43.160934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.160894    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-186.ec2.internal" podStartSLOduration=19.160881084 podStartE2EDuration="19.160881084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:43.160708033 +0000 UTC m=+20.581482437" watchObservedRunningTime="2026-09-11 18:10:43.160881084 +0000 UTC m=+20.581655511"
Sep 11 18:10:43.188427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:43.188384    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-78qwt" podStartSLOduration=2.770898382 podStartE2EDuration="20.188368785s" totalImagesPullingTime="17.417470403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:43.188267945 +0000 UTC m=+20.609042349" watchObservedRunningTime="2026-09-11 18:10:43.188368785 +0000 UTC m=+20.609143188"
Sep 11 18:10:44.054935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.054745    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:44.055064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.054816    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:44.055064 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:44.055003    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:44.055142 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:44.055076    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:44.135003 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.134966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"259d4b0536006d26ff1c4df80bcb277290f487aa4f8a16a83aa57b1a9f2a5aa3"}
Sep 11 18:10:44.135653 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.135042    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"acfa1427090a8cfe26f86a544b2cf9fb9dd452fde31c04d77d5859a69a43259f"}
Sep 11 18:10:44.135653 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.135075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"c86adfcc196d6e3e713c035b5b66a558e51046f537e8e5c5bcbf5f7d3643202e"}
Sep 11 18:10:44.135653 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.135114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"3f274ed97a2400ad1a244fb783b2a6831ebc8a7766760d64c33a9b24d80d0e80"}
Sep 11 18:10:44.135653 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.135142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"2f6d9e9fbe407d1d0ca19b709a2547495607c440de053fdd197d7a4e11d13fd7"}
Sep 11 18:10:44.135653 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.135166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"a3d8c117c592b5b22a23645d65a8c393824fea238a84b4da439554109b542995"}
Sep 11 18:10:44.136292 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.136267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8svnl" event={"ID":"2dd093e6-fb9a-4a65-a98d-901dc9654778","Type":"ContainerStarted","Data":"6e8b27deb505a4eaef408fe7f9b98ae86d6bc2fa680f62a2421ff4a133645b38"}
Sep 11 18:10:44.137819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.137780    2566 generic.go:356] "Generic (PLEG): container finished" podID="843cd73d600d6cc7d5c22a27b6134fec" containerID="f034f1a007d5145c114c822afcac9a90a6a3c00651b6305dacd6fd28c06f11bf" exitCode=0
Sep 11 18:10:44.137927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.137871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal" event={"ID":"843cd73d600d6cc7d5c22a27b6134fec","Type":"ContainerDied","Data":"f034f1a007d5145c114c822afcac9a90a6a3c00651b6305dacd6fd28c06f11bf"}
Sep 11 18:10:44.139404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.139379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dz4w2" event={"ID":"ce812a6a-26b1-441c-a1a5-b0b24bc51724","Type":"ContainerStarted","Data":"fa8c84a3e69a567ae44cd9a98e90f28c617b9698569376c3dc1b7abbe981b503"}
Sep 11 18:10:44.140997 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.140975    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glzd4" event={"ID":"ee6e557e-06e1-4070-9103-d3f635df8d2f","Type":"ContainerStarted","Data":"cb1c51912e9741c723ff8a30134ea5abf15c842353ba63af71f872e5c15deb35"}
Sep 11 18:10:44.144485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.144468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmrk8" event={"ID":"bb61546a-127f-4a22-b9de-e233a1307427","Type":"ContainerStarted","Data":"38580f1fe917612e86143628ed1d747a442d23fa183815380e7b36320df601a6"}
Sep 11 18:10:44.145941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.145919    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="d1070997e6a2f234bfce3242fe4ef4a778ce8ddfce686a4fd9b35b6211734bcf" exitCode=0
Sep 11 18:10:44.146029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.145995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"d1070997e6a2f234bfce3242fe4ef4a778ce8ddfce686a4fd9b35b6211734bcf"}
Sep 11 18:10:44.147659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.147627    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8" event={"ID":"52b21de6-5da9-4f93-8af2-fe5ca293f836","Type":"ContainerStarted","Data":"9dcf748a4be1cfde6c69e2a59f6714913ee88394e6eb335255f773ddc55fb121"}
Sep 11 18:10:44.179447 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.179394    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dz4w2" podStartSLOduration=3.798064937 podStartE2EDuration="21.179376768s" totalImagesPullingTime="17.381311831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:44.179205643 +0000 UTC m=+21.599980046" watchObservedRunningTime="2026-09-11 18:10:44.179376768 +0000 UTC m=+21.600151172"
Sep 11 18:10:44.179878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.179839    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8svnl" podStartSLOduration=7.502651006 podStartE2EDuration="21.179827096s" totalImagesPullingTime="13.67717609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:44.158595126 +0000 UTC m=+21.579369540" watchObservedRunningTime="2026-09-11 18:10:44.179827096 +0000 UTC m=+21.600601499"
Sep 11 18:10:44.223348 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.223304    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-glzd4" podStartSLOduration=7.5512467789999995 podStartE2EDuration="21.223289245s" totalImagesPullingTime="13.672042466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:44.223197811 +0000 UTC m=+21.643972213" watchObservedRunningTime="2026-09-11 18:10:44.223289245 +0000 UTC m=+21.644063648"
Sep 11 18:10:44.265406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.265353    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vmrk8" podStartSLOduration=3.834727458 podStartE2EDuration="21.265337046s" totalImagesPullingTime="17.430609588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:44.265082763 +0000 UTC m=+21.685857176" watchObservedRunningTime="2026-09-11 18:10:44.265337046 +0000 UTC m=+21.686111448"
Sep 11 18:10:44.330848 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.330814    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-glzd4_ee6e557e-06e1-4070-9103-d3f635df8d2f/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:44.411570 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.411536    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-glzd4_ee6e557e-06e1-4070-9103-d3f635df8d2f/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:44.807867 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.807677    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 18:10:44.918920 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.918886    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:44.919468 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.919450    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:44.993471 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.993256    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T18:10:44.807862272Z","UUID":"c18b8f91-b417-43b9-9c27-b94fef71fe16","Handler":null,"Name":"","Endpoint":""}
Sep 11 18:10:44.995174 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.995152    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 18:10:44.995174 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:44.995184    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 18:10:45.054432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.054404    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:45.054606 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:45.054526    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:45.152280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.152237    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8" event={"ID":"52b21de6-5da9-4f93-8af2-fe5ca293f836","Type":"ContainerStarted","Data":"f7b3b9a895e2a4d2f4a3dd0f10961269e36abce3695c606e2ccdb5e81fa46ecc"}
Sep 11 18:10:45.154385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.154352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal" event={"ID":"843cd73d600d6cc7d5c22a27b6134fec","Type":"ContainerStarted","Data":"73a60aaa277053e47bffdff2dac844b03beb2b3772a5efba6a977f9b8e42b87c"}
Sep 11 18:10:45.155099 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.155066    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:45.155552 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.155536    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-glzd4"
Sep 11 18:10:45.171950 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.171904    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-186.ec2.internal" podStartSLOduration=21.171888999 podStartE2EDuration="21.171888999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:45.171820489 +0000 UTC m=+22.592594891" watchObservedRunningTime="2026-09-11 18:10:45.171888999 +0000 UTC m=+22.592663400"
Sep 11 18:10:45.246948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:45.246865    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-glzd4_ee6e557e-06e1-4070-9103-d3f635df8d2f/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:46.055018 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:46.054944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:46.055150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:46.054944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:46.055150 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:46.055057    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:46.055150 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:46.055112    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:46.160872 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:46.160831    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"7d27afb8117ecd2dce4cc76d278da47f6c2c158e2ec5800d49ee53a6ad873873"}
Sep 11 18:10:47.054518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:47.054473    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:47.054704 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:47.054624    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:47.165231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:47.165194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8" event={"ID":"52b21de6-5da9-4f93-8af2-fe5ca293f836","Type":"ContainerStarted","Data":"98612b584ee4d010f65473cb31d1c30707a6fe7b984695d261edb4e00551c897"}
Sep 11 18:10:47.186385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:47.186337    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pkzw8" podStartSLOduration=4.040427895 podStartE2EDuration="24.186321856s" totalImagesPullingTime="20.145893961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:47.184900826 +0000 UTC m=+24.605675228" watchObservedRunningTime="2026-09-11 18:10:47.186321856 +0000 UTC m=+24.607096282"
Sep 11 18:10:48.054996 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:48.054960    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:48.054996 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:48.054988    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:48.055208 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:48.055101    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:48.055249 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:48.055222    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:49.055145 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:49.055114    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:49.055584 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:49.055253    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:50.055084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.054918    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:50.055250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.054918    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:50.055250 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:50.055145    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:50.055250 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:50.055219    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:50.175040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.175007    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="15c4a88526c04886d6549afef3c6e3ea3cba145a0fa2f0696e12eac20a8f0476" exitCode=0
Sep 11 18:10:50.175230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.175060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"15c4a88526c04886d6549afef3c6e3ea3cba145a0fa2f0696e12eac20a8f0476"}
Sep 11 18:10:50.178962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.178936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" event={"ID":"3137ec06-7b3a-4987-a7ac-7cce905a97b2","Type":"ContainerStarted","Data":"aaa859d7c8417a3b8d7076eefd5f021d19d874d3e4fd5381a4d300865b1c13ec"}
Sep 11 18:10:50.179203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.179183    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:50.193903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.193878    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:50.560187 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:50.560145    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-glzd4_ee6e557e-06e1-4070-9103-d3f635df8d2f/konnectivity-agent/0.log" limit=1024
Sep 11 18:10:51.054754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.054714    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:51.054931 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:51.054885    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:51.183153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.183126    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerStarted","Data":"ed696d5ef2cca3fc25bbb6f0e8a724587acc63da1e8e9874452b430a823bbb48"}
Sep 11 18:10:51.183713 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.183252    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:51.183713 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.183322    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:51.198878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.198702    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:10:51.208302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.208258    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp" podStartSLOduration=10.231245332 podStartE2EDuration="28.208244087s" totalImagesPullingTime="17.976998755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:10:50.26703328 +0000 UTC m=+27.687807683" watchObservedRunningTime="2026-09-11 18:10:51.208244087 +0000 UTC m=+28.629018490"
Sep 11 18:10:51.248021 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.247996    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2nk7"]
Sep 11 18:10:51.248199 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.248100    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:51.248267 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:51.248202    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:51.252473 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.252448    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tgthz"]
Sep 11 18:10:51.252602 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.252549    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:51.252669 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:51.252643    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:51.253056 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.253034    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9976f"]
Sep 11 18:10:51.253166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:51.253123    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:51.253243 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:51.253223    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:52.187489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:52.187460    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="ed696d5ef2cca3fc25bbb6f0e8a724587acc63da1e8e9874452b430a823bbb48" exitCode=0
Sep 11 18:10:52.187852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:52.187544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"ed696d5ef2cca3fc25bbb6f0e8a724587acc63da1e8e9874452b430a823bbb48"}
Sep 11 18:10:53.055907 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:53.055827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:53.056042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:53.055926    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:53.056042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:53.055949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:53.056042 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:53.055918    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:53.056042 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:53.056016    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:53.056177 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:53.056134    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:53.192327 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:53.192295    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="c2b5c2fdfe298923c130a20f44733ee42855cc4933f3e9bbebe1b3c66a4351ae" exitCode=0
Sep 11 18:10:53.192681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:53.192345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"c2b5c2fdfe298923c130a20f44733ee42855cc4933f3e9bbebe1b3c66a4351ae"}
Sep 11 18:10:55.054475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.054444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:55.054909 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.054444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:55.054909 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:55.054555    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9976f" podUID="7c68290e-6a0d-42af-856a-a125def872d1"
Sep 11 18:10:55.054909 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.054444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:55.054909 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:55.054627    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgthz" podUID="900edfc9-340d-46f5-836c-d8168393d1fa"
Sep 11 18:10:55.054909 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:55.054725    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2nk7" podUID="d1eb9695-39ad-4a0a-b15d-b0ff8283af6c"
Sep 11 18:10:55.824053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.824018    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-186.ec2.internal" event="NodeReady"
Sep 11 18:10:55.824232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.824185    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 18:10:55.883333 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.883300    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zxq2x"]
Sep 11 18:10:55.885510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.885482    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6llzx"]
Sep 11 18:10:55.885510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.885498    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:55.887443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.887421    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:55.888290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.888269    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 18:10:55.888382 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.888315    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4zn8w\""
Sep 11 18:10:55.888959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.888938    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 18:10:55.889355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.889332    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 18:10:55.889472 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.889359    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7bc6\""
Sep 11 18:10:55.889648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.889632    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 18:10:55.889931 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.889913    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 18:10:55.898503 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.898480    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6llzx"]
Sep 11 18:10:55.902671 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.902437    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxq2x"]
Sep 11 18:10:55.982295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f27b1187-c3bf-4233-8b02-7342ed2a138b-cert\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:55.982438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:55.982438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m8lt\" (UniqueName: \"kubernetes.io/projected/f1e30d6f-b96e-4ca3-966e-a320f5155356-kube-api-access-8m8lt\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:55.982522 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2ssb\" (UniqueName: \"kubernetes.io/projected/f27b1187-c3bf-4233-8b02-7342ed2a138b-kube-api-access-g2ssb\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:55.982522 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1e30d6f-b96e-4ca3-966e-a320f5155356-config-volume\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:55.982590 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:55.982526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e30d6f-b96e-4ca3-966e-a320f5155356-tmp-dir\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e30d6f-b96e-4ca3-966e-a320f5155356-tmp-dir\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083057    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f27b1187-c3bf-4233-8b02-7342ed2a138b-cert\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:56.083483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083082    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8lt\" (UniqueName: \"kubernetes.io/projected/f1e30d6f-b96e-4ca3-966e-a320f5155356-kube-api-access-8m8lt\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083170    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2ssb\" (UniqueName: \"kubernetes.io/projected/f27b1187-c3bf-4233-8b02-7342ed2a138b-kube-api-access-g2ssb\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:56.083483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1e30d6f-b96e-4ca3-966e-a320f5155356-config-volume\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1e30d6f-b96e-4ca3-966e-a320f5155356-tmp-dir\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.083667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1e30d6f-b96e-4ca3-966e-a320f5155356-config-volume\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.083971 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.083719    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:10:56.083971 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.083812    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:56.583771926 +0000 UTC m=+34.004546321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:10:56.088130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.088103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f27b1187-c3bf-4233-8b02-7342ed2a138b-cert\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:56.092187 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.092152    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m8lt\" (UniqueName: \"kubernetes.io/projected/f1e30d6f-b96e-4ca3-966e-a320f5155356-kube-api-access-8m8lt\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.092736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.092717    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2ssb\" (UniqueName: \"kubernetes.io/projected/f27b1187-c3bf-4233-8b02-7342ed2a138b-kube-api-access-g2ssb\") pod \"ingress-canary-6llzx\" (UID: \"f27b1187-c3bf-4233-8b02-7342ed2a138b\") " pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:56.204604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.204576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6llzx"
Sep 11 18:10:56.585903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.585859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:56.586097 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.586057    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:10:56.586158 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.586123    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:57.586107363 +0000 UTC m=+35.006881764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:10:56.686798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.686748    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:56.686958 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.686915    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:56.687013 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.686994    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret podName:d1eb9695-39ad-4a0a-b15d-b0ff8283af6c nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.686974802 +0000 UTC m=+66.107749205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret") pod "global-pull-secret-syncer-k2nk7" (UID: "d1eb9695-39ad-4a0a-b15d-b0ff8283af6c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:10:56.787611 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.787581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:56.787774 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.787746    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:56.787842 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.787824    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.787808434 +0000 UTC m=+66.208582817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:10:56.888904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:56.888780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:56.889062 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.888997    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:10:56.889062 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.889022    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:10:56.889062 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.889036    2566 projected.go:196] Error preparing data for projected volume kube-api-access-r68t6 for pod openshift-network-diagnostics/network-check-target-tgthz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:56.889189 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:56.889099    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6 podName:900edfc9-340d-46f5-836c-d8168393d1fa nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.889080408 +0000 UTC m=+66.309854794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r68t6" (UniqueName: "kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6") pod "network-check-target-tgthz" (UID: "900edfc9-340d-46f5-836c-d8168393d1fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:10:57.054584 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.054369    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:10:57.054750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.054369    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:10:57.055098 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.054425    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:10:57.057463 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.057436    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:10:57.057543 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.057449    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 18:10:57.058251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.058059    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnsl\""
Sep 11 18:10:57.058251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.058100    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:10:57.058251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.058063    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztbbx\""
Sep 11 18:10:57.058251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.058085    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 18:10:57.594537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.594497    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:57.594941 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:57.594644    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:10:57.594941 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:57.594712    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:10:59.594693501 +0000 UTC m=+37.015467882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:10:57.916460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:57.916411    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6llzx"]
Sep 11 18:10:57.922413 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:10:57.922381    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27b1187_c3bf_4233_8b02_7342ed2a138b.slice/crio-a5009e40c9715fa9f258421ea6512aeade8f279a57f432f0f739f34c43122a65 WatchSource:0}: Error finding container a5009e40c9715fa9f258421ea6512aeade8f279a57f432f0f739f34c43122a65: Status 404 returned error can't find the container with id a5009e40c9715fa9f258421ea6512aeade8f279a57f432f0f739f34c43122a65
Sep 11 18:10:58.207043 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:58.207007    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="b7024bbe301b91738fa2202e2ec24b9e274c39473497664f49a4969d1c2503b2" exitCode=0
Sep 11 18:10:58.207204 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:58.207085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"b7024bbe301b91738fa2202e2ec24b9e274c39473497664f49a4969d1c2503b2"}
Sep 11 18:10:58.208252 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:58.208232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6llzx" event={"ID":"f27b1187-c3bf-4233-8b02-7342ed2a138b","Type":"ContainerStarted","Data":"a5009e40c9715fa9f258421ea6512aeade8f279a57f432f0f739f34c43122a65"}
Sep 11 18:10:59.214614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:59.214577    2566 generic.go:356] "Generic (PLEG): container finished" podID="a51e2dc1-3280-48a0-91c3-e8827fdbc3e0" containerID="dea07540b277c85eef3e3984f4c44bce3701beb7242cc8e0d2d6257c97b5d8c5" exitCode=0
Sep 11 18:10:59.215364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:59.214649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerDied","Data":"dea07540b277c85eef3e3984f4c44bce3701beb7242cc8e0d2d6257c97b5d8c5"}
Sep 11 18:10:59.611150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:10:59.611052    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:10:59.611316 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:59.611214    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:10:59.611316 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:10:59.611288    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:03.611269633 +0000 UTC m=+41.032044028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:11:00.220104 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:00.219879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" event={"ID":"a51e2dc1-3280-48a0-91c3-e8827fdbc3e0","Type":"ContainerStarted","Data":"f15b2ecd9905b7fba61ad00a08d56334b1268ad03008165f35b8fce7d7b1bd33"}
Sep 11 18:11:00.242961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:00.242911    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q5f4t" podStartSLOduration=8.276527411 podStartE2EDuration="37.242894694s" totalImagesPullingTime="28.966367283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:00.241597201 +0000 UTC m=+37.662371616" watchObservedRunningTime="2026-09-11 18:11:00.242894694 +0000 UTC m=+37.663669100"
Sep 11 18:11:01.223503 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:01.223462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6llzx" event={"ID":"f27b1187-c3bf-4233-8b02-7342ed2a138b","Type":"ContainerStarted","Data":"ae87f6b88b8395c399525f5a20bc829b9aa0baaf21a4a91f0eb25d1fd238f910"}
Sep 11 18:11:01.269473 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:01.269416    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6llzx" podStartSLOduration=3.591852453 podStartE2EDuration="6.269396466s" totalImagesPullingTime="2.677544013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:01.268945976 +0000 UTC m=+38.689720378" watchObservedRunningTime="2026-09-11 18:11:01.269396466 +0000 UTC m=+38.690170870"
Sep 11 18:11:03.639044 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:03.639002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:03.639513 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:03.639171    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:11:03.639513 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:03.639254    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:11.639234011 +0000 UTC m=+49.060008412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:11:11.693998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:11.693958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:11.694433 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:11.694128    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:11:11.694433 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:11.694199    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:27.694179157 +0000 UTC m=+65.114953538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:11:23.202392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:23.202357    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkqhp"
Sep 11 18:11:26.708503 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.708469    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"]
Sep 11 18:11:26.710992 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.710975    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:26.713436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.713416    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:11:26.713554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.713418    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5zxm5\""
Sep 11 18:11:26.713554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.713417    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 18:11:26.714027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.714006    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 18:11:26.721672 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.721653    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"]
Sep 11 18:11:26.829129 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.829099    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-gg2k4"]
Sep 11 18:11:26.831271 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.831255    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b84465d6d-lbgjn"]
Sep 11 18:11:26.831398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.831382    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:26.833229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.833210    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:26.834326 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.834305    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 18:11:26.834594 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.834577    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-95zqg\""
Sep 11 18:11:26.834658 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.834610    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 18:11:26.835098 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.835079    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:11:26.839367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839348    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 18:11:26.839505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839370    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 18:11:26.839505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839385    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 18:11:26.839505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839462    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 18:11:26.839505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839480    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 18:11:26.839707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839667    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 18:11:26.839707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839690    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 18:11:26.839958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.839943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p8kqq\""
Sep 11 18:11:26.843772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.843658    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-gg2k4"]
Sep 11 18:11:26.845948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.845926    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b84465d6d-lbgjn"]
Sep 11 18:11:26.846953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.846917    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 18:11:26.903803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.903746    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqwm\" (UniqueName: \"kubernetes.io/projected/3a575159-9c4b-438c-9a46-59ab780a55b0-kube-api-access-mjqwm\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:26.903979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.903907    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:26.938516 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.938477    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"]
Sep 11 18:11:26.942753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.942725    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:26.945378 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.945347    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 18:11:26.945378 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.945364    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bszmj\""
Sep 11 18:11:26.945682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.945664    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 18:11:26.958954 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:26.958899    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"]
Sep 11 18:11:27.005097 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005062    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.005267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005109    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-config\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.005267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6913903e-bea1-4103-9780-0b879b4a004d-serving-cert\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.005267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkn5\" (UniqueName: \"kubernetes.io/projected/6913903e-bea1-4103-9780-0b879b4a004d-kube-api-access-zgkn5\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.005267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-default-certificate\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.005267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005238    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-stats-auth\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005307    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-trusted-ca\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005322    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dsbz\" (UniqueName: \"kubernetes.io/projected/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-kube-api-access-7dsbz\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.005420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqwm\" (UniqueName: \"kubernetes.io/projected/3a575159-9c4b-438c-9a46-59ab780a55b0-kube-api-access-mjqwm\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:27.005443 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.005442    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 18:11:27.005629 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.005515    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls podName:3a575159-9c4b-438c-9a46-59ab780a55b0 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:27.505496054 +0000 UTC m=+64.926270454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-dsfb9" (UID: "3a575159-9c4b-438c-9a46-59ab780a55b0") : secret "samples-operator-tls" not found
Sep 11 18:11:27.014720 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.014687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqwm\" (UniqueName: \"kubernetes.io/projected/3a575159-9c4b-438c-9a46-59ab780a55b0-kube-api-access-mjqwm\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:27.106685 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106643    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.106685 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-config\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6913903e-bea1-4103-9780-0b879b4a004d-serving-cert\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkn5\" (UniqueName: \"kubernetes.io/projected/6913903e-bea1-4103-9780-0b879b4a004d-kube-api-access-zgkn5\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-default-certificate\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106810    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-stats-auth\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106846    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.106873    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:27.606848751 +0000 UTC m=+65.027623150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:27.106962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106929    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.107302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-trusted-ca\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.107302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.106993    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dsbz\" (UniqueName: \"kubernetes.io/projected/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-kube-api-access-7dsbz\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.107302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.107053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.107302 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.107067    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:11:27.107302 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.107127    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:27.607111462 +0000 UTC m=+65.027885861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : secret "router-metrics-certs-default" not found
Sep 11 18:11:27.107546 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.107461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-config\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.107924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.107902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6913903e-bea1-4103-9780-0b879b4a004d-trusted-ca\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.109207 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.109189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6913903e-bea1-4103-9780-0b879b4a004d-serving-cert\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.109715 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.109694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-stats-auth\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.109774 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.109699    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-default-certificate\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.117470 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.117441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dsbz\" (UniqueName: \"kubernetes.io/projected/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-kube-api-access-7dsbz\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.117838 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.117819    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkn5\" (UniqueName: \"kubernetes.io/projected/6913903e-bea1-4103-9780-0b879b4a004d-kube-api-access-zgkn5\") pod \"console-operator-696884fb9c-gg2k4\" (UID: \"6913903e-bea1-4103-9780-0b879b4a004d\") " pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.141240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.141194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:27.208255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.208222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.208412 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.208306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.208412 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.208356    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:27.208516 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.208423    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:27.708407983 +0000 UTC m=+65.129182364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:27.208999 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.208947    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.429402 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.429366    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-gg2k4"]
Sep 11 18:11:27.433277 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:27.433251    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6913903e_bea1_4103_9780_0b879b4a004d.slice/crio-9d3d9f88b598389443bce99a10ee85a843a36b6bdcd6f2f875b5ec716543c4dc WatchSource:0}: Error finding container 9d3d9f88b598389443bce99a10ee85a843a36b6bdcd6f2f875b5ec716543c4dc: Status 404 returned error can't find the container with id 9d3d9f88b598389443bce99a10ee85a843a36b6bdcd6f2f875b5ec716543c4dc
Sep 11 18:11:27.510952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.510857    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:27.511116 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.511008    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 18:11:27.511116 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.511093    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls podName:3a575159-9c4b-438c-9a46-59ab780a55b0 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.511076273 +0000 UTC m=+65.931850654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-dsfb9" (UID: "3a575159-9c4b-438c-9a46-59ab780a55b0") : secret "samples-operator-tls" not found
Sep 11 18:11:27.611371 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.611331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.611555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.611432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:27.611555 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.611471    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:11:27.611555 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.611535    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.611517673 +0000 UTC m=+66.032292076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : secret "router-metrics-certs-default" not found
Sep 11 18:11:27.611555 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.611549    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.611542939 +0000 UTC m=+66.032317321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:27.712670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.712634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:27.713155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:27.712706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:27.713155 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.712821    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:11:27.713155 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.712890    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls podName:f1e30d6f-b96e-4ca3-966e-a320f5155356 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:59.712870763 +0000 UTC m=+97.133645145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls") pod "dns-default-zxq2x" (UID: "f1e30d6f-b96e-4ca3-966e-a320f5155356") : secret "dns-default-metrics-tls" not found
Sep 11 18:11:27.713155 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.712821    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:27.713155 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:27.712977    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:28.712959314 +0000 UTC m=+66.133733719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:28.289619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.289578    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" event={"ID":"6913903e-bea1-4103-9780-0b879b4a004d","Type":"ContainerStarted","Data":"9d3d9f88b598389443bce99a10ee85a843a36b6bdcd6f2f875b5ec716543c4dc"}
Sep 11 18:11:28.519495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.519453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:28.519667 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.519616    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 18:11:28.519716 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.519696    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls podName:3a575159-9c4b-438c-9a46-59ab780a55b0 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:30.519675881 +0000 UTC m=+67.940450278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-dsfb9" (UID: "3a575159-9c4b-438c-9a46-59ab780a55b0") : secret "samples-operator-tls" not found
Sep 11 18:11:28.620300 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.620217    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:28.620450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.620318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:28.620450 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.620374    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:11:28.620450 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.620442    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:30.620424822 +0000 UTC m=+68.041199204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:28.620624 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.620466    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:30.620455774 +0000 UTC m=+68.041230169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : secret "router-metrics-certs-default" not found
Sep 11 18:11:28.721607 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.721568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:11:28.722169 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.721629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:28.722169 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.721775    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:28.722169 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.721863    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:30.721840483 +0000 UTC m=+68.142614887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:28.723777 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.723754    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:11:28.734942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.734908    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1eb9695-39ad-4a0a-b15d-b0ff8283af6c-original-pull-secret\") pod \"global-pull-secret-syncer-k2nk7\" (UID: \"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c\") " pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:11:28.822454 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.822418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:11:28.824988 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.824957    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:11:28.832983 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.832956    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 18:11:28.833130 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:28.833036    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs podName:7c68290e-6a0d-42af-856a-a125def872d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:12:32.833015168 +0000 UTC m=+130.253789564 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs") pod "network-metrics-daemon-9976f" (UID: "7c68290e-6a0d-42af-856a-a125def872d1") : secret "metrics-daemon-secret" not found
Sep 11 18:11:28.878489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.878408    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2nk7"
Sep 11 18:11:28.923745 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.923701    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:11:28.926317 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.926287    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 18:11:28.936711 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.936682    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 18:11:28.947224 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:28.947195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68t6\" (UniqueName: \"kubernetes.io/projected/900edfc9-340d-46f5-836c-d8168393d1fa-kube-api-access-r68t6\") pod \"network-check-target-tgthz\" (UID: \"900edfc9-340d-46f5-836c-d8168393d1fa\") " pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:11:29.175307 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:29.175276    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztbbx\""
Sep 11 18:11:29.183334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:29.183307    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:11:29.541891 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:29.541817    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2nk7"]
Sep 11 18:11:29.544953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:29.544928    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tgthz"]
Sep 11 18:11:29.546189 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:29.546156    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1eb9695_39ad_4a0a_b15d_b0ff8283af6c.slice/crio-5579402ca5c3a84129008cb1a88c38347fe7a038a949f7da486e5416fc63d137 WatchSource:0}: Error finding container 5579402ca5c3a84129008cb1a88c38347fe7a038a949f7da486e5416fc63d137: Status 404 returned error can't find the container with id 5579402ca5c3a84129008cb1a88c38347fe7a038a949f7da486e5416fc63d137
Sep 11 18:11:29.549251 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:29.549227    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900edfc9_340d_46f5_836c_d8168393d1fa.slice/crio-7a886f6dc0edf392bd9f944a04242990fd96a4c28830134dc2467bb76a2e7384 WatchSource:0}: Error finding container 7a886f6dc0edf392bd9f944a04242990fd96a4c28830134dc2467bb76a2e7384: Status 404 returned error can't find the container with id 7a886f6dc0edf392bd9f944a04242990fd96a4c28830134dc2467bb76a2e7384
Sep 11 18:11:30.299006 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.298940    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2nk7" event={"ID":"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c","Type":"ContainerStarted","Data":"5579402ca5c3a84129008cb1a88c38347fe7a038a949f7da486e5416fc63d137"}
Sep 11 18:11:30.301567 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.301543    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/0.log"
Sep 11 18:11:30.301706 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.301588    2566 generic.go:356] "Generic (PLEG): container finished" podID="6913903e-bea1-4103-9780-0b879b4a004d" containerID="5b57943330c9e2574b988a76f02cf86fd2740cb6f2db3ff98cce842e1bbe8db2" exitCode=255
Sep 11 18:11:30.301706 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.301679    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" event={"ID":"6913903e-bea1-4103-9780-0b879b4a004d","Type":"ContainerDied","Data":"5b57943330c9e2574b988a76f02cf86fd2740cb6f2db3ff98cce842e1bbe8db2"}
Sep 11 18:11:30.302323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.301960    2566 scope.go:117] "RemoveContainer" containerID="5b57943330c9e2574b988a76f02cf86fd2740cb6f2db3ff98cce842e1bbe8db2"
Sep 11 18:11:30.303611 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.303583    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tgthz" event={"ID":"900edfc9-340d-46f5-836c-d8168393d1fa","Type":"ContainerStarted","Data":"7a886f6dc0edf392bd9f944a04242990fd96a4c28830134dc2467bb76a2e7384"}
Sep 11 18:11:30.533546 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.533465    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:30.533719 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.533629    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 18:11:30.533719 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.533714    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls podName:3a575159-9c4b-438c-9a46-59ab780a55b0 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.533693146 +0000 UTC m=+71.954467545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-dsfb9" (UID: "3a575159-9c4b-438c-9a46-59ab780a55b0") : secret "samples-operator-tls" not found
Sep 11 18:11:30.634883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.634781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:30.635022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.634961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:30.635022 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.634999    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.634973868 +0000 UTC m=+72.055748272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:30.635223 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.635044    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:11:30.635223 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.635097    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.635082457 +0000 UTC m=+72.055856853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : secret "router-metrics-certs-default" not found
Sep 11 18:11:30.735573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:30.735529    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:30.735744 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.735733    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:30.735827 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:30.735804    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.735773815 +0000 UTC m=+72.156548201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:31.308817 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.308738    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:11:31.309482 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.309436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/0.log"
Sep 11 18:11:31.309614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.309479    2566 generic.go:356] "Generic (PLEG): container finished" podID="6913903e-bea1-4103-9780-0b879b4a004d" containerID="afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e" exitCode=255
Sep 11 18:11:31.309614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.309527    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" event={"ID":"6913903e-bea1-4103-9780-0b879b4a004d","Type":"ContainerDied","Data":"afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e"}
Sep 11 18:11:31.309614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.309582    2566 scope.go:117] "RemoveContainer" containerID="5b57943330c9e2574b988a76f02cf86fd2740cb6f2db3ff98cce842e1bbe8db2"
Sep 11 18:11:31.310059 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:31.310040    2566 scope.go:117] "RemoveContainer" containerID="afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e"
Sep 11 18:11:31.310288 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:31.310253    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-gg2k4_openshift-console-operator(6913903e-bea1-4103-9780-0b879b4a004d)\"" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" podUID="6913903e-bea1-4103-9780-0b879b4a004d"
Sep 11 18:11:32.312260 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:32.312235    2566 scope.go:117] "RemoveContainer" containerID="afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e"
Sep 11 18:11:32.312602 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:32.312390    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-gg2k4_openshift-console-operator(6913903e-bea1-4103-9780-0b879b4a004d)\"" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" podUID="6913903e-bea1-4103-9780-0b879b4a004d"
Sep 11 18:11:33.726255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.726225    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"]
Sep 11 18:11:33.733613 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.733593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"
Sep 11 18:11:33.742849 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.742827    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 18:11:33.742961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.742830    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 18:11:33.743333 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.743318    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rxcb8\""
Sep 11 18:11:33.758666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.758639    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"]
Sep 11 18:11:33.759830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.759808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ljm\" (UniqueName: \"kubernetes.io/projected/c8058597-eb60-4ca4-a601-f3fca5984491-kube-api-access-j7ljm\") pod \"migrator-8b4d697c5-t4cdd\" (UID: \"c8058597-eb60-4ca4-a601-f3fca5984491\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"
Sep 11 18:11:33.854496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.854466    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v9cpq"]
Sep 11 18:11:33.860261 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.860231    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ljm\" (UniqueName: \"kubernetes.io/projected/c8058597-eb60-4ca4-a601-f3fca5984491-kube-api-access-j7ljm\") pod \"migrator-8b4d697c5-t4cdd\" (UID: \"c8058597-eb60-4ca4-a601-f3fca5984491\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"
Sep 11 18:11:33.869396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.869365    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:33.871814 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.871776    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9cpq"]
Sep 11 18:11:33.872662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.872577    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 18:11:33.872662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.872649    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 18:11:33.872994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.872974    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 18:11:33.873108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.872998    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 18:11:33.873366 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.873350    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8hchm\""
Sep 11 18:11:33.873616 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.873595    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ljm\" (UniqueName: \"kubernetes.io/projected/c8058597-eb60-4ca4-a601-f3fca5984491-kube-api-access-j7ljm\") pod \"migrator-8b4d697c5-t4cdd\" (UID: \"c8058597-eb60-4ca4-a601-f3fca5984491\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"
Sep 11 18:11:33.961110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.961077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21223870-c5d7-4bfa-b015-c94211e0abdc-data-volume\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:33.961281 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.961174    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21223870-c5d7-4bfa-b015-c94211e0abdc-crio-socket\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:33.961281 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.961204    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:33.961281 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.961223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4gs\" (UniqueName: \"kubernetes.io/projected/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-api-access-cv4gs\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:33.961281 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:33.961247    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.041722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.041703    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"
Sep 11 18:11:34.062547 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21223870-c5d7-4bfa-b015-c94211e0abdc-crio-socket\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.062652 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062560    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.062652 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062587    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4gs\" (UniqueName: \"kubernetes.io/projected/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-api-access-cv4gs\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.062747 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062657    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21223870-c5d7-4bfa-b015-c94211e0abdc-crio-socket\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.062747 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.062699    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:34.062747 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.062906 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.062765    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.562745008 +0000 UTC m=+71.983519404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:34.062906 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.062803    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:11:34.062906 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.062865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21223870-c5d7-4bfa-b015-c94211e0abdc-data-volume\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.063053 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.062961    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:34.562945094 +0000 UTC m=+71.983719488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : configmap "kube-rbac-proxy" not found
Sep 11 18:11:34.063203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.063183    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21223870-c5d7-4bfa-b015-c94211e0abdc-data-volume\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.081830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.081803    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4gs\" (UniqueName: \"kubernetes.io/projected/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-api-access-cv4gs\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.319684 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.319608    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:11:34.322439 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.322329    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tgthz" event={"ID":"900edfc9-340d-46f5-836c-d8168393d1fa","Type":"ContainerStarted","Data":"4e6b4cb50b037ae82941ebec8a6d8c4e44bfa64706203d818cba0bf4abda0b19"}
Sep 11 18:11:34.322439 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.322408    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:11:34.324276 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.324253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2nk7" event={"ID":"d1eb9695-39ad-4a0a-b15d-b0ff8283af6c","Type":"ContainerStarted","Data":"d35915934dee68bd39e1bddf24cbef0ccb4ca1140130a7a37717cd2a427553a3"}
Sep 11 18:11:34.353751 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.353701    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tgthz" podStartSLOduration=66.873166128 podStartE2EDuration="1m11.353686074s" totalImagesPullingTime="4.480519946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:34.350384829 +0000 UTC m=+71.771159233" watchObservedRunningTime="2026-09-11 18:11:34.353686074 +0000 UTC m=+71.774460509"
Sep 11 18:11:34.366829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.366801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd"]
Sep 11 18:11:34.369967 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:34.369944    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8058597_eb60_4ca4_a601_f3fca5984491.slice/crio-333d079a0dbef374ce00f1b8d21f05955a44b6a81932d6ba66de06fa47c5eb77 WatchSource:0}: Error finding container 333d079a0dbef374ce00f1b8d21f05955a44b6a81932d6ba66de06fa47c5eb77: Status 404 returned error can't find the container with id 333d079a0dbef374ce00f1b8d21f05955a44b6a81932d6ba66de06fa47c5eb77
Sep 11 18:11:34.391367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.391326    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k2nk7" podStartSLOduration=66.897377608 podStartE2EDuration="1m11.391309451s" totalImagesPullingTime="4.493931843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:34.390854834 +0000 UTC m=+71.811629237" watchObservedRunningTime="2026-09-11 18:11:34.391309451 +0000 UTC m=+71.812083844"
Sep 11 18:11:34.567677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.567642    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:34.567846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.567717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.567846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.567751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:34.567846 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567801    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 18:11:34.567946 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567846    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:11:34.567946 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567860    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls podName:3a575159-9c4b-438c-9a46-59ab780a55b0 nodeName:}" failed. No retries permitted until 2026-09-11 18:11:42.567845745 +0000 UTC m=+79.988620126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-dsfb9" (UID: "3a575159-9c4b-438c-9a46-59ab780a55b0") : secret "samples-operator-tls" not found
Sep 11 18:11:34.567946 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567866    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:34.567946 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567887    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:35.567876057 +0000 UTC m=+72.988650438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : configmap "kube-rbac-proxy" not found
Sep 11 18:11:34.567946 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.567909    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:35.567899006 +0000 UTC m=+72.988673388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:34.668568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.668475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:34.668568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.668544    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:34.668737 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.668628    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:11:34.668737 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.668640    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:42.668623094 +0000 UTC m=+80.089397476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:34.668737 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.668670    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:42.668660291 +0000 UTC m=+80.089434672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : secret "router-metrics-certs-default" not found
Sep 11 18:11:34.769114 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:34.769078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:34.769405 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.769238    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:34.769405 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:34.769301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:42.769287298 +0000 UTC m=+80.190061680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:35.328041 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:35.328006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd" event={"ID":"c8058597-eb60-4ca4-a601-f3fca5984491","Type":"ContainerStarted","Data":"333d079a0dbef374ce00f1b8d21f05955a44b6a81932d6ba66de06fa47c5eb77"}
Sep 11 18:11:35.576386 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:35.576355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:35.576490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:35.576414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:35.576490 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:35.576478    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:35.576575 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:35.576524    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:11:35.576575 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:35.576548    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:37.576529636 +0000 UTC m=+74.997304037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:35.576575 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:35.576565    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:37.576554107 +0000 UTC m=+74.997328515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : configmap "kube-rbac-proxy" not found
Sep 11 18:11:36.333911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:36.333875    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd" event={"ID":"c8058597-eb60-4ca4-a601-f3fca5984491","Type":"ContainerStarted","Data":"258179ca0f0169bcc160fa65284a276b37f5bd35546ff80105eb298060dbe827"}
Sep 11 18:11:36.334338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:36.333931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd" event={"ID":"c8058597-eb60-4ca4-a601-f3fca5984491","Type":"ContainerStarted","Data":"119cf3f50d4e72d7354ca8cd77f3652b7ec5de337c71eac1a2f7922798e9c32f"}
Sep 11 18:11:36.357942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:36.357894    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-t4cdd" podStartSLOduration=2.167970724 podStartE2EDuration="3.357871262s" totalImagesPullingTime="1.189900538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:36.3568297 +0000 UTC m=+73.777604103" watchObservedRunningTime="2026-09-11 18:11:36.357871262 +0000 UTC m=+73.778645664"
Sep 11 18:11:36.591992 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:36.591915    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmrk8_bb61546a-127f-4a22-b9de-e233a1307427/dns-node-resolver/0.log"
Sep 11 18:11:37.142365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.142324    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:37.142529 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.142391    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:37.142806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.142768    2566 scope.go:117] "RemoveContainer" containerID="afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e"
Sep 11 18:11:37.142979 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:37.142956    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-gg2k4_openshift-console-operator(6913903e-bea1-4103-9780-0b879b4a004d)\"" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" podUID="6913903e-bea1-4103-9780-0b879b4a004d"
Sep 11 18:11:37.589507 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.589481    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8svnl_2dd093e6-fb9a-4a65-a98d-901dc9654778/node-ca/0.log"
Sep 11 18:11:37.591761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.591741    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:37.591827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:37.591773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:37.591877 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:37.591865    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:11:37.591931 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:37.591922    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:41.591910146 +0000 UTC m=+79.012684527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : configmap "kube-rbac-proxy" not found
Sep 11 18:11:37.591972 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:37.591870    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:37.592003 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:37.591997    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:41.59198287 +0000 UTC m=+79.012757257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:38.196590 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:38.196560    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6llzx_f27b1187-c3bf-4233-8b02-7342ed2a138b/serve-healthcheck-canary/0.log"
Sep 11 18:11:38.790583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:38.790547    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t4cdd_c8058597-eb60-4ca4-a601-f3fca5984491/migrator/0.log"
Sep 11 18:11:38.989697 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:38.989667    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t4cdd_c8058597-eb60-4ca4-a601-f3fca5984491/graceful-termination/0.log"
Sep 11 18:11:41.620521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:41.620478    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:41.620521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:41.620526    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:41.621171 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:41.620607    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:11:41.621171 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:41.620634    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:41.621171 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:41.620680    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:49.620658972 +0000 UTC m=+87.041433373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : configmap "kube-rbac-proxy" not found
Sep 11 18:11:41.621171 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:41.620698    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls podName:21223870-c5d7-4bfa-b015-c94211e0abdc nodeName:}" failed. No retries permitted until 2026-09-11 18:11:49.620690481 +0000 UTC m=+87.041464868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9cpq" (UID: "21223870-c5d7-4bfa-b015-c94211e0abdc") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:11:42.628724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.628671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:42.631028 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.631006    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a575159-9c4b-438c-9a46-59ab780a55b0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-dsfb9\" (UID: \"3a575159-9c4b-438c-9a46-59ab780a55b0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:42.729726 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.729678    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:42.729948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.729745    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:42.729948 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:42.729890    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle podName:d22f2142-ad4d-49f3-aa6e-17bd4788f50a nodeName:}" failed. No retries permitted until 2026-09-11 18:11:58.729869065 +0000 UTC m=+96.150643447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle") pod "router-default-6b84465d6d-lbgjn" (UID: "d22f2142-ad4d-49f3-aa6e-17bd4788f50a") : configmap references non-existent config key: service-ca.crt
Sep 11 18:11:42.731990 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.731969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-metrics-certs\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:42.830754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.830712    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:42.830942 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:42.830843    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:11:42.830942 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:11:42.830895    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert podName:5dcf4200-df6a-4eb0-9e80-b41e1bdc983b nodeName:}" failed. No retries permitted until 2026-09-11 18:11:58.830882675 +0000 UTC m=+96.251657056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xpkhl" (UID: "5dcf4200-df6a-4eb0-9e80-b41e1bdc983b") : secret "networking-console-plugin-cert" not found
Sep 11 18:11:42.919706 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:42.919683    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"
Sep 11 18:11:43.193454 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:43.193368    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9"]
Sep 11 18:11:43.354998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:43.354962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9" event={"ID":"3a575159-9c4b-438c-9a46-59ab780a55b0","Type":"ContainerStarted","Data":"9a75cea8bed058b6a91be767e17b7347e08b9788fb06bd9613c1d645083cb426"}
Sep 11 18:11:45.364980 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:45.364864    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9" event={"ID":"3a575159-9c4b-438c-9a46-59ab780a55b0","Type":"ContainerStarted","Data":"841ba7be838af0c28fa4c4d3323d35ca66403f4cc133d8482c0b2b5c6a4d65e4"}
Sep 11 18:11:45.364980 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:45.364936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9" event={"ID":"3a575159-9c4b-438c-9a46-59ab780a55b0","Type":"ContainerStarted","Data":"eed5a685ef520aa184c02ac8edc80ead3b72793657b1789f58905a831aa49c42"}
Sep 11 18:11:45.400033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:45.399984    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-dsfb9" podStartSLOduration=18.037119506 podStartE2EDuration="19.399967877s" totalImagesPullingTime="1.362848371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:45.399545553 +0000 UTC m=+82.820319957" watchObservedRunningTime="2026-09-11 18:11:45.399967877 +0000 UTC m=+82.820742280"
Sep 11 18:11:49.054648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.054612    2566 scope.go:117] "RemoveContainer" containerID="afdd1a85bf3c81d1ebcdc3f9346d0b6bd9a0ac5f55ac86256d8aeb2ee0de544e"
Sep 11 18:11:49.377283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.377213    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:11:49.377405 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.377287    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" event={"ID":"6913903e-bea1-4103-9780-0b879b4a004d","Type":"ContainerStarted","Data":"d95a95ed697a7cfa67c9fbdc6ff79491199f2f2db96da5c94d86865d24c12806"}
Sep 11 18:11:49.377555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.377537    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:49.397237 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.397181    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4" podStartSLOduration=21.540197722 podStartE2EDuration="23.397162687s" totalImagesPullingTime="1.856964965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:49.396779136 +0000 UTC m=+86.817553548" watchObservedRunningTime="2026-09-11 18:11:49.397162687 +0000 UTC m=+86.817937090"
Sep 11 18:11:49.406694 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.406667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-gg2k4"
Sep 11 18:11:49.685902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.685872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:49.686076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.685909    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:49.686496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.686472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21223870-c5d7-4bfa-b015-c94211e0abdc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:49.688190 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.688169    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21223870-c5d7-4bfa-b015-c94211e0abdc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9cpq\" (UID: \"21223870-c5d7-4bfa-b015-c94211e0abdc\") " pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:49.783628 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:49.783595    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9cpq"
Sep 11 18:11:50.063563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:50.063344    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9cpq"]
Sep 11 18:11:50.065776 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:50.065749    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21223870_c5d7_4bfa_b015_c94211e0abdc.slice/crio-a4c99a58b5c39fb1793914d5731578e3d356518886421a9a0982c8313a487cde WatchSource:0}: Error finding container a4c99a58b5c39fb1793914d5731578e3d356518886421a9a0982c8313a487cde: Status 404 returned error can't find the container with id a4c99a58b5c39fb1793914d5731578e3d356518886421a9a0982c8313a487cde
Sep 11 18:11:50.382136 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:50.382057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9cpq" event={"ID":"21223870-c5d7-4bfa-b015-c94211e0abdc","Type":"ContainerStarted","Data":"18f218193d50bb134d01d0b8a73ea4421df8c5692889e27cb8a14cdd852faafb"}
Sep 11 18:11:50.382136 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:50.382113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9cpq" event={"ID":"21223870-c5d7-4bfa-b015-c94211e0abdc","Type":"ContainerStarted","Data":"a4c99a58b5c39fb1793914d5731578e3d356518886421a9a0982c8313a487cde"}
Sep 11 18:11:51.388390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:51.388354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9cpq" event={"ID":"21223870-c5d7-4bfa-b015-c94211e0abdc","Type":"ContainerStarted","Data":"30b2d624e9c403366f390c06b6082243d18be65683ba993f48c98a77d31c61fe"}
Sep 11 18:11:52.393671 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:52.393579    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9cpq" event={"ID":"21223870-c5d7-4bfa-b015-c94211e0abdc","Type":"ContainerStarted","Data":"20ae78c5c92a16f375656757b2344c8fbbdaf1835947cc2ec4ee5256529685e7"}
Sep 11 18:11:52.415823 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:52.415749    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v9cpq" podStartSLOduration=17.538435872 podStartE2EDuration="19.415734227s" totalImagesPullingTime="1.877298355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:11:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:52.414847038 +0000 UTC m=+89.835621440" watchObservedRunningTime="2026-09-11 18:11:52.415734227 +0000 UTC m=+89.836508629"
Sep 11 18:11:58.753040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:58.752998    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:58.753566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:58.753546    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22f2142-ad4d-49f3-aa6e-17bd4788f50a-service-ca-bundle\") pod \"router-default-6b84465d6d-lbgjn\" (UID: \"d22f2142-ad4d-49f3-aa6e-17bd4788f50a\") " pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:58.854276 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:58.854222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:58.856579 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:58.856548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5dcf4200-df6a-4eb0-9e80-b41e1bdc983b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xpkhl\" (UID: \"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:58.947223 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:58.947186    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:59.051422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.051341    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"
Sep 11 18:11:59.156773 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.156739    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl"]
Sep 11 18:11:59.159474 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:59.159445    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcf4200_df6a_4eb0_9e80_b41e1bdc983b.slice/crio-2b40562484226ab485f4f1b386f9c480371c9d48d5cc28b8b6cf471325703fc6 WatchSource:0}: Error finding container 2b40562484226ab485f4f1b386f9c480371c9d48d5cc28b8b6cf471325703fc6: Status 404 returned error can't find the container with id 2b40562484226ab485f4f1b386f9c480371c9d48d5cc28b8b6cf471325703fc6
Sep 11 18:11:59.217890 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.217860    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b84465d6d-lbgjn"]
Sep 11 18:11:59.221091 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:11:59.221064    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22f2142_ad4d_49f3_aa6e_17bd4788f50a.slice/crio-822ef4121b40c659d942f9c7486c98a27e850de9cbd3d2bfefe7722cde1db182 WatchSource:0}: Error finding container 822ef4121b40c659d942f9c7486c98a27e850de9cbd3d2bfefe7722cde1db182: Status 404 returned error can't find the container with id 822ef4121b40c659d942f9c7486c98a27e850de9cbd3d2bfefe7722cde1db182
Sep 11 18:11:59.416103 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.416019    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b84465d6d-lbgjn" event={"ID":"d22f2142-ad4d-49f3-aa6e-17bd4788f50a","Type":"ContainerStarted","Data":"64bd84b0b8b63ee34714509aaae1621d368dbc33fa2fa08f9af809c2fa9320bc"}
Sep 11 18:11:59.416103 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.416078    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b84465d6d-lbgjn" event={"ID":"d22f2142-ad4d-49f3-aa6e-17bd4788f50a","Type":"ContainerStarted","Data":"822ef4121b40c659d942f9c7486c98a27e850de9cbd3d2bfefe7722cde1db182"}
Sep 11 18:11:59.417283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.417254    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl" event={"ID":"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b","Type":"ContainerStarted","Data":"2b40562484226ab485f4f1b386f9c480371c9d48d5cc28b8b6cf471325703fc6"}
Sep 11 18:11:59.445460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.445410    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b84465d6d-lbgjn" podStartSLOduration=33.445392796 podStartE2EDuration="33.445392796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:11:59.444707712 +0000 UTC m=+96.865482114" watchObservedRunningTime="2026-09-11 18:11:59.445392796 +0000 UTC m=+96.866167198"
Sep 11 18:11:59.762028 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.761995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:59.764198 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.764178    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1e30d6f-b96e-4ca3-966e-a320f5155356-metrics-tls\") pod \"dns-default-zxq2x\" (UID: \"f1e30d6f-b96e-4ca3-966e-a320f5155356\") " pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:59.798996 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.798971    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4zn8w\""
Sep 11 18:11:59.807885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.807832    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:11:59.947778 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.947737    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:11:59.950089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:11:59.950067    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:12:00.085604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.085525    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxq2x"]
Sep 11 18:12:00.089970 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:00.089925    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e30d6f_b96e_4ca3_966e_a320f5155356.slice/crio-456a426cf1696659574a87ce041975f6150a0cf6b187f5cb0fcf18574843260e WatchSource:0}: Error finding container 456a426cf1696659574a87ce041975f6150a0cf6b187f5cb0fcf18574843260e: Status 404 returned error can't find the container with id 456a426cf1696659574a87ce041975f6150a0cf6b187f5cb0fcf18574843260e
Sep 11 18:12:00.423648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.423612    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxq2x" event={"ID":"f1e30d6f-b96e-4ca3-966e-a320f5155356","Type":"ContainerStarted","Data":"456a426cf1696659574a87ce041975f6150a0cf6b187f5cb0fcf18574843260e"}
Sep 11 18:12:00.423875 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.423814    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:12:00.425059 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.425041    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b84465d6d-lbgjn"
Sep 11 18:12:00.580234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.580203    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-7qqqh"]
Sep 11 18:12:00.583431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.583409    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:00.586824 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.586803    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l2hhp\""
Sep 11 18:12:00.587167 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.587146    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 18:12:00.587445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.587429    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 18:12:00.605098 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.605073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7qqqh"]
Sep 11 18:12:00.670122 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.670077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4mjs\" (UniqueName: \"kubernetes.io/projected/03eb6d06-5c71-468d-a646-4a4b6eb18e54-kube-api-access-x4mjs\") pod \"downloads-76f99584f4-7qqqh\" (UID: \"03eb6d06-5c71-468d-a646-4a4b6eb18e54\") " pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:00.770605 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.770522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mjs\" (UniqueName: \"kubernetes.io/projected/03eb6d06-5c71-468d-a646-4a4b6eb18e54-kube-api-access-x4mjs\") pod \"downloads-76f99584f4-7qqqh\" (UID: \"03eb6d06-5c71-468d-a646-4a4b6eb18e54\") " pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:00.781256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.781225    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4mjs\" (UniqueName: \"kubernetes.io/projected/03eb6d06-5c71-468d-a646-4a4b6eb18e54-kube-api-access-x4mjs\") pod \"downloads-76f99584f4-7qqqh\" (UID: \"03eb6d06-5c71-468d-a646-4a4b6eb18e54\") " pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:00.893142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:00.893109    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:01.173294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.173262    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7qqqh"]
Sep 11 18:12:01.177240 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:01.177209    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03eb6d06_5c71_468d_a646_4a4b6eb18e54.slice/crio-7014deb1394bdce73c062f4a43597aaaf77baea99afc9877e41626f443427b84 WatchSource:0}: Error finding container 7014deb1394bdce73c062f4a43597aaaf77baea99afc9877e41626f443427b84: Status 404 returned error can't find the container with id 7014deb1394bdce73c062f4a43597aaaf77baea99afc9877e41626f443427b84
Sep 11 18:12:01.428422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.428343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7qqqh" event={"ID":"03eb6d06-5c71-468d-a646-4a4b6eb18e54","Type":"ContainerStarted","Data":"7014deb1394bdce73c062f4a43597aaaf77baea99afc9877e41626f443427b84"}
Sep 11 18:12:01.429744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.429715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl" event={"ID":"5dcf4200-df6a-4eb0-9e80-b41e1bdc983b","Type":"ContainerStarted","Data":"c5ad56a4c0d2c518a4b43b071500e6e623b44e50b0c0c3ddf70ff42fafb25a43"}
Sep 11 18:12:01.460813 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.460736    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xpkhl" podStartSLOduration=34.177899253 podStartE2EDuration="35.460714686s" totalImagesPullingTime="1.282815433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:01.459773667 +0000 UTC m=+98.880548061" watchObservedRunningTime="2026-09-11 18:12:01.460714686 +0000 UTC m=+98.881489090"
Sep 11 18:12:01.779941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.779861    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"]
Sep 11 18:12:01.783537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.783085    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:01.785946 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.785832    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 18:12:01.786060 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.786017    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sd98d\""
Sep 11 18:12:01.795780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.795732    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"]
Sep 11 18:12:01.879370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.879316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rzxnx\" (UID: \"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:01.980801 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:01.980745    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rzxnx\" (UID: \"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:01.980983 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:01.980888    2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 18:12:01.980983 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:01.980968    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates podName:8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94 nodeName:}" failed. No retries permitted until 2026-09-11 18:12:02.480949906 +0000 UTC m=+99.901724290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-rzxnx" (UID: "8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 18:12:02.436087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.435969    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxq2x" event={"ID":"f1e30d6f-b96e-4ca3-966e-a320f5155356","Type":"ContainerStarted","Data":"ab44b1a152c895331f5e777873892e91523206b5e4b4a6f626140de7349ea9e5"}
Sep 11 18:12:02.436087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.436031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxq2x" event={"ID":"f1e30d6f-b96e-4ca3-966e-a320f5155356","Type":"ContainerStarted","Data":"c8aa1a54b74b047df30f2bfcbc4d96922a7e491ac5e2e48cba221fa21eb5ab60"}
Sep 11 18:12:02.475469 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.475418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zxq2x" podStartSLOduration=65.383270965 podStartE2EDuration="1m7.475400125s" totalImagesPullingTime="2.09212916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:02.474377915 +0000 UTC m=+99.895152319" watchObservedRunningTime="2026-09-11 18:12:02.475400125 +0000 UTC m=+99.896174528"
Sep 11 18:12:02.484637 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.484605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rzxnx\" (UID: \"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:02.486975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.486946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rzxnx\" (UID: \"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:02.694680 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.694596    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:02.975349 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:02.975273    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"]
Sep 11 18:12:03.335331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.335229    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:03.339703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.339677    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.342276 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342253    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gl25p\""
Sep 11 18:12:03.342421 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342324    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 18:12:03.342421 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342355    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 18:12:03.342518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342480    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 18:12:03.342736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342690    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 18:12:03.342860 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.342819    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 18:12:03.356201 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.356173    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:03.390983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.390950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.390983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.390994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7nk\" (UniqueName: \"kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.391203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.391104    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.391203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.391119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.391203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.391137    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.391203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.391162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.440150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.440116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx" event={"ID":"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94","Type":"ContainerStarted","Data":"23e79fc283e8960a4799d6da6c7d7c9bf6a74387fbc2c4c36befec13c3e7589e"}
Sep 11 18:12:03.440299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.440249    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:12:03.492359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7nk\" (UniqueName: \"kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.492530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.492530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.492530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492440    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.492530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.492530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.492518    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.493178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.493151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.493285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.493205    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.493285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.493253    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.494754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.494738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.494842 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.494820    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.501750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.501730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7nk\" (UniqueName: \"kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk\") pod \"console-656db9ffcd-9skz8\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") " pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.650663 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.650583    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:03.935897 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:03.935855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:03.940556 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:03.940527    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84cde13_e6b7_40cb_9dd8_9253d7cfb2c0.slice/crio-69d4c64ff897f3aab404e90f4b2bac8edcd1cc08f474023f539f5c6a78df7a3c WatchSource:0}: Error finding container 69d4c64ff897f3aab404e90f4b2bac8edcd1cc08f474023f539f5c6a78df7a3c: Status 404 returned error can't find the container with id 69d4c64ff897f3aab404e90f4b2bac8edcd1cc08f474023f539f5c6a78df7a3c
Sep 11 18:12:04.316875 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.315778    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:04.319121 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.319095    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.326164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.326134    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 18:12:04.334214 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.334187    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:04.401484 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401438    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401490    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fzw\" (UniqueName: \"kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401719    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.401846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.401755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.446885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.446805    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656db9ffcd-9skz8" event={"ID":"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0","Type":"ContainerStarted","Data":"69d4c64ff897f3aab404e90f4b2bac8edcd1cc08f474023f539f5c6a78df7a3c"}
Sep 11 18:12:04.503032 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.502998    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58fzw\" (UniqueName: \"kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503101    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503154    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.503807 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.503763    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.504466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.504175    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.504466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.504272    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.504466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.504286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.506061 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.506032    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.506236 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.506209    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.514989 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.514964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fzw\" (UniqueName: \"kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw\") pod \"console-b8c9fcfbc-gnh7d\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") " pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.631714 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.631684    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:04.921122 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:04.921086    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:04.923451 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:04.923424    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100f7795_cec6_4679_9abe_9aad5be82a74.slice/crio-4a74daacc529b509df5ff0b19a7ccfecefff8a5c631693cbebe5407f664e0f47 WatchSource:0}: Error finding container 4a74daacc529b509df5ff0b19a7ccfecefff8a5c631693cbebe5407f664e0f47: Status 404 returned error can't find the container with id 4a74daacc529b509df5ff0b19a7ccfecefff8a5c631693cbebe5407f664e0f47
Sep 11 18:12:05.456767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.456318    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx" event={"ID":"8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94","Type":"ContainerStarted","Data":"833561e01ab2f5f9377724cea577c5cd0e5732411b4a0828bc3623ea2ce651d2"}
Sep 11 18:12:05.456767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.456587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:05.458839 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.458753    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9fcfbc-gnh7d" event={"ID":"100f7795-cec6-4679-9abe-9aad5be82a74","Type":"ContainerStarted","Data":"4a74daacc529b509df5ff0b19a7ccfecefff8a5c631693cbebe5407f664e0f47"}
Sep 11 18:12:05.462848 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.462803    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx"
Sep 11 18:12:05.488597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.488537    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rzxnx" podStartSLOduration=2.910516758 podStartE2EDuration="4.488516961s" totalImagesPullingTime="1.578000203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:05.485050105 +0000 UTC m=+102.905824512" watchObservedRunningTime="2026-09-11 18:12:05.488516961 +0000 UTC m=+102.909291363"
Sep 11 18:12:05.893523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.892817    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"]
Sep 11 18:12:05.897904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.897879    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:05.900445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.900289    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 18:12:05.900445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.900274    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 18:12:05.900445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.900359    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 18:12:05.901598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.900938    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j6v5k\""
Sep 11 18:12:05.901598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.901036    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 18:12:05.901598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.901170    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 18:12:05.912375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:05.912309    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"]
Sep 11 18:12:06.015170 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.015131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.015359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.015254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.015359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.015317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.015359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.015351    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5wpw\" (UniqueName: \"kubernetes.io/projected/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-kube-api-access-m5wpw\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.116596 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.116554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.116769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.116604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.116769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.116633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5wpw\" (UniqueName: \"kubernetes.io/projected/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-kube-api-access-m5wpw\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.116769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.116679    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.117480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.117455    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.120004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.119930    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.120756 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.120727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.126153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.126127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5wpw\" (UniqueName: \"kubernetes.io/projected/ca13b8e6-e9fd-4407-a4e6-43d23fa5f128-kube-api-access-m5wpw\") pod \"prometheus-operator-68bcd7f987-rqctp\" (UID: \"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.210310 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.210274    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"
Sep 11 18:12:06.336496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.336467    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tgthz"
Sep 11 18:12:06.516694 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:06.516516    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqctp"]
Sep 11 18:12:06.522741 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:06.522706    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca13b8e6_e9fd_4407_a4e6_43d23fa5f128.slice/crio-e2bb15f92cbb84003e4d81c34e54337a5a5bf6affba89f7754507b44d52d412a WatchSource:0}: Error finding container e2bb15f92cbb84003e4d81c34e54337a5a5bf6affba89f7754507b44d52d412a: Status 404 returned error can't find the container with id e2bb15f92cbb84003e4d81c34e54337a5a5bf6affba89f7754507b44d52d412a
Sep 11 18:12:07.470328 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:07.470185    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp" event={"ID":"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128","Type":"ContainerStarted","Data":"e2bb15f92cbb84003e4d81c34e54337a5a5bf6affba89f7754507b44d52d412a"}
Sep 11 18:12:08.475774 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:08.475732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9fcfbc-gnh7d" event={"ID":"100f7795-cec6-4679-9abe-9aad5be82a74","Type":"ContainerStarted","Data":"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"}
Sep 11 18:12:08.477533 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:08.477502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656db9ffcd-9skz8" event={"ID":"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0","Type":"ContainerStarted","Data":"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"}
Sep 11 18:12:08.502624 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:08.502453    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8c9fcfbc-gnh7d" podStartSLOduration=1.207348404 podStartE2EDuration="4.502433062s" totalImagesPullingTime="3.295084658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:08.501757988 +0000 UTC m=+105.922532392" watchObservedRunningTime="2026-09-11 18:12:08.502433062 +0000 UTC m=+105.923207466"
Sep 11 18:12:08.522007 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:08.521850    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-656db9ffcd-9skz8" podStartSLOduration=1.252026399 podStartE2EDuration="5.521830847s" totalImagesPullingTime="4.269804448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:08.521433397 +0000 UTC m=+105.942207800" watchObservedRunningTime="2026-09-11 18:12:08.521830847 +0000 UTC m=+105.942605243"
Sep 11 18:12:10.488947 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:10.488905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp" event={"ID":"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128","Type":"ContainerStarted","Data":"83bcdd6771558590f6f8c186d928916983e7b6166b85d2a5672a018ca4c1e6fb"}
Sep 11 18:12:10.489348 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:10.488972    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp" event={"ID":"ca13b8e6-e9fd-4407-a4e6-43d23fa5f128","Type":"ContainerStarted","Data":"cd639e72388ccddcd638a6328f3cb5493aa514cb85d205e0cd76d3f7b140b86c"}
Sep 11 18:12:10.546645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:10.546582    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqctp" podStartSLOduration=2.415796276 podStartE2EDuration="5.546565481s" totalImagesPullingTime="3.130769205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:10.545668308 +0000 UTC m=+107.966442712" watchObservedRunningTime="2026-09-11 18:12:10.546565481 +0000 UTC m=+107.967339884"
Sep 11 18:12:12.284512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.284474    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xk4fl"]
Sep 11 18:12:12.287781 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.287747    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.290563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.290536    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xkt9g\""
Sep 11 18:12:12.290691 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.290613    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 18:12:12.290691 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.290613    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 18:12:12.290691 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.290676    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 18:12:12.377105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-accelerators-collector-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-sys\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-wtmp\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377253    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-root\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377464 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-metrics-client-ca\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377464 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-tls\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377464 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377395    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfwjr\" (UniqueName: \"kubernetes.io/projected/0df16cc1-41f4-432e-b11e-cb991e4d2281-kube-api-access-bfwjr\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.377464 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.377428    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-textfile\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478540 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-accelerators-collector-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-sys\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-sys\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478632    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-wtmp\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.478727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-root\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-metrics-client-ca\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-tls\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfwjr\" (UniqueName: \"kubernetes.io/projected/0df16cc1-41f4-432e-b11e-cb991e4d2281-kube-api-access-bfwjr\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478825    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-wtmp\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-textfile\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.478848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0df16cc1-41f4-432e-b11e-cb991e4d2281-root\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.479149    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-accelerators-collector-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.479162    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-textfile\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.479374 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.479276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df16cc1-41f4-432e-b11e-cb991e4d2281-metrics-client-ca\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.481556 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.481532    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.481663 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.481532    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0df16cc1-41f4-432e-b11e-cb991e4d2281-node-exporter-tls\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.492780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.492759    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfwjr\" (UniqueName: \"kubernetes.io/projected/0df16cc1-41f4-432e-b11e-cb991e4d2281-kube-api-access-bfwjr\") pod \"node-exporter-xk4fl\" (UID: \"0df16cc1-41f4-432e-b11e-cb991e4d2281\") " pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:12.599243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:12.599167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xk4fl"
Sep 11 18:12:13.331981 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.331947    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:12:13.336400 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.336376    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.364069 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.364039    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:12:13.364902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.364877    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 18:12:13.365296 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.365275    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 18:12:13.365490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.365463    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 18:12:13.365921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.365675    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 18:12:13.366010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.365956    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zsz9r\""
Sep 11 18:12:13.366120 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.366101    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 18:12:13.366250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.366233    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 18:12:13.366350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.366328    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 18:12:13.366458 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.366369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 18:12:13.366627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.366600    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 18:12:13.448827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.448765    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zxq2x"
Sep 11 18:12:13.488194 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488216    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488363    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488506    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488584    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpqbs\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488671    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.488728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.488698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590005    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590191    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590824    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590843    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpqbs\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590913    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.590974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.590947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.591489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.591008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.593063 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:13.592088    2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 11 18:12:13.593063 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:13.592163    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls podName:5667b759-e913-4b79-a1e1-5e86a6b68f75 nodeName:}" failed. No retries permitted until 2026-09-11 18:12:14.09214465 +0000 UTC m=+111.512919055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75") : secret "alertmanager-main-tls" not found
Sep 11 18:12:13.593063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.592606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.593409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.593362    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.593597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.593576    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.594370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.594230    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.594370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.594358    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.594585 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.594567    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.594636 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.594596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.595877 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.595854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.596375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.596323    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.596375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.596333    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.603741 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.603695    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpqbs\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:13.651107 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.651072    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:13.651272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.651148    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:13.652493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.652454    2566 patch_prober.go:28] interesting pod/console-656db9ffcd-9skz8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Sep 11 18:12:13.652615 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:13.652499    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-656db9ffcd-9skz8" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Sep 11 18:12:14.096486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.096445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:14.099221 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.099196    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:14.246555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.246513    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:12:14.632581 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.632542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:14.633076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.632613    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:14.633997 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.633966    2566 patch_prober.go:28] interesting pod/console-b8c9fcfbc-gnh7d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body=
Sep 11 18:12:14.634139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:14.634020    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b8c9fcfbc-gnh7d" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused"
Sep 11 18:12:16.651426 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.651385    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bf678549f-l62qs"]
Sep 11 18:12:16.655439 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.655412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.658286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658265    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8b2u0mtggl9ir\""
Sep 11 18:12:16.658395 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658380    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 18:12:16.658471 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658411    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j9c6t\""
Sep 11 18:12:16.658471 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658446    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 18:12:16.658574 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658508    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 18:12:16.658743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.658724    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 18:12:16.671462 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.671433    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bf678549f-l62qs"]
Sep 11 18:12:16.820336 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820298    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-metrics-server-audit-profiles\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmw9q\" (UniqueName: \"kubernetes.io/projected/a48f6674-31fe-4699-a4cb-68fe0b401285-kube-api-access-dmw9q\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-tls\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820582 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820485    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-client-certs\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820582 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820582 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a48f6674-31fe-4699-a4cb-68fe0b401285-audit-log\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.820692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.820613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-client-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921077 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921045    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-client-certs\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921090    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a48f6674-31fe-4699-a4cb-68fe0b401285-audit-log\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-client-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921200    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-metrics-server-audit-profiles\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmw9q\" (UniqueName: \"kubernetes.io/projected/a48f6674-31fe-4699-a4cb-68fe0b401285-kube-api-access-dmw9q\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921498 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-tls\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921590    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a48f6674-31fe-4699-a4cb-68fe0b401285-audit-log\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.921933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.921902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.922500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.922472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a48f6674-31fe-4699-a4cb-68fe0b401285-metrics-server-audit-profiles\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.924183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.924127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-client-certs\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.924279 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.924185    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-client-ca-bundle\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.924279 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.924245    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a48f6674-31fe-4699-a4cb-68fe0b401285-secret-metrics-server-tls\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.929128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.929106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmw9q\" (UniqueName: \"kubernetes.io/projected/a48f6674-31fe-4699-a4cb-68fe0b401285-kube-api-access-dmw9q\") pod \"metrics-server-5bf678549f-l62qs\" (UID: \"a48f6674-31fe-4699-a4cb-68fe0b401285\") " pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:16.967201 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:16.967153    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:17.067676 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.067648    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"]
Sep 11 18:12:17.070038 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.070012    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.072442 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.072421    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 18:12:17.072583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.072567    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kzks6\""
Sep 11 18:12:17.081098 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.081074    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"]
Sep 11 18:12:17.088500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.088473    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:17.122467 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.122430    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:17.124883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.124860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.138195 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.138160    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:17.223523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223440    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223481    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnrv\" (UniqueName: \"kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223547    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223603    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqz2\" (UniqueName: \"kubernetes.io/projected/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-kube-api-access-xbqz2\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223638    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.223819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.223753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.324727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324695    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.324727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnrv\" (UniqueName: \"kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.324958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324827    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.324958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqz2\" (UniqueName: \"kubernetes.io/projected/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-kube-api-access-xbqz2\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.324958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.324958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.325153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.325153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.324991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.325153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.325017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.325523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.325464    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.325765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.325674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.326076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.326054    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.326177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.326080    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.327907 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.327883    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.328003 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.327887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.328115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.328092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.332642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.332612    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnrv\" (UniqueName: \"kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv\") pod \"console-667b76d4dc-8rbrg\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") " pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:17.333144 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.333128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqz2\" (UniqueName: \"kubernetes.io/projected/6d25f6a7-69b9-45a6-b4e8-b69546d7c644-kube-api-access-xbqz2\") pod \"monitoring-plugin-5d85778b9d-gjmqp\" (UID: \"6d25f6a7-69b9-45a6-b4e8-b69546d7c644\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.381988 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.381950    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:17.434588 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:17.434556    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:19.000138 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:18.999771    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df16cc1_41f4_432e_b11e_cb991e4d2281.slice/crio-2e528e4d570c5126a6c155cc2f9c494124c511247d258583958b5bb126fb97b9 WatchSource:0}: Error finding container 2e528e4d570c5126a6c155cc2f9c494124c511247d258583958b5bb126fb97b9: Status 404 returned error can't find the container with id 2e528e4d570c5126a6c155cc2f9c494124c511247d258583958b5bb126fb97b9
Sep 11 18:12:19.267033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.266886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:12:19.271465 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:19.271435    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5667b759_e913_4b79_a1e1_5e86a6b68f75.slice/crio-2ac7e766fe97dd3bbfc8d627deff3b579c9fb42f89f06d1833d98bdd9bc68af6 WatchSource:0}: Error finding container 2ac7e766fe97dd3bbfc8d627deff3b579c9fb42f89f06d1833d98bdd9bc68af6: Status 404 returned error can't find the container with id 2ac7e766fe97dd3bbfc8d627deff3b579c9fb42f89f06d1833d98bdd9bc68af6
Sep 11 18:12:19.290202 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.290138    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:19.293506 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:19.293465    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78788ab8_92de_4be5_9fc8_103f328d1a23.slice/crio-d2592c1ae269afc1cdc2a845d065a29f9fe7a34a56d77dc2b48e8c22902d0590 WatchSource:0}: Error finding container d2592c1ae269afc1cdc2a845d065a29f9fe7a34a56d77dc2b48e8c22902d0590: Status 404 returned error can't find the container with id d2592c1ae269afc1cdc2a845d065a29f9fe7a34a56d77dc2b48e8c22902d0590
Sep 11 18:12:19.297482 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.297434    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"]
Sep 11 18:12:19.300092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.300070    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bf678549f-l62qs"]
Sep 11 18:12:19.300748 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:19.300723    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d25f6a7_69b9_45a6_b4e8_b69546d7c644.slice/crio-1d43163d41dcb0b64e04da525b3b2722dddbc2842cd5e164442c44f3873e2e52 WatchSource:0}: Error finding container 1d43163d41dcb0b64e04da525b3b2722dddbc2842cd5e164442c44f3873e2e52: Status 404 returned error can't find the container with id 1d43163d41dcb0b64e04da525b3b2722dddbc2842cd5e164442c44f3873e2e52
Sep 11 18:12:19.303724 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:19.303581    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48f6674_31fe_4699_a4cb_68fe0b401285.slice/crio-c4c606c59dd9f1022a253cf4d324d6ca57e3cab9c6968601068dd71eccfec77a WatchSource:0}: Error finding container c4c606c59dd9f1022a253cf4d324d6ca57e3cab9c6968601068dd71eccfec77a: Status 404 returned error can't find the container with id c4c606c59dd9f1022a253cf4d324d6ca57e3cab9c6968601068dd71eccfec77a
Sep 11 18:12:19.530576 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.530443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs" event={"ID":"a48f6674-31fe-4699-a4cb-68fe0b401285","Type":"ContainerStarted","Data":"c4c606c59dd9f1022a253cf4d324d6ca57e3cab9c6968601068dd71eccfec77a"}
Sep 11 18:12:19.533432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.532958    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b76d4dc-8rbrg" event={"ID":"78788ab8-92de-4be5-9fc8-103f328d1a23","Type":"ContainerStarted","Data":"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"}
Sep 11 18:12:19.533432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.533047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b76d4dc-8rbrg" event={"ID":"78788ab8-92de-4be5-9fc8-103f328d1a23","Type":"ContainerStarted","Data":"d2592c1ae269afc1cdc2a845d065a29f9fe7a34a56d77dc2b48e8c22902d0590"}
Sep 11 18:12:19.534635 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.534565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"2ac7e766fe97dd3bbfc8d627deff3b579c9fb42f89f06d1833d98bdd9bc68af6"}
Sep 11 18:12:19.536767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.536682    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7qqqh" event={"ID":"03eb6d06-5c71-468d-a646-4a4b6eb18e54","Type":"ContainerStarted","Data":"43aa5dd96adf53cb42be1ccb134319c1eb9ffdab98d482753a73556c009f6048"}
Sep 11 18:12:19.537264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.537218    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:19.539389 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.539364    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp" event={"ID":"6d25f6a7-69b9-45a6-b4e8-b69546d7c644","Type":"ContainerStarted","Data":"1d43163d41dcb0b64e04da525b3b2722dddbc2842cd5e164442c44f3873e2e52"}
Sep 11 18:12:19.540703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.540677    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xk4fl" event={"ID":"0df16cc1-41f4-432e-b11e-cb991e4d2281","Type":"ContainerStarted","Data":"2e528e4d570c5126a6c155cc2f9c494124c511247d258583958b5bb126fb97b9"}
Sep 11 18:12:19.547691 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.547646    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-7qqqh"
Sep 11 18:12:19.555026 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.554291    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-667b76d4dc-8rbrg" podStartSLOduration=2.554272141 podStartE2EDuration="2.554272141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:19.55343653 +0000 UTC m=+116.974210955" watchObservedRunningTime="2026-09-11 18:12:19.554272141 +0000 UTC m=+116.975046541"
Sep 11 18:12:19.573112 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:19.571597    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-7qqqh" podStartSLOduration=1.685671696 podStartE2EDuration="19.571576348s" totalImagesPullingTime="17.885904652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:19.570117347 +0000 UTC m=+116.990891751" watchObservedRunningTime="2026-09-11 18:12:19.571576348 +0000 UTC m=+116.992350751"
Sep 11 18:12:21.554837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.554767    2566 generic.go:356] "Generic (PLEG): container finished" podID="0df16cc1-41f4-432e-b11e-cb991e4d2281" containerID="cd2786688f08533a88bbfcccc29115afa17ddda6a201b747eb8b22a5bc057ade" exitCode=0
Sep 11 18:12:21.555763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.555673    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xk4fl" event={"ID":"0df16cc1-41f4-432e-b11e-cb991e4d2281","Type":"ContainerDied","Data":"cd2786688f08533a88bbfcccc29115afa17ddda6a201b747eb8b22a5bc057ade"}
Sep 11 18:12:21.687738 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.687703    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:21.725188 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.725156    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:12:21.745843 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.745807    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:12:21.746667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.746008    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.873635 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.873840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx48l\" (UniqueName: \"kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.873840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873722    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.873840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.873840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873834    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.874051 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.873978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.874051 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.874003    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.974940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.974904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.974940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.974943    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.974980    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.975007    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx48l\" (UniqueName: \"kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.975035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.975063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.975093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.975837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.975808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.976178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.976131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.976178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.976145    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.976342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.976320    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.977867 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.977841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.978048 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.978026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:21.984021 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:21.983995    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx48l\" (UniqueName: \"kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l\") pod \"console-557c48498c-q6gs7\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") " pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:22.058438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:22.058356    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:22.774101 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:22.773186    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:12:22.778444 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:22.778405    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode198f511_39a5_48d0_ad59_8a4f1e72c900.slice/crio-6a1f7bd29477b43ddf14d0bbf7adc02d8b1b56abf9e4eac20cad364bab5c2c53 WatchSource:0}: Error finding container 6a1f7bd29477b43ddf14d0bbf7adc02d8b1b56abf9e4eac20cad364bab5c2c53: Status 404 returned error can't find the container with id 6a1f7bd29477b43ddf14d0bbf7adc02d8b1b56abf9e4eac20cad364bab5c2c53
Sep 11 18:12:23.578485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.578447    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c48498c-q6gs7" event={"ID":"e198f511-39a5-48d0-ad59-8a4f1e72c900","Type":"ContainerStarted","Data":"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"}
Sep 11 18:12:23.578648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.578547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c48498c-q6gs7" event={"ID":"e198f511-39a5-48d0-ad59-8a4f1e72c900","Type":"ContainerStarted","Data":"6a1f7bd29477b43ddf14d0bbf7adc02d8b1b56abf9e4eac20cad364bab5c2c53"}
Sep 11 18:12:23.580457 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.580426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs" event={"ID":"a48f6674-31fe-4699-a4cb-68fe0b401285","Type":"ContainerStarted","Data":"e49f88075528c99f585ec0e300cd0db41e9907e0cb4fe3d821ad0b71f23547f3"}
Sep 11 18:12:23.582345 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.582318    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee" exitCode=0
Sep 11 18:12:23.582473 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.582400    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee"}
Sep 11 18:12:23.584243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.584192    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp" event={"ID":"6d25f6a7-69b9-45a6-b4e8-b69546d7c644","Type":"ContainerStarted","Data":"9eb9d896f5c293f78a00fd997d9a88b3d01fa3e9de388e387571d5ffe5c2e8ad"}
Sep 11 18:12:23.584533 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.584508    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:23.586831 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.586803    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xk4fl" event={"ID":"0df16cc1-41f4-432e-b11e-cb991e4d2281","Type":"ContainerStarted","Data":"87e03d0f4f21d42099e7bd6d02d32a4d9e665b6a61c4d7000077b9b98bf0db12"}
Sep 11 18:12:23.586926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.586858    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xk4fl" event={"ID":"0df16cc1-41f4-432e-b11e-cb991e4d2281","Type":"ContainerStarted","Data":"9f76c785720482d7d993b700acb7f24e31e97a5bc2c37899e5832f48acb8aacb"}
Sep 11 18:12:23.589958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.589940    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp"
Sep 11 18:12:23.602174 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.602129    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557c48498c-q6gs7" podStartSLOduration=2.6020945749999997 podStartE2EDuration="2.602094575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:23.600401896 +0000 UTC m=+121.021176300" watchObservedRunningTime="2026-09-11 18:12:23.602094575 +0000 UTC m=+121.022868978"
Sep 11 18:12:23.625096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.625048    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xk4fl" podStartSLOduration=9.763633637 podStartE2EDuration="11.625018982s" totalImagesPullingTime="1.776156334s" totalInitContainerRuntime="85.229011ms" isStatefulPod=true podCreationTimestamp="2026-09-11 18:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:23.622932918 +0000 UTC m=+121.043707320" watchObservedRunningTime="2026-09-11 18:12:23.625018982 +0000 UTC m=+121.045793386"
Sep 11 18:12:23.642386 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.642338    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs" podStartSLOduration=4.463721628 podStartE2EDuration="7.642323926s" totalImagesPullingTime="3.178602298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:23.640768802 +0000 UTC m=+121.061543233" watchObservedRunningTime="2026-09-11 18:12:23.642323926 +0000 UTC m=+121.063098327"
Sep 11 18:12:23.658743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:23.658686    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gjmqp" podStartSLOduration=3.479653314 podStartE2EDuration="6.6586664s" totalImagesPullingTime="3.179013086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:23.656874468 +0000 UTC m=+121.077648870" watchObservedRunningTime="2026-09-11 18:12:23.6586664 +0000 UTC m=+121.079440804"
Sep 11 18:12:26.605772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:26.605732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"}
Sep 11 18:12:26.606212 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:26.605868    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"}
Sep 11 18:12:26.606212 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:26.605900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"}
Sep 11 18:12:26.606212 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:26.605927    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"}
Sep 11 18:12:26.606212 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:26.605966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"}
Sep 11 18:12:27.435408 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:27.435368    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:27.435583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:27.435447    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:27.441004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:27.440981    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:27.615234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:27.615200    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:28.618440 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:28.618407    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerStarted","Data":"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"}
Sep 11 18:12:28.667265 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:28.667217    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.043500824 podStartE2EDuration="15.667201025s" totalImagesPullingTime="6.60218375s" totalInitContainerRuntime="21.516451ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:12:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:28.665886072 +0000 UTC m=+126.086660474" watchObservedRunningTime="2026-09-11 18:12:28.667201025 +0000 UTC m=+126.087975457"
Sep 11 18:12:32.058737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.058694    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:32.059214 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.058760    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:32.063916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.063891    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:32.638554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.638520    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:12:32.727002 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.726972    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:32.885568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.885531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:12:32.887714 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:32.887694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c68290e-6a0d-42af-856a-a125def872d1-metrics-certs\") pod \"network-metrics-daemon-9976f\" (UID: \"7c68290e-6a0d-42af-856a-a125def872d1\") " pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:12:33.068211 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:33.068180    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvnsl\""
Sep 11 18:12:33.077089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:33.077061    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9976f"
Sep 11 18:12:33.394156 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:33.394076    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9976f"]
Sep 11 18:12:33.398472 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:12:33.398443    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c68290e_6a0d_42af_856a_a125def872d1.slice/crio-403b5ceca7623fe09c66e1e7a260bc770904e5c8463a4a621ab8fb7224682d6d WatchSource:0}: Error finding container 403b5ceca7623fe09c66e1e7a260bc770904e5c8463a4a621ab8fb7224682d6d: Status 404 returned error can't find the container with id 403b5ceca7623fe09c66e1e7a260bc770904e5c8463a4a621ab8fb7224682d6d
Sep 11 18:12:33.641080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:33.641033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9976f" event={"ID":"7c68290e-6a0d-42af-856a-a125def872d1","Type":"ContainerStarted","Data":"403b5ceca7623fe09c66e1e7a260bc770904e5c8463a4a621ab8fb7224682d6d"}
Sep 11 18:12:35.651802 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:35.651757    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9976f" event={"ID":"7c68290e-6a0d-42af-856a-a125def872d1","Type":"ContainerStarted","Data":"d28d2f5996d28f1c9680c4b54277a95832fcc9966cbedbb79fabfee4a4c31c2f"}
Sep 11 18:12:35.652233 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:35.651845    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9976f" event={"ID":"7c68290e-6a0d-42af-856a-a125def872d1","Type":"ContainerStarted","Data":"6154123142bcdce7b6a7c6d67d9f1ccde3153ddb7579fbfc771240f4b3d02460"}
Sep 11 18:12:35.680803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:35.680728    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9976f" podStartSLOduration=131.229490723 podStartE2EDuration="2m12.680712537s" totalImagesPullingTime="1.451221814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:12:35.680491727 +0000 UTC m=+133.101266131" watchObservedRunningTime="2026-09-11 18:12:35.680712537 +0000 UTC m=+133.101486940"
Sep 11 18:12:36.967260 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:36.967227    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:36.967705 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:36.967310    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:42.110459 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.110396    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-656db9ffcd-9skz8" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerName="console" containerID="cri-o://634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca" gracePeriod=15
Sep 11 18:12:42.380076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.380012    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:42.472732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472693    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.472949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.472949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472851    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7nk\" (UniqueName: \"kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.472949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472884    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.472949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472914    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.472949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.472942    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config\") pod \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\" (UID: \"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0\") "
Sep 11 18:12:42.473200 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.473154    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:42.473367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.473332    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:42.473367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.473353    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.473491 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.473389    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config" (OuterVolumeSpecName: "console-config") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:42.475083 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.475053    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:42.475422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.475398    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:42.475476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.475418    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk" (OuterVolumeSpecName: "kube-api-access-dn7nk") pod "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" (UID: "d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0"). InnerVolumeSpecName "kube-api-access-dn7nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:12:42.574079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.574041    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.574079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.574074    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7nk\" (UniqueName: \"kubernetes.io/projected/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-kube-api-access-dn7nk\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.574079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.574083    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-oauth-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.574326 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.574091    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-oauth-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.574326 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.574099    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0-console-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:42.681631 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.681600    2566 generic.go:356] "Generic (PLEG): container finished" podID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerID="634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca" exitCode=0
Sep 11 18:12:42.681851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.681648    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656db9ffcd-9skz8"
Sep 11 18:12:42.681851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.681662    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656db9ffcd-9skz8" event={"ID":"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0","Type":"ContainerDied","Data":"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"}
Sep 11 18:12:42.681851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.681726    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656db9ffcd-9skz8" event={"ID":"d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0","Type":"ContainerDied","Data":"69d4c64ff897f3aab404e90f4b2bac8edcd1cc08f474023f539f5c6a78df7a3c"}
Sep 11 18:12:42.681851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.681746    2566 scope.go:117] "RemoveContainer" containerID="634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"
Sep 11 18:12:42.689781 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.689767    2566 scope.go:117] "RemoveContainer" containerID="634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"
Sep 11 18:12:42.690062 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:42.690045    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca\": container with ID starting with 634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca not found: ID does not exist" containerID="634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"
Sep 11 18:12:42.690113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.690069    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca"} err="failed to get container status \"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca\": rpc error: code = NotFound desc = could not find container \"634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca\": container with ID starting with 634818534d9996be733accbd80c480c38283cb3981407b3ef386df09048320ca not found: ID does not exist"
Sep 11 18:12:42.710924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.710898    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:42.717713 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:42.717690    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-656db9ffcd-9skz8"]
Sep 11 18:12:43.059723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:43.059650    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" path="/var/lib/kubelet/pods/d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0/volumes"
Sep 11 18:12:46.712261 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:46.712205    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b8c9fcfbc-gnh7d" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" containerName="console" containerID="cri-o://a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d" gracePeriod=15
Sep 11 18:12:46.956407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:46.956369    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:47.008010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.007924    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.007976    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58fzw\" (UniqueName: \"kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008009    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008029    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008072    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008097    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008122    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config\") pod \"100f7795-cec6-4679-9abe-9aad5be82a74\" (UID: \"100f7795-cec6-4679-9abe-9aad5be82a74\") "
Sep 11 18:12:47.008600 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008477    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca" (OuterVolumeSpecName: "service-ca") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:47.008600 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008587    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:47.008840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.008630    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config" (OuterVolumeSpecName: "console-config") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:47.009030 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.009006    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:47.010340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.010315    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw" (OuterVolumeSpecName: "kube-api-access-58fzw") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "kube-api-access-58fzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:12:47.010566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.010543    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:47.010566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.010555    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "100f7795-cec6-4679-9abe-9aad5be82a74" (UID: "100f7795-cec6-4679-9abe-9aad5be82a74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:47.109501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109468    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-oauth-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109497    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-console-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109507    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109516    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58fzw\" (UniqueName: \"kubernetes.io/projected/100f7795-cec6-4679-9abe-9aad5be82a74-kube-api-access-58fzw\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109526    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109534    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/100f7795-cec6-4679-9abe-9aad5be82a74-console-oauth-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.109724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.109542    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100f7795-cec6-4679-9abe-9aad5be82a74-trusted-ca-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:47.703343 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.703311    2566 generic.go:356] "Generic (PLEG): container finished" podID="100f7795-cec6-4679-9abe-9aad5be82a74" containerID="a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d" exitCode=0
Sep 11 18:12:47.703547 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.703359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9fcfbc-gnh7d" event={"ID":"100f7795-cec6-4679-9abe-9aad5be82a74","Type":"ContainerDied","Data":"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"}
Sep 11 18:12:47.703547 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.703362    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9fcfbc-gnh7d"
Sep 11 18:12:47.703547 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.703398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9fcfbc-gnh7d" event={"ID":"100f7795-cec6-4679-9abe-9aad5be82a74","Type":"ContainerDied","Data":"4a74daacc529b509df5ff0b19a7ccfecefff8a5c631693cbebe5407f664e0f47"}
Sep 11 18:12:47.703547 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.703418    2566 scope.go:117] "RemoveContainer" containerID="a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"
Sep 11 18:12:47.712130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.712107    2566 scope.go:117] "RemoveContainer" containerID="a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"
Sep 11 18:12:47.712428 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:47.712408    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d\": container with ID starting with a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d not found: ID does not exist" containerID="a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"
Sep 11 18:12:47.712667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.712435    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d"} err="failed to get container status \"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d\": rpc error: code = NotFound desc = could not find container \"a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d\": container with ID starting with a8b593d63e40037b9004fc95d3d35dad8defab8090a0d48e810948fcf5e3e88d not found: ID does not exist"
Sep 11 18:12:47.722232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.722206    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:47.732732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:47.732691    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8c9fcfbc-gnh7d"]
Sep 11 18:12:49.060032 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:49.060003    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" path="/var/lib/kubelet/pods/100f7795-cec6-4679-9abe-9aad5be82a74/volumes"
Sep 11 18:12:56.972451 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:56.972422    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:56.976221 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:56.976202    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bf678549f-l62qs"
Sep 11 18:12:57.746902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:57.746832    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-667b76d4dc-8rbrg" podUID="78788ab8-92de-4be5-9fc8-103f328d1a23" containerName="console" containerID="cri-o://dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d" gracePeriod=15
Sep 11 18:12:58.039206 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.039177    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:58.206095 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206058    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qnrv\" (UniqueName: \"kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206105    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206138    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206167    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206196    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206229    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206254    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config\") pod \"78788ab8-92de-4be5-9fc8-103f328d1a23\" (UID: \"78788ab8-92de-4be5-9fc8-103f328d1a23\") "
Sep 11 18:12:58.206638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206602    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca" (OuterVolumeSpecName: "service-ca") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:58.206729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206643    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:58.206729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206659    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config" (OuterVolumeSpecName: "console-config") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:58.206729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.206709    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:12:58.208280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.208250    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv" (OuterVolumeSpecName: "kube-api-access-5qnrv") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "kube-api-access-5qnrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:12:58.208380 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.208333    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:58.208380 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.208371    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78788ab8-92de-4be5-9fc8-103f328d1a23" (UID: "78788ab8-92de-4be5-9fc8-103f328d1a23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307483    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qnrv\" (UniqueName: \"kubernetes.io/projected/78788ab8-92de-4be5-9fc8-103f328d1a23-kube-api-access-5qnrv\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307511    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-console-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307520    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307528    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-oauth-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307537    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307545    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78788ab8-92de-4be5-9fc8-103f328d1a23-trusted-ca-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.307560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.307553    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78788ab8-92de-4be5-9fc8-103f328d1a23-console-oauth-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:12:58.750763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.750728    2566 generic.go:356] "Generic (PLEG): container finished" podID="78788ab8-92de-4be5-9fc8-103f328d1a23" containerID="dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d" exitCode=0
Sep 11 18:12:58.750919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.750778    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b76d4dc-8rbrg"
Sep 11 18:12:58.750919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.750780    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b76d4dc-8rbrg" event={"ID":"78788ab8-92de-4be5-9fc8-103f328d1a23","Type":"ContainerDied","Data":"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"}
Sep 11 18:12:58.751004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.750922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b76d4dc-8rbrg" event={"ID":"78788ab8-92de-4be5-9fc8-103f328d1a23","Type":"ContainerDied","Data":"d2592c1ae269afc1cdc2a845d065a29f9fe7a34a56d77dc2b48e8c22902d0590"}
Sep 11 18:12:58.751004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.750943    2566 scope.go:117] "RemoveContainer" containerID="dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"
Sep 11 18:12:58.759385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.759366    2566 scope.go:117] "RemoveContainer" containerID="dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"
Sep 11 18:12:58.759652 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:12:58.759633    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d\": container with ID starting with dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d not found: ID does not exist" containerID="dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"
Sep 11 18:12:58.759696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.759661    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d"} err="failed to get container status \"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d\": rpc error: code = NotFound desc = could not find container \"dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d\": container with ID starting with dcbffe094bf87ac3d2ad630b850e9902c31ea65979ff48903ce280484132291d not found: ID does not exist"
Sep 11 18:12:58.777935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.777910    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:58.787213 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:58.787191    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-667b76d4dc-8rbrg"]
Sep 11 18:12:59.059543 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:12:59.059471    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78788ab8-92de-4be5-9fc8-103f328d1a23" path="/var/lib/kubelet/pods/78788ab8-92de-4be5-9fc8-103f328d1a23/volumes"
Sep 11 18:13:32.917933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.917892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:32.918417 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918309    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="alertmanager" containerID="cri-o://048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da" gracePeriod=120
Sep 11 18:13:32.918417 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918378    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-metric" containerID="cri-o://65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513" gracePeriod=120
Sep 11 18:13:32.918541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918401    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-web" containerID="cri-o://95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01" gracePeriod=120
Sep 11 18:13:32.918541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918414    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy" containerID="cri-o://fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3" gracePeriod=120
Sep 11 18:13:32.918541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918392    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="config-reloader" containerID="cri-o://aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7" gracePeriod=120
Sep 11 18:13:32.918700 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:32.918431    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="prom-label-proxy" containerID="cri-o://10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90" gracePeriod=120
Sep 11 18:13:33.890945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890912    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90" exitCode=0
Sep 11 18:13:33.890945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890935    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513" exitCode=0
Sep 11 18:13:33.890945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890941    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3" exitCode=0
Sep 11 18:13:33.890945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890947    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7" exitCode=0
Sep 11 18:13:33.890945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890952    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da" exitCode=0
Sep 11 18:13:33.891232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.890979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"}
Sep 11 18:13:33.891232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.891042    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"}
Sep 11 18:13:33.891232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.891068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"}
Sep 11 18:13:33.891232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.891090    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"}
Sep 11 18:13:33.891232 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:33.891114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"}
Sep 11 18:13:34.171470 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.171446    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:34.282569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282540    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282578    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282603    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282630    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282669    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.282737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282728    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282758    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpqbs\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282808    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282848    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282871    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282898    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.282930    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle\") pod \"5667b759-e913-4b79-a1e1-5e86a6b68f75\" (UID: \"5667b759-e913-4b79-a1e1-5e86a6b68f75\") "
Sep 11 18:13:34.283155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.283059    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:13:34.283485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.283210    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-main-db\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.283485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.283439    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:13:34.283587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.283549    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:13:34.285500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.285470    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.285898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.285872    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.286156 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.286107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs" (OuterVolumeSpecName: "kube-api-access-rpqbs") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "kube-api-access-rpqbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:13:34.286242 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.286172    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.286399 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.286366    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume" (OuterVolumeSpecName: "config-volume") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.286485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.286450    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out" (OuterVolumeSpecName: "config-out") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:13:34.286709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.286670    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.287325 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.287304    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:13:34.290183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.290067    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.296236 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.296216    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config" (OuterVolumeSpecName: "web-config") pod "5667b759-e913-4b79-a1e1-5e86a6b68f75" (UID: "5667b759-e913-4b79-a1e1-5e86a6b68f75"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:13:34.383949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383914    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-out\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.383949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383944    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.383949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383955    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383967    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-main-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383976    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-config-volume\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383984    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-cluster-tls-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.383992    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpqbs\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-kube-api-access-rpqbs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.384001    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.384010    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5667b759-e913-4b79-a1e1-5e86a6b68f75-tls-assets\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.384018    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-metrics-client-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.384026    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5667b759-e913-4b79-a1e1-5e86a6b68f75-web-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.384182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.384033    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5667b759-e913-4b79-a1e1-5e86a6b68f75-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:13:34.898759 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.898728    2566 generic.go:356] "Generic (PLEG): container finished" podID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerID="95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01" exitCode=0
Sep 11 18:13:34.898960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.898798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"}
Sep 11 18:13:34.898960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.898814    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:34.898960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.898874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5667b759-e913-4b79-a1e1-5e86a6b68f75","Type":"ContainerDied","Data":"2ac7e766fe97dd3bbfc8d627deff3b579c9fb42f89f06d1833d98bdd9bc68af6"}
Sep 11 18:13:34.898960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.898924    2566 scope.go:117] "RemoveContainer" containerID="10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"
Sep 11 18:13:34.909750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.908232    2566 scope.go:117] "RemoveContainer" containerID="65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"
Sep 11 18:13:34.916413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.916394    2566 scope.go:117] "RemoveContainer" containerID="fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"
Sep 11 18:13:34.922781 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.922763    2566 scope.go:117] "RemoveContainer" containerID="95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"
Sep 11 18:13:34.927500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.927479    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:34.929371 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.929349    2566 scope.go:117] "RemoveContainer" containerID="aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"
Sep 11 18:13:34.933416 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.933397    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:34.936318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.936303    2566 scope.go:117] "RemoveContainer" containerID="048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"
Sep 11 18:13:34.942964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.942948    2566 scope.go:117] "RemoveContainer" containerID="42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee"
Sep 11 18:13:34.949523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.949507    2566 scope.go:117] "RemoveContainer" containerID="10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"
Sep 11 18:13:34.949772 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.949752    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90\": container with ID starting with 10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90 not found: ID does not exist" containerID="10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"
Sep 11 18:13:34.949830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.949782    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90"} err="failed to get container status \"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90\": rpc error: code = NotFound desc = could not find container \"10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90\": container with ID starting with 10fb0c20c5b803bce6146ea9e9d809855621274d8a78cf21948bdb8b1a1f5b90 not found: ID does not exist"
Sep 11 18:13:34.949830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.949814    2566 scope.go:117] "RemoveContainer" containerID="65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"
Sep 11 18:13:34.950063 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.950050    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513\": container with ID starting with 65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513 not found: ID does not exist" containerID="65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"
Sep 11 18:13:34.950125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950067    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513"} err="failed to get container status \"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513\": rpc error: code = NotFound desc = could not find container \"65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513\": container with ID starting with 65004ec827fb95e541042a8a9d3e574693a8fd012bb2f821f3fd8dcb2de23513 not found: ID does not exist"
Sep 11 18:13:34.950125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950079    2566 scope.go:117] "RemoveContainer" containerID="fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"
Sep 11 18:13:34.950270 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.950256    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3\": container with ID starting with fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3 not found: ID does not exist" containerID="fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"
Sep 11 18:13:34.950312 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950281    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3"} err="failed to get container status \"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3\": rpc error: code = NotFound desc = could not find container \"fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3\": container with ID starting with fec2664a428734ecf1f44be577d836262fe9b0179d0b9ecb9e3395c261f733d3 not found: ID does not exist"
Sep 11 18:13:34.950312 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950294    2566 scope.go:117] "RemoveContainer" containerID="95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"
Sep 11 18:13:34.950487 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.950473    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01\": container with ID starting with 95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01 not found: ID does not exist" containerID="95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"
Sep 11 18:13:34.950520 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950489    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01"} err="failed to get container status \"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01\": rpc error: code = NotFound desc = could not find container \"95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01\": container with ID starting with 95c33d4a21d186b95e104dd1218c5ad1ee7b0012c5eaf0eff1dd8765ffcc0a01 not found: ID does not exist"
Sep 11 18:13:34.950520 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950500    2566 scope.go:117] "RemoveContainer" containerID="aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"
Sep 11 18:13:34.950697 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.950680    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7\": container with ID starting with aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7 not found: ID does not exist" containerID="aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"
Sep 11 18:13:34.950737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950703    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7"} err="failed to get container status \"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7\": rpc error: code = NotFound desc = could not find container \"aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7\": container with ID starting with aa55cf144f790aa1d7aed8d79602e724f3acedabd1c405e77c9364c285f7f6d7 not found: ID does not exist"
Sep 11 18:13:34.950737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.950719    2566 scope.go:117] "RemoveContainer" containerID="048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"
Sep 11 18:13:34.951002 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.950982    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da\": container with ID starting with 048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da not found: ID does not exist" containerID="048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"
Sep 11 18:13:34.951058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.951010    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da"} err="failed to get container status \"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da\": rpc error: code = NotFound desc = could not find container \"048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da\": container with ID starting with 048d2b34fa69d86edfab8dd2590de2aaa46e4ff375dd97d2f4f5a7db23dc72da not found: ID does not exist"
Sep 11 18:13:34.951058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.951029    2566 scope.go:117] "RemoveContainer" containerID="42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee"
Sep 11 18:13:34.951257 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:13:34.951244    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee\": container with ID starting with 42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee not found: ID does not exist" containerID="42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee"
Sep 11 18:13:34.951306 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.951259    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee"} err="failed to get container status \"42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee\": rpc error: code = NotFound desc = could not find container \"42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee\": container with ID starting with 42fd8a154a6b10aecabfd10d60e7b39d684c06994d0afd2ddf2ce6ed75759dee not found: ID does not exist"
Sep 11 18:13:34.968173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968145    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:34.968439 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968427    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968440    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968450    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="init-config-reloader"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968457    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="init-config-reloader"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968464    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" containerName="console"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968469    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" containerName="console"
Sep 11 18:13:34.968483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968480    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-web"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968486    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-web"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968493    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="alertmanager"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968498    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="alertmanager"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968505    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78788ab8-92de-4be5-9fc8-103f328d1a23" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968509    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="78788ab8-92de-4be5-9fc8-103f328d1a23" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968517    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="prom-label-proxy"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968522    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="prom-label-proxy"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968528    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968532    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968540    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-metric"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968545    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-metric"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968552    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="config-reloader"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968557    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="config-reloader"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968597    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="alertmanager"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968604    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d84cde13-e6b7-40cb-9dd8-9253d7cfb2c0" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968610    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="prom-label-proxy"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968616    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="100f7795-cec6-4679-9abe-9aad5be82a74" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968620    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968625    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="config-reloader"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968630    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="78788ab8-92de-4be5-9fc8-103f328d1a23" containerName="console"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968636    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-web"
Sep 11 18:13:34.968651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.968640    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" containerName="kube-rbac-proxy-metric"
Sep 11 18:13:34.972291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.972275    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:34.975825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.975780    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 18:13:34.975952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.975782    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zsz9r\""
Sep 11 18:13:34.976360 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.976334    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 18:13:34.976656 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.976598    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 18:13:34.978960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.978417    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 18:13:34.978960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.978537    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 18:13:34.978960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.978636    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 18:13:34.978960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.978836    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 18:13:34.979294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.979010    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 18:13:34.984931 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.984910    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 18:13:34.997270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:34.997241    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:35.060308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.060277    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5667b759-e913-4b79-a1e1-5e86a6b68f75" path="/var/lib/kubelet/pods/5667b759-e913-4b79-a1e1-5e86a6b68f75/volumes"
Sep 11 18:13:35.089351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089460    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-out\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089679 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089679 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089649    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-web-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089740 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrpm\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-kube-api-access-6lrpm\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089740 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.089833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.089811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191020    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191061    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-out\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191141    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191321    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-web-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrpm\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-kube-api-access-6lrpm\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191546    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.191913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191605    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.192108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.191945    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.193573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.193525    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.193981 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.193948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-out\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.194329 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194307    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.194731 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194704    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.194851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194711    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.194912 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194855    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.194912 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.195012 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.194939    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-web-config\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.195357 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.195335    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.196039 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.196020    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.201436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.201414    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrpm\" (UniqueName: \"kubernetes.io/projected/ba24df90-04bb-4ed9-ab27-11e816ba5b2c-kube-api-access-6lrpm\") pod \"alertmanager-main-0\" (UID: \"ba24df90-04bb-4ed9-ab27-11e816ba5b2c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.282560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.282520    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:13:35.573183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.573051    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:13:35.577385 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:13:35.577359    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba24df90_04bb_4ed9_ab27_11e816ba5b2c.slice/crio-c947fbf2e76ad26a767413e7a2219e1614370e59d5e48f5faa81198192d1b6c4 WatchSource:0}: Error finding container c947fbf2e76ad26a767413e7a2219e1614370e59d5e48f5faa81198192d1b6c4: Status 404 returned error can't find the container with id c947fbf2e76ad26a767413e7a2219e1614370e59d5e48f5faa81198192d1b6c4
Sep 11 18:13:35.904820 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.904709    2566 generic.go:356] "Generic (PLEG): container finished" podID="ba24df90-04bb-4ed9-ab27-11e816ba5b2c" containerID="28a4a4f81a67715a93774e330095f9f4f9b3f8c2f434aa670f557f5b25ed01e1" exitCode=0
Sep 11 18:13:35.904976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.904818    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerDied","Data":"28a4a4f81a67715a93774e330095f9f4f9b3f8c2f434aa670f557f5b25ed01e1"}
Sep 11 18:13:35.904976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:35.904906    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"c947fbf2e76ad26a767413e7a2219e1614370e59d5e48f5faa81198192d1b6c4"}
Sep 11 18:13:36.912839 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912802    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"aff408e211b260c3e5a7290937c27d916bc86329384da22768acef36106b7b9d"}
Sep 11 18:13:36.913209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"113c50c02895b96ed01bac6b510ef8c5ea14a048ba3fa63b16c4189bee7d94ee"}
Sep 11 18:13:36.913209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"11c84571d3339df3416eac49830d1bb21c18978fbf02f14f99ded250ef0a2e74"}
Sep 11 18:13:36.913209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912945    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"55d8896a4a04ffda334ab07e0b33c4d193bec2b3fca161b29b46e4012584dc0a"}
Sep 11 18:13:36.913209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"1d7c763adc4f56f959d2380220cc780cb2a71c297e18a27e0244e5d2ffb6bf3d"}
Sep 11 18:13:36.913209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.912987    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba24df90-04bb-4ed9-ab27-11e816ba5b2c","Type":"ContainerStarted","Data":"4107d572d5e18439a7ab9e79a0ae460908bcd897d26907ffd27999d4164de607"}
Sep 11 18:13:36.957348 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:36.957299    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.941706117 podStartE2EDuration="2.957284495s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.578378ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:13:36.954422822 +0000 UTC m=+194.375197225" watchObservedRunningTime="2026-09-11 18:13:36.957284495 +0000 UTC m=+194.378058894"
Sep 11 18:13:46.347144 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.347109    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:13:46.349370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.349351    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.381319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.381292    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:13:46.483181 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483219    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483259    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qpqj\" (UniqueName: \"kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.483622 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.483382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584532 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qpqj\" (UniqueName: \"kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584704 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584704 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584887 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584857    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.584926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.584886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.585435 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.585409    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.585416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.585492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.585618 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.585547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.587215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.587193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.587303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.587258    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.592739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.592720    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qpqj\" (UniqueName: \"kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj\") pod \"console-77459d67c-5m2nr\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") " pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.659758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.659680    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:46.946720 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:46.946697    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:13:46.949050 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:13:46.949025    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a749d5_bcf2_49a5_bbb9_aa941a9fde84.slice/crio-02e8df0fe0b7140be7d33736a6a2347dae418f3fd4a577ca8fa8f4c46f5c7136 WatchSource:0}: Error finding container 02e8df0fe0b7140be7d33736a6a2347dae418f3fd4a577ca8fa8f4c46f5c7136: Status 404 returned error can't find the container with id 02e8df0fe0b7140be7d33736a6a2347dae418f3fd4a577ca8fa8f4c46f5c7136
Sep 11 18:13:47.956670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:47.956633    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459d67c-5m2nr" event={"ID":"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84","Type":"ContainerStarted","Data":"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"}
Sep 11 18:13:47.957102 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:47.956682    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459d67c-5m2nr" event={"ID":"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84","Type":"ContainerStarted","Data":"02e8df0fe0b7140be7d33736a6a2347dae418f3fd4a577ca8fa8f4c46f5c7136"}
Sep 11 18:13:47.978133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:47.978087    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77459d67c-5m2nr" podStartSLOduration=1.9780706289999999 podStartE2EDuration="1.978070629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:13:47.977574767 +0000 UTC m=+205.398349179" watchObservedRunningTime="2026-09-11 18:13:47.978070629 +0000 UTC m=+205.398845033"
Sep 11 18:13:56.660457 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:56.660417    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:56.660931 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:56.660488    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:56.665365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:56.665340    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:56.993956 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:56.993930    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:13:57.061247 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:13:57.061219    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:14:22.081110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.081074    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-557c48498c-q6gs7" podUID="e198f511-39a5-48d0-ad59-8a4f1e72c900" containerName="console" containerID="cri-o://b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef" gracePeriod=15
Sep 11 18:14:22.324203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.324176    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:14:22.381388 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381314    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381388 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381353    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381388 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381379    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx48l\" (UniqueName: \"kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381407    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381533    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381573    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381627    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config\") pod \"e198f511-39a5-48d0-ad59-8a4f1e72c900\" (UID: \"e198f511-39a5-48d0-ad59-8a4f1e72c900\") "
Sep 11 18:14:22.381898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381703    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:22.381952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381892    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config" (OuterVolumeSpecName: "console-config") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:22.381952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381903    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca" (OuterVolumeSpecName: "service-ca") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:22.381952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.381917    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-oauth-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.382090 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.382018    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:14:22.383584 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.383558    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:22.383695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.383601    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l" (OuterVolumeSpecName: "kube-api-access-bx48l") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "kube-api-access-bx48l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:22.383695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.383601    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e198f511-39a5-48d0-ad59-8a4f1e72c900" (UID: "e198f511-39a5-48d0-ad59-8a4f1e72c900"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:14:22.482397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482352    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.482397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482390    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-trusted-ca-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.482397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482399    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-oauth-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.482397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482408    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.482649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482417    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx48l\" (UniqueName: \"kubernetes.io/projected/e198f511-39a5-48d0-ad59-8a4f1e72c900-kube-api-access-bx48l\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:22.482649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:22.482426    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e198f511-39a5-48d0-ad59-8a4f1e72c900-console-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:23.086983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.086950    2566 generic.go:356] "Generic (PLEG): container finished" podID="e198f511-39a5-48d0-ad59-8a4f1e72c900" containerID="b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef" exitCode=0
Sep 11 18:14:23.087401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.086996    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c48498c-q6gs7"
Sep 11 18:14:23.087401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.087033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c48498c-q6gs7" event={"ID":"e198f511-39a5-48d0-ad59-8a4f1e72c900","Type":"ContainerDied","Data":"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"}
Sep 11 18:14:23.087401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.087086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c48498c-q6gs7" event={"ID":"e198f511-39a5-48d0-ad59-8a4f1e72c900","Type":"ContainerDied","Data":"6a1f7bd29477b43ddf14d0bbf7adc02d8b1b56abf9e4eac20cad364bab5c2c53"}
Sep 11 18:14:23.087401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.087109    2566 scope.go:117] "RemoveContainer" containerID="b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"
Sep 11 18:14:23.094527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.094509    2566 scope.go:117] "RemoveContainer" containerID="b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"
Sep 11 18:14:23.094833 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:14:23.094811    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef\": container with ID starting with b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef not found: ID does not exist" containerID="b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"
Sep 11 18:14:23.094886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.094845    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef"} err="failed to get container status \"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef\": rpc error: code = NotFound desc = could not find container \"b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef\": container with ID starting with b2d6a21de72de1cf54a3e5c56ce039c50d287ea9fafc2341038e0fe5131919ef not found: ID does not exist"
Sep 11 18:14:23.105542 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.105522    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:14:23.109257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:23.109238    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557c48498c-q6gs7"]
Sep 11 18:14:25.059133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:25.059099    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e198f511-39a5-48d0-ad59-8a4f1e72c900" path="/var/lib/kubelet/pods/e198f511-39a5-48d0-ad59-8a4f1e72c900/volumes"
Sep 11 18:14:36.126378 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.126343    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"]
Sep 11 18:14:36.126753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.126633    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e198f511-39a5-48d0-ad59-8a4f1e72c900" containerName="console"
Sep 11 18:14:36.126753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.126643    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e198f511-39a5-48d0-ad59-8a4f1e72c900" containerName="console"
Sep 11 18:14:36.126753 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.126699    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e198f511-39a5-48d0-ad59-8a4f1e72c900" containerName="console"
Sep 11 18:14:36.135525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.135497    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.139029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.139009    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cckg\""
Sep 11 18:14:36.139141 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.139042    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:14:36.139141 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.139074    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:14:36.144594 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.144571    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"]
Sep 11 18:14:36.189078 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.189048    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.189225 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.189088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb525\" (UniqueName: \"kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.189225 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.189154    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.289603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.289573    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.289699 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.289614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.289699 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.289670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb525\" (UniqueName: \"kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.289999 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.289979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.290077 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.290063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.298920 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.298891    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb525\" (UniqueName: \"kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.444607 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.444576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:36.717535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:36.717511    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"]
Sep 11 18:14:36.720136 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:14:36.720105    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0887dfb1_6b17_4151_8f8c_601bfda7b494.slice/crio-63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec WatchSource:0}: Error finding container 63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec: Status 404 returned error can't find the container with id 63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec
Sep 11 18:14:37.141575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:37.141487    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8" event={"ID":"0887dfb1-6b17-4151-8f8c-601bfda7b494","Type":"ContainerStarted","Data":"63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec"}
Sep 11 18:14:44.172700 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:44.172665    2566 generic.go:356] "Generic (PLEG): container finished" podID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerID="2e32c22fc925427bd25357dec426268247f8aa8430cbe79686ed8b93f01fe1b9" exitCode=0
Sep 11 18:14:44.173153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:44.172756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8" event={"ID":"0887dfb1-6b17-4151-8f8c-601bfda7b494","Type":"ContainerDied","Data":"2e32c22fc925427bd25357dec426268247f8aa8430cbe79686ed8b93f01fe1b9"}
Sep 11 18:14:46.182350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:46.182314    2566 generic.go:356] "Generic (PLEG): container finished" podID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerID="ff4c7946b66d5efac7f93f0667affdd4801e5a444694927ab0d80fd9822d8f9d" exitCode=0
Sep 11 18:14:46.182767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:46.182394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8" event={"ID":"0887dfb1-6b17-4151-8f8c-601bfda7b494","Type":"ContainerDied","Data":"ff4c7946b66d5efac7f93f0667affdd4801e5a444694927ab0d80fd9822d8f9d"}
Sep 11 18:14:54.219736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:54.219700    2566 generic.go:356] "Generic (PLEG): container finished" podID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerID="f4f5f7f825d1ca76cb313e2c37880a069e7f15e554c206d7f01de9e42a86c60b" exitCode=0
Sep 11 18:14:54.220111 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:54.219806    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8" event={"ID":"0887dfb1-6b17-4151-8f8c-601bfda7b494","Type":"ContainerDied","Data":"f4f5f7f825d1ca76cb313e2c37880a069e7f15e554c206d7f01de9e42a86c60b"}
Sep 11 18:14:55.338729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.338706    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:55.461243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.461210    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util\") pod \"0887dfb1-6b17-4151-8f8c-601bfda7b494\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") "
Sep 11 18:14:55.461427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.461268    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle\") pod \"0887dfb1-6b17-4151-8f8c-601bfda7b494\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") "
Sep 11 18:14:55.461427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.461325    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb525\" (UniqueName: \"kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525\") pod \"0887dfb1-6b17-4151-8f8c-601bfda7b494\" (UID: \"0887dfb1-6b17-4151-8f8c-601bfda7b494\") "
Sep 11 18:14:55.461895 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.461870    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle" (OuterVolumeSpecName: "bundle") pod "0887dfb1-6b17-4151-8f8c-601bfda7b494" (UID: "0887dfb1-6b17-4151-8f8c-601bfda7b494"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:55.463400 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.463368    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525" (OuterVolumeSpecName: "kube-api-access-gb525") pod "0887dfb1-6b17-4151-8f8c-601bfda7b494" (UID: "0887dfb1-6b17-4151-8f8c-601bfda7b494"). InnerVolumeSpecName "kube-api-access-gb525". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:14:55.464944 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.464919    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util" (OuterVolumeSpecName: "util") pod "0887dfb1-6b17-4151-8f8c-601bfda7b494" (UID: "0887dfb1-6b17-4151-8f8c-601bfda7b494"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:14:55.561995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.561909    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:55.561995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.561947    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb525\" (UniqueName: \"kubernetes.io/projected/0887dfb1-6b17-4151-8f8c-601bfda7b494-kube-api-access-gb525\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:55.561995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:55.561955    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0887dfb1-6b17-4151-8f8c-601bfda7b494-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:14:56.229204 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:56.229166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8" event={"ID":"0887dfb1-6b17-4151-8f8c-601bfda7b494","Type":"ContainerDied","Data":"63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec"}
Sep 11 18:14:56.229204 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:56.229209    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404qfh8"
Sep 11 18:14:56.229408 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:14:56.229221    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63eea52dccd17ad6048740f0824b7a28c5c94e60e33f70903380e3b44220c4ec"
Sep 11 18:15:04.465091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465053    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"]
Sep 11 18:15:04.465750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465729    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="extract"
Sep 11 18:15:04.465857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465754    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="extract"
Sep 11 18:15:04.465857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465802    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="pull"
Sep 11 18:15:04.465857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465811    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="pull"
Sep 11 18:15:04.465857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465825    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="util"
Sep 11 18:15:04.465857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465832    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="util"
Sep 11 18:15:04.466086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.465913    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0887dfb1-6b17-4151-8f8c-601bfda7b494" containerName="extract"
Sep 11 18:15:04.471216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.471195    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.474603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.474581    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 18:15:04.474693 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.474643    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qwjth\""
Sep 11 18:15:04.474693 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.474653    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:15:04.487323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.487300    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"]
Sep 11 18:15:04.639274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.639235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppnt\" (UniqueName: \"kubernetes.io/projected/ccff4a73-ca64-46ba-8051-939e53d48d94-kube-api-access-fppnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.639274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.639280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccff4a73-ca64-46ba-8051-939e53d48d94-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.740655 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.740571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fppnt\" (UniqueName: \"kubernetes.io/projected/ccff4a73-ca64-46ba-8051-939e53d48d94-kube-api-access-fppnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.740655 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.740614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccff4a73-ca64-46ba-8051-939e53d48d94-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.741053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.741033    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccff4a73-ca64-46ba-8051-939e53d48d94-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.749028 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.749009    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppnt\" (UniqueName: \"kubernetes.io/projected/ccff4a73-ca64-46ba-8051-939e53d48d94-kube-api-access-fppnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-zt84x\" (UID: \"ccff4a73-ca64-46ba-8051-939e53d48d94\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:04.779601 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:04.779564    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"
Sep 11 18:15:05.064779 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:05.064756    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x"]
Sep 11 18:15:05.066669 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:05.066644    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccff4a73_ca64_46ba_8051_939e53d48d94.slice/crio-6d3a85e34fbf2637d1096cf4a95d59d33e331e59858d5b0084aa2bfd75ff19cb WatchSource:0}: Error finding container 6d3a85e34fbf2637d1096cf4a95d59d33e331e59858d5b0084aa2bfd75ff19cb: Status 404 returned error can't find the container with id 6d3a85e34fbf2637d1096cf4a95d59d33e331e59858d5b0084aa2bfd75ff19cb
Sep 11 18:15:05.266649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:05.266614    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x" event={"ID":"ccff4a73-ca64-46ba-8051-939e53d48d94","Type":"ContainerStarted","Data":"6d3a85e34fbf2637d1096cf4a95d59d33e331e59858d5b0084aa2bfd75ff19cb"}
Sep 11 18:15:07.278394 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:07.278352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x" event={"ID":"ccff4a73-ca64-46ba-8051-939e53d48d94","Type":"ContainerStarted","Data":"5b1377dd4e1c714e03ba05e6de38fea5efdbecd8b06fcce013a04ee78a25dd25"}
Sep 11 18:15:07.301489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:07.301368    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zt84x" podStartSLOduration=1.201505084 podStartE2EDuration="3.301349399s" totalImagesPullingTime="2.099844315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:07.30025577 +0000 UTC m=+284.721030173" watchObservedRunningTime="2026-09-11 18:15:07.301349399 +0000 UTC m=+284.722123801"
Sep 11 18:15:08.775865 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.775828    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"]
Sep 11 18:15:08.778619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.778601    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:08.783130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.783111    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cckg\""
Sep 11 18:15:08.783449 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.783436    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:15:08.783649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.783635    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:15:08.808149 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.808121    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"]
Sep 11 18:15:08.974999 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.974962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:08.974999 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.975003    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk49h\" (UniqueName: \"kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:08.975200 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:08.975091    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.075767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.075681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.075767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.075719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk49h\" (UniqueName: \"kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.076014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.075774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.076160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.076140    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.076215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.076156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.084981 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.084960    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk49h\" (UniqueName: \"kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.087739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.087722    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:09.364094 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:09.363983    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"]
Sep 11 18:15:09.367212 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:09.367177    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9493f_452f_4bab_95d8_66100673e4a8.slice/crio-e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340 WatchSource:0}: Error finding container e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340: Status 404 returned error can't find the container with id e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340
Sep 11 18:15:10.292561 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.292526    2566 generic.go:356] "Generic (PLEG): container finished" podID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerID="e2217778cda82a703e14de4dc269b854377669c5a1de0f8abe052e1e5b8cd552" exitCode=0
Sep 11 18:15:10.292952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.292595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq" event={"ID":"1cc9493f-452f-4bab-95d8-66100673e4a8","Type":"ContainerDied","Data":"e2217778cda82a703e14de4dc269b854377669c5a1de0f8abe052e1e5b8cd552"}
Sep 11 18:15:10.292952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.292641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq" event={"ID":"1cc9493f-452f-4bab-95d8-66100673e4a8","Type":"ContainerStarted","Data":"e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340"}
Sep 11 18:15:10.705674 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.705642    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"]
Sep 11 18:15:10.707877 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.707855    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.710365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.710344    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 18:15:10.710726 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.710706    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k62t5\""
Sep 11 18:15:10.710870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.710833    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 18:15:10.721626 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.721602    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"]
Sep 11 18:15:10.786943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.786903    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.786943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.786942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llzh5\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-kube-api-access-llzh5\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.888004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.887970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.888004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.888009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llzh5\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-kube-api-access-llzh5\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.899694 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.899669    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:10.900114 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:10.900092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llzh5\" (UniqueName: \"kubernetes.io/projected/c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20-kube-api-access-llzh5\") pod \"cert-manager-cainjector-559cdd8c87-9jldh\" (UID: \"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:11.024607 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:11.024526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"
Sep 11 18:15:11.308909 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:11.308824    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jldh"]
Sep 11 18:15:11.945826 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:11.945770    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc039d3a8_9d21_4ecc_beb0_9a0cfbba8c20.slice/crio-a9920fd07e2f27f5eb9c52bcaff02d85ad271bd356019aaf1811f2f63568e438 WatchSource:0}: Error finding container a9920fd07e2f27f5eb9c52bcaff02d85ad271bd356019aaf1811f2f63568e438: Status 404 returned error can't find the container with id a9920fd07e2f27f5eb9c52bcaff02d85ad271bd356019aaf1811f2f63568e438
Sep 11 18:15:12.302133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:12.302055    2566 generic.go:356] "Generic (PLEG): container finished" podID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerID="25bcfd0fac7a7d0d6c38a5433be44d55282229f824542e03ee5ef38fd13112d2" exitCode=0
Sep 11 18:15:12.302279 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:12.302134    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq" event={"ID":"1cc9493f-452f-4bab-95d8-66100673e4a8","Type":"ContainerDied","Data":"25bcfd0fac7a7d0d6c38a5433be44d55282229f824542e03ee5ef38fd13112d2"}
Sep 11 18:15:12.303331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:12.303312    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh" event={"ID":"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20","Type":"ContainerStarted","Data":"a9920fd07e2f27f5eb9c52bcaff02d85ad271bd356019aaf1811f2f63568e438"}
Sep 11 18:15:13.311192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:13.311153    2566 generic.go:356] "Generic (PLEG): container finished" podID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerID="cb1f955e0470fb329b9ddd14c32749e5b8b9f467c9aaebb89998febc2fb4772d" exitCode=0
Sep 11 18:15:13.311552 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:13.311201    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq" event={"ID":"1cc9493f-452f-4bab-95d8-66100673e4a8","Type":"ContainerDied","Data":"cb1f955e0470fb329b9ddd14c32749e5b8b9f467c9aaebb89998febc2fb4772d"}
Sep 11 18:15:14.562219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.562195    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:14.612557 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.612533    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk49h\" (UniqueName: \"kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h\") pod \"1cc9493f-452f-4bab-95d8-66100673e4a8\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") "
Sep 11 18:15:14.612680 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.612570    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle\") pod \"1cc9493f-452f-4bab-95d8-66100673e4a8\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") "
Sep 11 18:15:14.612680 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.612615    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util\") pod \"1cc9493f-452f-4bab-95d8-66100673e4a8\" (UID: \"1cc9493f-452f-4bab-95d8-66100673e4a8\") "
Sep 11 18:15:14.613004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.612978    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle" (OuterVolumeSpecName: "bundle") pod "1cc9493f-452f-4bab-95d8-66100673e4a8" (UID: "1cc9493f-452f-4bab-95d8-66100673e4a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:14.614654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.614622    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h" (OuterVolumeSpecName: "kube-api-access-jk49h") pod "1cc9493f-452f-4bab-95d8-66100673e4a8" (UID: "1cc9493f-452f-4bab-95d8-66100673e4a8"). InnerVolumeSpecName "kube-api-access-jk49h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:14.619160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.619014    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util" (OuterVolumeSpecName: "util") pod "1cc9493f-452f-4bab-95d8-66100673e4a8" (UID: "1cc9493f-452f-4bab-95d8-66100673e4a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:14.713427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.713394    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk49h\" (UniqueName: \"kubernetes.io/projected/1cc9493f-452f-4bab-95d8-66100673e4a8-kube-api-access-jk49h\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:14.713427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.713422    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:14.713427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:14.713432    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cc9493f-452f-4bab-95d8-66100673e4a8-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:15.064559 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064530    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m4f6s"]
Sep 11 18:15:15.064870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064844    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="pull"
Sep 11 18:15:15.064870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064856    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="pull"
Sep 11 18:15:15.064870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064865    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="util"
Sep 11 18:15:15.064870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064870    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="util"
Sep 11 18:15:15.065070 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064876    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="extract"
Sep 11 18:15:15.065070 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064883    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="extract"
Sep 11 18:15:15.065070 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.064940    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc9493f-452f-4bab-95d8-66100673e4a8" containerName="extract"
Sep 11 18:15:15.066955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.066930    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.069750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.069730    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qbs9c\""
Sep 11 18:15:15.084754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.084727    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m4f6s"]
Sep 11 18:15:15.117444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.117412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.117444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.117447    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk7bs\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-kube-api-access-nk7bs\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.218451 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.218415    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.218451 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.218453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk7bs\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-kube-api-access-nk7bs\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.228494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.228460    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk7bs\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-kube-api-access-nk7bs\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.229165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.229142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb715b6f-1d0c-447c-9f01-dbe02deffa61-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m4f6s\" (UID: \"fb715b6f-1d0c-447c-9f01-dbe02deffa61\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.321627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.321538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq" event={"ID":"1cc9493f-452f-4bab-95d8-66100673e4a8","Type":"ContainerDied","Data":"e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340"}
Sep 11 18:15:15.321627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.321570    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn2dkq"
Sep 11 18:15:15.321627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.321596    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64b4ac593b326b2475786aa9d396bbd31a6a348a0b38b271827f8b352d07340"
Sep 11 18:15:15.323151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.323125    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh" event={"ID":"c039d3a8-9d21-4ecc-beb0-9a0cfbba8c20","Type":"ContainerStarted","Data":"b38a7f68e643da2c3176461c6b5c73433ab0132cfca1ed38c0ae6f7aec6b33e9"}
Sep 11 18:15:15.346587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.346531    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jldh" podStartSLOduration=2.7149659809999998 podStartE2EDuration="5.346518141s" totalImagesPullingTime="2.63155216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:15.345309238 +0000 UTC m=+292.766083643" watchObservedRunningTime="2026-09-11 18:15:15.346518141 +0000 UTC m=+292.767292544"
Sep 11 18:15:15.375385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.375356    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:15.661050 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:15.660942    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m4f6s"]
Sep 11 18:15:15.664639 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:15.664606    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb715b6f_1d0c_447c_9f01_dbe02deffa61.slice/crio-2d81550c6a8fb8778f2fe5f864a10ed279da3f0024f86e7a210d6710f13401e8 WatchSource:0}: Error finding container 2d81550c6a8fb8778f2fe5f864a10ed279da3f0024f86e7a210d6710f13401e8: Status 404 returned error can't find the container with id 2d81550c6a8fb8778f2fe5f864a10ed279da3f0024f86e7a210d6710f13401e8
Sep 11 18:15:16.329370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:16.329339    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s" event={"ID":"fb715b6f-1d0c-447c-9f01-dbe02deffa61","Type":"ContainerStarted","Data":"9d6eacd3f1b6beb8acb4317e5c94f639fef02f030451902c6d3f699fc7ebf810"}
Sep 11 18:15:16.329534 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:16.329378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s" event={"ID":"fb715b6f-1d0c-447c-9f01-dbe02deffa61","Type":"ContainerStarted","Data":"2d81550c6a8fb8778f2fe5f864a10ed279da3f0024f86e7a210d6710f13401e8"}
Sep 11 18:15:16.329534 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:16.329471    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:22.335821 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:22.335771    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s"
Sep 11 18:15:22.356228 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:22.356164    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m4f6s" podStartSLOduration=8.356148573 podStartE2EDuration="8.356148573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:16.354280193 +0000 UTC m=+293.775054596" watchObservedRunningTime="2026-09-11 18:15:22.356148573 +0000 UTC m=+299.776922977"
Sep 11 18:15:22.950338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:22.950309    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:15:22.952808 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:22.952768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:15:22.961385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:22.961370    2566 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 18:15:29.952342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.952306    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"]
Sep 11 18:15:29.954626 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.954609    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:29.958464 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.958445    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:15:29.958666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.958647    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cckg\""
Sep 11 18:15:29.959022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.959008    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:15:29.982091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:29.982059    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"]
Sep 11 18:15:30.038655 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.038617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.038834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.038666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjvt2\" (UniqueName: \"kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.038834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.038758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.139462 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.139420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.139627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.139477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjvt2\" (UniqueName: \"kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.139627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.139608    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.139844 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.139823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.140013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.139993    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.147998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.147979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjvt2\" (UniqueName: \"kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.263550 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.263468    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:30.545852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:30.545827    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"]
Sep 11 18:15:30.547921 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:30.547892    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26f3a72_7429_4e37_8eec_6829ecf2eb0b.slice/crio-64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7 WatchSource:0}: Error finding container 64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7: Status 404 returned error can't find the container with id 64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7
Sep 11 18:15:31.394546 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:31.394506    2566 generic.go:356] "Generic (PLEG): container finished" podID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerID="d7661738823b731b774d09b1b91086ba671bb4200f63cf6e7126b0cc89d2c776" exitCode=0
Sep 11 18:15:31.395049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:31.394591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d" event={"ID":"a26f3a72-7429-4e37-8eec-6829ecf2eb0b","Type":"ContainerDied","Data":"d7661738823b731b774d09b1b91086ba671bb4200f63cf6e7126b0cc89d2c776"}
Sep 11 18:15:31.395049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:31.394657    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d" event={"ID":"a26f3a72-7429-4e37-8eec-6829ecf2eb0b","Type":"ContainerStarted","Data":"64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7"}
Sep 11 18:15:31.395257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:31.395239    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:15:32.400699 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:32.400663    2566 generic.go:356] "Generic (PLEG): container finished" podID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerID="1ed763ae459ca20a660805c8bfdabbc091e2598e34239c5d1a56648fb52adb4e" exitCode=0
Sep 11 18:15:32.401086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:32.400753    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d" event={"ID":"a26f3a72-7429-4e37-8eec-6829ecf2eb0b","Type":"ContainerDied","Data":"1ed763ae459ca20a660805c8bfdabbc091e2598e34239c5d1a56648fb52adb4e"}
Sep 11 18:15:33.406806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:33.406758    2566 generic.go:356] "Generic (PLEG): container finished" podID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerID="b1f476aaf2aad4835fe140b64c48db5190072d236306602a2f9cb6a552b422cc" exitCode=0
Sep 11 18:15:33.407182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:33.406826    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d" event={"ID":"a26f3a72-7429-4e37-8eec-6829ecf2eb0b","Type":"ContainerDied","Data":"b1f476aaf2aad4835fe140b64c48db5190072d236306602a2f9cb6a552b422cc"}
Sep 11 18:15:34.531449 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.531423    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:34.572806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.572753    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjvt2\" (UniqueName: \"kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2\") pod \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") "
Sep 11 18:15:34.572976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.572832    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle\") pod \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") "
Sep 11 18:15:34.572976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.572888    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util\") pod \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\" (UID: \"a26f3a72-7429-4e37-8eec-6829ecf2eb0b\") "
Sep 11 18:15:34.573559 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.573531    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle" (OuterVolumeSpecName: "bundle") pod "a26f3a72-7429-4e37-8eec-6829ecf2eb0b" (UID: "a26f3a72-7429-4e37-8eec-6829ecf2eb0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:34.574873 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.574849    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2" (OuterVolumeSpecName: "kube-api-access-vjvt2") pod "a26f3a72-7429-4e37-8eec-6829ecf2eb0b" (UID: "a26f3a72-7429-4e37-8eec-6829ecf2eb0b"). InnerVolumeSpecName "kube-api-access-vjvt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:34.578118 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.578080    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util" (OuterVolumeSpecName: "util") pod "a26f3a72-7429-4e37-8eec-6829ecf2eb0b" (UID: "a26f3a72-7429-4e37-8eec-6829ecf2eb0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:34.674223 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.674196    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjvt2\" (UniqueName: \"kubernetes.io/projected/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-kube-api-access-vjvt2\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:34.674223 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.674224    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:34.674379 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:34.674233    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a26f3a72-7429-4e37-8eec-6829ecf2eb0b-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:35.417197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:35.417116    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d"
Sep 11 18:15:35.417197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:35.417129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4gr6d" event={"ID":"a26f3a72-7429-4e37-8eec-6829ecf2eb0b","Type":"ContainerDied","Data":"64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7"}
Sep 11 18:15:35.417197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:35.417176    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64bc4ed5afd37d3b8b5d2b9a51e591e5831d36ab8762444c67353937294ce1c7"
Sep 11 18:15:39.775672 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.775637    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"]
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776090    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="pull"
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776108    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="pull"
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776130    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="util"
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776139    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="util"
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776153    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="extract"
Sep 11 18:15:39.776178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776161    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="extract"
Sep 11 18:15:39.776474 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.776245    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26f3a72-7429-4e37-8eec-6829ecf2eb0b" containerName="extract"
Sep 11 18:15:39.779356 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.779335    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:39.797126 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.797105    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cckg\""
Sep 11 18:15:39.799806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.799776    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:15:39.809881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.809861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:15:39.848939 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.848912    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"]
Sep 11 18:15:39.921150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.921113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:39.921309 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.921179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsv9\" (UniqueName: \"kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:39.921309 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:39.921220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.022258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.022225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsv9\" (UniqueName: \"kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.022258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.022261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.022501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.022322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.022715 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.022694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.022781 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.022711    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.035240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.035178    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsv9\" (UniqueName: \"kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.087915 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.087883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:40.366153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.366129    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"]
Sep 11 18:15:40.368143 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:40.368117    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60021f63_c4d8_40a6_9455_1b487cdbb234.slice/crio-9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59 WatchSource:0}: Error finding container 9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59: Status 404 returned error can't find the container with id 9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59
Sep 11 18:15:40.441208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.441177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerStarted","Data":"5373023f8a00971b7d69c762daa9a1e50f9015ed1eedca9d4dd17f74897b3b96"}
Sep 11 18:15:40.441340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:40.441233    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerStarted","Data":"9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59"}
Sep 11 18:15:41.446851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.446820    2566 generic.go:356] "Generic (PLEG): container finished" podID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerID="5373023f8a00971b7d69c762daa9a1e50f9015ed1eedca9d4dd17f74897b3b96" exitCode=0
Sep 11 18:15:41.447334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.446916    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerDied","Data":"5373023f8a00971b7d69c762daa9a1e50f9015ed1eedca9d4dd17f74897b3b96"}
Sep 11 18:15:41.854477 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.854401    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"]
Sep 11 18:15:41.856716 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.856700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:41.859062 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.859031    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m5jv4\""
Sep 11 18:15:41.859196 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.859099    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 18:15:41.859196 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.859145    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 18:15:41.859511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.859473    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 18:15:41.859692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.859677    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 18:15:41.879143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.879115    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"]
Sep 11 18:15:41.940764 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.940729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-webhook-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:41.940764 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.940767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-manifests\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:41.940966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.940876    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-apiservice-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:41.940966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.940898    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcf8c\" (UniqueName: \"kubernetes.io/projected/e7ffce3e-9f5c-4f48-9940-36347658e031-kube-api-access-mcf8c\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:41.940966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:41.940914    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-tmp\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.041839 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.041808    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-apiservice-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.041932 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.041858    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcf8c\" (UniqueName: \"kubernetes.io/projected/e7ffce3e-9f5c-4f48-9940-36347658e031-kube-api-access-mcf8c\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.041932 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.041884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-tmp\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.042060 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.042041    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-webhook-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.042117 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.042091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-manifests\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.042568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.042549    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-manifests\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.044111 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.044093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ffce3e-9f5c-4f48-9940-36347658e031-tmp\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.044431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.044410    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-apiservice-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.044539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.044523    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7ffce3e-9f5c-4f48-9940-36347658e031-webhook-cert\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.058131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.058109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcf8c\" (UniqueName: \"kubernetes.io/projected/e7ffce3e-9f5c-4f48-9940-36347658e031-kube-api-access-mcf8c\") pod \"opendatahub-operator-controller-manager-657fcdcb9c-4ldmz\" (UID: \"e7ffce3e-9f5c-4f48-9940-36347658e031\") " pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.166444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.166361    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:42.453703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.453668    2566 generic.go:356] "Generic (PLEG): container finished" podID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerID="a298caf335f48930503897c40bf51a2a2dc003803aef8a943cf6bd04a110a577" exitCode=0
Sep 11 18:15:42.454074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.453714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerDied","Data":"a298caf335f48930503897c40bf51a2a2dc003803aef8a943cf6bd04a110a577"}
Sep 11 18:15:42.458169 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:42.458103    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"]
Sep 11 18:15:42.460349 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:15:42.460329    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ffce3e_9f5c_4f48_9940_36347658e031.slice/crio-8058af621ea998d58789c435e2b2ec9c50ad15f61a49c13bf4038f3ec164b855 WatchSource:0}: Error finding container 8058af621ea998d58789c435e2b2ec9c50ad15f61a49c13bf4038f3ec164b855: Status 404 returned error can't find the container with id 8058af621ea998d58789c435e2b2ec9c50ad15f61a49c13bf4038f3ec164b855
Sep 11 18:15:43.462290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:43.462242    2566 generic.go:356] "Generic (PLEG): container finished" podID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerID="25c6106b78f2fe4e235d51f7608309a27f9838603d32a4998ec44d2ed650e222" exitCode=0
Sep 11 18:15:43.462759 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:43.462332    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerDied","Data":"25c6106b78f2fe4e235d51f7608309a27f9838603d32a4998ec44d2ed650e222"}
Sep 11 18:15:43.464104 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:43.464068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz" event={"ID":"e7ffce3e-9f5c-4f48-9940-36347658e031","Type":"ContainerStarted","Data":"8058af621ea998d58789c435e2b2ec9c50ad15f61a49c13bf4038f3ec164b855"}
Sep 11 18:15:45.444422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.444397    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:45.477813 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.477589    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf" event={"ID":"60021f63-c4d8-40a6-9455-1b487cdbb234","Type":"ContainerDied","Data":"9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59"}
Sep 11 18:15:45.477813 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.477620    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cwzf"
Sep 11 18:15:45.477813 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.477645    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bb28a8341a3223bc074cd09567876a13fa7d145352b65f287d814f790b8cb59"
Sep 11 18:15:45.574422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.574392    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util\") pod \"60021f63-c4d8-40a6-9455-1b487cdbb234\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") "
Sep 11 18:15:45.574566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.574438    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktsv9\" (UniqueName: \"kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9\") pod \"60021f63-c4d8-40a6-9455-1b487cdbb234\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") "
Sep 11 18:15:45.574566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.574498    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle\") pod \"60021f63-c4d8-40a6-9455-1b487cdbb234\" (UID: \"60021f63-c4d8-40a6-9455-1b487cdbb234\") "
Sep 11 18:15:45.575188 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.575165    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle" (OuterVolumeSpecName: "bundle") pod "60021f63-c4d8-40a6-9455-1b487cdbb234" (UID: "60021f63-c4d8-40a6-9455-1b487cdbb234"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:45.576395 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.576373    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9" (OuterVolumeSpecName: "kube-api-access-ktsv9") pod "60021f63-c4d8-40a6-9455-1b487cdbb234" (UID: "60021f63-c4d8-40a6-9455-1b487cdbb234"). InnerVolumeSpecName "kube-api-access-ktsv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:15:45.579274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.579238    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util" (OuterVolumeSpecName: "util") pod "60021f63-c4d8-40a6-9455-1b487cdbb234" (UID: "60021f63-c4d8-40a6-9455-1b487cdbb234"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:15:45.675603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.675560    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:45.675603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.675598    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktsv9\" (UniqueName: \"kubernetes.io/projected/60021f63-c4d8-40a6-9455-1b487cdbb234-kube-api-access-ktsv9\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:45.675603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:45.675609    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60021f63-c4d8-40a6-9455-1b487cdbb234-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:15:46.484187 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:46.484145    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz" event={"ID":"e7ffce3e-9f5c-4f48-9940-36347658e031","Type":"ContainerStarted","Data":"8bd3bc2e3b27ad9c5168ee976da095056245d2892c15e055e9a0d9f2f0366e13"}
Sep 11 18:15:47.489879 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:47.489838    2566 generic.go:356] "Generic (PLEG): container finished" podID="e7ffce3e-9f5c-4f48-9940-36347658e031" containerID="8bd3bc2e3b27ad9c5168ee976da095056245d2892c15e055e9a0d9f2f0366e13" exitCode=0
Sep 11 18:15:47.490233 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:47.489892    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz" event={"ID":"e7ffce3e-9f5c-4f48-9940-36347658e031","Type":"ContainerDied","Data":"8bd3bc2e3b27ad9c5168ee976da095056245d2892c15e055e9a0d9f2f0366e13"}
Sep 11 18:15:48.497682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:48.497645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz" event={"ID":"e7ffce3e-9f5c-4f48-9940-36347658e031","Type":"ContainerStarted","Data":"46a862fae5a7644c37435362640cd0cf9654006038a87da4ecb4efdf6274a47c"}
Sep 11 18:15:48.498124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:48.497816    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:15:48.528780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:48.528727    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz" podStartSLOduration=3.19527903 podStartE2EDuration="7.528711611s" totalImagesPullingTime="3.309131988s" totalInitContainerRuntime="1.024300593s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:15:48.52737069 +0000 UTC m=+325.948145095" watchObservedRunningTime="2026-09-11 18:15:48.528711611 +0000 UTC m=+325.949486013"
Sep 11 18:15:59.504659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:15:59.504629    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-657fcdcb9c-4ldmz"
Sep 11 18:16:02.360665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.360627    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b485767cb-hczf6"]
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.360992    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="pull"
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361004    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="pull"
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361021    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="util"
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361026    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="util"
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361033    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="extract"
Sep 11 18:16:02.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361038    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="extract"
Sep 11 18:16:02.361244 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.361100    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="60021f63-c4d8-40a6-9455-1b487cdbb234" containerName="extract"
Sep 11 18:16:02.366378 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.366360    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.373476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.373437    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 18:16:02.373959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.373939    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 18:16:02.396455 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.396429    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b485767cb-hczf6"]
Sep 11 18:16:02.511803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.511758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tls-certs\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.511974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.511820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2h48\" (UniqueName: \"kubernetes.io/projected/b9b7dc50-ab41-42aa-8d2d-404c6449c511-kube-api-access-t2h48\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.511974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.511920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tmp\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.613364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.613284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tls-certs\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.613364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.613322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2h48\" (UniqueName: \"kubernetes.io/projected/b9b7dc50-ab41-42aa-8d2d-404c6449c511-kube-api-access-t2h48\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.613364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.613360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tmp\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.615692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.615664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tmp\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.615905 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.615889    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7dc50-ab41-42aa-8d2d-404c6449c511-tls-certs\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.634943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.634917    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2h48\" (UniqueName: \"kubernetes.io/projected/b9b7dc50-ab41-42aa-8d2d-404c6449c511-kube-api-access-t2h48\") pod \"kube-auth-proxy-b485767cb-hczf6\" (UID: \"b9b7dc50-ab41-42aa-8d2d-404c6449c511\") " pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.675447 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.675420    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6"
Sep 11 18:16:02.973076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:02.973039    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b485767cb-hczf6"]
Sep 11 18:16:02.986273 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:16:02.986248    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b7dc50_ab41_42aa_8d2d_404c6449c511.slice/crio-90ddbb62a8dbf55541f527269e96277ef87473efc22c075a029b4cb7c0922114 WatchSource:0}: Error finding container 90ddbb62a8dbf55541f527269e96277ef87473efc22c075a029b4cb7c0922114: Status 404 returned error can't find the container with id 90ddbb62a8dbf55541f527269e96277ef87473efc22c075a029b4cb7c0922114
Sep 11 18:16:03.567208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:03.567174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6" event={"ID":"b9b7dc50-ab41-42aa-8d2d-404c6449c511","Type":"ContainerStarted","Data":"90ddbb62a8dbf55541f527269e96277ef87473efc22c075a029b4cb7c0922114"}
Sep 11 18:16:04.757156 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.757109    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:04.759913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.759889    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.764112 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.764003    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 18:16:04.764374 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.764345    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-887k5\""
Sep 11 18:16:04.764566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.764548    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 18:16:04.765084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.765062    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 18:16:04.768556 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.768531    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 18:16:04.782011 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.780640    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:04.932401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932501    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8cwn\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932757 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:04.932757 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:04.932735    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034107 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034107 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8cwn\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.034775 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.034746    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.037042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.037000    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.037142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.037106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.037199 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.037178    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.037377 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.037358    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.044176 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.044151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.044420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.044402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8cwn\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn\") pod \"istiod-openshift-gateway-7b7995d5cd-fzs4b\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:05.075443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:05.075412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:06.444172 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:06.443995    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:06.446641 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:16:06.446598    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda550aa81_e66b_49db_9565_ed50fb3d0ca1.slice/crio-07b33c43ebb3054983e66ff3e93acd549d03abe5828a05b2454e097e02461d8d WatchSource:0}: Error finding container 07b33c43ebb3054983e66ff3e93acd549d03abe5828a05b2454e097e02461d8d: Status 404 returned error can't find the container with id 07b33c43ebb3054983e66ff3e93acd549d03abe5828a05b2454e097e02461d8d
Sep 11 18:16:06.585670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:06.585628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6" event={"ID":"b9b7dc50-ab41-42aa-8d2d-404c6449c511","Type":"ContainerStarted","Data":"1675688d0e688759c6a5f5334458d869dd5889aab63514083f09d56faa8ae6a7"}
Sep 11 18:16:06.586869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:06.586846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" event={"ID":"a550aa81-e66b-49db-9565-ed50fb3d0ca1","Type":"ContainerStarted","Data":"07b33c43ebb3054983e66ff3e93acd549d03abe5828a05b2454e097e02461d8d"}
Sep 11 18:16:06.608099 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:06.608057    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b485767cb-hczf6" podStartSLOduration=1.374356125 podStartE2EDuration="4.608042525s" totalImagesPullingTime="3.2336864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:06.607045788 +0000 UTC m=+344.027820191" watchObservedRunningTime="2026-09-11 18:16:06.608042525 +0000 UTC m=+344.028816927"
Sep 11 18:16:09.033345 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:09.033288    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:09.033595 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:09.033382    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:09.605598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:09.605561    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" event={"ID":"a550aa81-e66b-49db-9565-ed50fb3d0ca1","Type":"ContainerStarted","Data":"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"}
Sep 11 18:16:09.605776 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:09.605625    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:09.630311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:09.630260    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" podStartSLOduration=3.045829066 podStartE2EDuration="5.630244722s" totalImagesPullingTime="2.584415656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:09.629043594 +0000 UTC m=+347.049817997" watchObservedRunningTime="2026-09-11 18:16:09.630244722 +0000 UTC m=+347.051019127"
Sep 11 18:16:10.613079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:10.613045    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fzs4b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:16:10.613565 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:10.613102    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:16:11.479086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.479050    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"]
Sep 11 18:16:11.482358 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.482342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.485391 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.485368    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d645t\""
Sep 11 18:16:11.487884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.487861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.487998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.487895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.487998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.487939    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.487998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.487985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.488160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.488000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10416f8c-aa48-4441-a5e3-09be19421c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.488160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.488027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.488160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.488065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.488160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.488085    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2h64\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-kube-api-access-c2h64\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.488160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.488120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.562937 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.562902    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"]
Sep 11 18:16:11.589412 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589378    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589508    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589569    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10416f8c-aa48-4441-a5e3-09be19421c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2h64\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-kube-api-access-c2h64\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589821    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.589995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.589921    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.590156 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.590132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.590397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.590372    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.590505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.590489    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10416f8c-aa48-4441-a5e3-09be19421c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.591940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.591914    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.592045 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.592027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.601306 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.601286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2h64\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-kube-api-access-c2h64\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.601632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.601614    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10416f8c-aa48-4441-a5e3-09be19421c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t\" (UID: \"10416f8c-aa48-4441-a5e3-09be19421c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:11.792240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:11.792159    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:12.093027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:12.092996    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"]
Sep 11 18:16:12.094575 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:16:12.094540    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10416f8c_aa48_4441_a5e3_09be19421c9d.slice/crio-aa7ff2660deff956e19ed15b9536ef92f2997a82dfce8953f6ebd1178a123df3 WatchSource:0}: Error finding container aa7ff2660deff956e19ed15b9536ef92f2997a82dfce8953f6ebd1178a123df3: Status 404 returned error can't find the container with id aa7ff2660deff956e19ed15b9536ef92f2997a82dfce8953f6ebd1178a123df3
Sep 11 18:16:12.621342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:12.621308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t" event={"ID":"10416f8c-aa48-4441-a5e3-09be19421c9d","Type":"ContainerStarted","Data":"aa7ff2660deff956e19ed15b9536ef92f2997a82dfce8953f6ebd1178a123df3"}
Sep 11 18:16:13.612837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:13.612781    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:14.966771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:14.966727    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:14.967089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:14.966828    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:14.967089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:14.966861    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:15.638872 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:15.638826    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t" event={"ID":"10416f8c-aa48-4441-a5e3-09be19421c9d","Type":"ContainerStarted","Data":"898fa161734714b591f3ba08777aa2912b0b784e69991629dddb65c8c097a6e0"}
Sep 11 18:16:15.677735 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:15.677681    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t" podStartSLOduration=1.807973591 podStartE2EDuration="4.677664048s" totalImagesPullingTime="2.869690457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:15.675427234 +0000 UTC m=+353.096201664" watchObservedRunningTime="2026-09-11 18:16:15.677664048 +0000 UTC m=+353.098438450"
Sep 11 18:16:15.792369 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:15.792327    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:16.798847 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:16.798774    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:17.649341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:17.649309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:17.650480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:17.650458    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t"
Sep 11 18:16:19.995044 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:19.995000    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"]
Sep 11 18:16:20.001985 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.001964    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.020186 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.020149    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"]
Sep 11 18:16:20.068396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxf76\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-kube-api-access-qxf76\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068549    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068694 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/604ab746-436f-4c83-b54b-de12b3e9691b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.068694 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.068599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.169750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.169708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.169945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.169808    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxf76\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-kube-api-access-qxf76\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.169945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.169850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.170073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.169936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.170073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.169995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.170073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.170041    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/604ab746-436f-4c83-b54b-de12b3e9691b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.170355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.170333    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.170844 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.170817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.172474 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.172445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/604ab746-436f-4c83-b54b-de12b3e9691b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.172581 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.172521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.172854 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.172840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.173145 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.173125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/604ab746-436f-4c83-b54b-de12b3e9691b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.205022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.204990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.205825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.205773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxf76\" (UniqueName: \"kubernetes.io/projected/604ab746-436f-4c83-b54b-de12b3e9691b-kube-api-access-qxf76\") pod \"istiod-openshift-gateway-5677ccb49b-hrqmq\" (UID: \"604ab746-436f-4c83-b54b-de12b3e9691b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.310864 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.310770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.594144 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.594066    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"]
Sep 11 18:16:20.597682 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:16:20.597656    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604ab746_436f_4c83_b54b_de12b3e9691b.slice/crio-efb07f116b7fa8025480abca472debf8ac03aa29661d10e651629905e5a87f8f WatchSource:0}: Error finding container efb07f116b7fa8025480abca472debf8ac03aa29661d10e651629905e5a87f8f: Status 404 returned error can't find the container with id efb07f116b7fa8025480abca472debf8ac03aa29661d10e651629905e5a87f8f
Sep 11 18:16:20.600689 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.600659    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:20.600782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.600718    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:16:20.665963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.665937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq" event={"ID":"604ab746-436f-4c83-b54b-de12b3e9691b","Type":"ContainerStarted","Data":"912b7d4a3f0fd1a497124f21751cd7894c1ccfbdf49b5ef682d8aa8e7344430b"}
Sep 11 18:16:20.666088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.665984    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq" event={"ID":"604ab746-436f-4c83-b54b-de12b3e9691b","Type":"ContainerStarted","Data":"efb07f116b7fa8025480abca472debf8ac03aa29661d10e651629905e5a87f8f"}
Sep 11 18:16:20.666088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.666055    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:20.707193 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:20.707133    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq" podStartSLOduration=1.707113163 podStartE2EDuration="1.707113163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:20.699046687 +0000 UTC m=+358.119821134" watchObservedRunningTime="2026-09-11 18:16:20.707113163 +0000 UTC m=+358.127887567"
Sep 11 18:16:21.677713 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:21.677678    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq"
Sep 11 18:16:21.776081 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:21.776044    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:21.776255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:21.776232    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerName="discovery" containerID="cri-o://097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e" gracePeriod=30
Sep 11 18:16:22.014731 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.014706    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:22.087632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087602    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8cwn\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087649    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087667    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087692    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087714    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087742    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.087833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.087768    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert\") pod \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\" (UID: \"a550aa81-e66b-49db-9565-ed50fb3d0ca1\") "
Sep 11 18:16:22.088154 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.088088    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:16:22.090422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090389    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs" (OuterVolumeSpecName: "local-certs") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:16:22.090568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090549    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts" (OuterVolumeSpecName: "cacerts") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:16:22.090645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090558    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:22.090645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090581    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn" (OuterVolumeSpecName: "kube-api-access-w8cwn") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "kube-api-access-w8cwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:16:22.090645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090581    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:16:22.090645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.090567    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a550aa81-e66b-49db-9565-ed50fb3d0ca1" (UID: "a550aa81-e66b-49db-9565-ed50fb3d0ca1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:16:22.188754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188669    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8cwn\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-kube-api-access-w8cwn\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.188754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188723    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-ca-configmap\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.188754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188738    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-cacerts\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.188754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188751    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.189017 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188763    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a550aa81-e66b-49db-9565-ed50fb3d0ca1-local-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.189017 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188774    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-kubeconfig\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.189017 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.188799    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a550aa81-e66b-49db-9565-ed50fb3d0ca1-istio-csr-dns-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:16:22.682936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.682887    2566 generic.go:356] "Generic (PLEG): container finished" podID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerID="097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e" exitCode=0
Sep 11 18:16:22.683406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.682957    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"
Sep 11 18:16:22.683406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.682980    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" event={"ID":"a550aa81-e66b-49db-9565-ed50fb3d0ca1","Type":"ContainerDied","Data":"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"}
Sep 11 18:16:22.683406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.683029    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b" event={"ID":"a550aa81-e66b-49db-9565-ed50fb3d0ca1","Type":"ContainerDied","Data":"07b33c43ebb3054983e66ff3e93acd549d03abe5828a05b2454e097e02461d8d"}
Sep 11 18:16:22.683406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.683048    2566 scope.go:117] "RemoveContainer" containerID="097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"
Sep 11 18:16:22.694523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.694500    2566 scope.go:117] "RemoveContainer" containerID="097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"
Sep 11 18:16:22.694849 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:16:22.694826    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e\": container with ID starting with 097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e not found: ID does not exist" containerID="097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"
Sep 11 18:16:22.694937 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.694862    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e"} err="failed to get container status \"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e\": rpc error: code = NotFound desc = could not find container \"097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e\": container with ID starting with 097d119391d66fef3c87f43395bcfebcd67ab249580990831bc1707d46a4a68e not found: ID does not exist"
Sep 11 18:16:22.745172 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.745132    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:22.758812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:22.758773    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b"]
Sep 11 18:16:23.061029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:23.061001    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" path="/var/lib/kubelet/pods/a550aa81-e66b-49db-9565-ed50fb3d0ca1/volumes"
Sep 11 18:16:24.001007 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.000974    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"]
Sep 11 18:16:24.001362 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.001299    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerName="discovery"
Sep 11 18:16:24.001362 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.001310    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerName="discovery"
Sep 11 18:16:24.001447 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.001366    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a550aa81-e66b-49db-9565-ed50fb3d0ca1" containerName="discovery"
Sep 11 18:16:24.005751 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.005713    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.013001 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.012978    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 18:16:24.013124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.013006    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jjkv4\""
Sep 11 18:16:24.023069 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.023045    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"]
Sep 11 18:16:24.108255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.108217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.108410 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.108276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmct8\" (UniqueName: \"kubernetes.io/projected/87bd9c00-842d-4074-a12b-0561a3ad88cb-kube-api-access-pmct8\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.208801 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.208746    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.208980 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.208845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmct8\" (UniqueName: \"kubernetes.io/projected/87bd9c00-842d-4074-a12b-0561a3ad88cb-kube-api-access-pmct8\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.208980 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:16:24.208916    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 18:16:24.209065 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:16:24.208992    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert podName:87bd9c00-842d-4074-a12b-0561a3ad88cb nodeName:}" failed. No retries permitted until 2026-09-11 18:16:24.708976558 +0000 UTC m=+362.129750939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert") pod "kserve-controller-manager-d6f4b65b8-l4pxm" (UID: "87bd9c00-842d-4074-a12b-0561a3ad88cb") : secret "kserve-webhook-server-cert" not found
Sep 11 18:16:24.225160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.225125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmct8\" (UniqueName: \"kubernetes.io/projected/87bd9c00-842d-4074-a12b-0561a3ad88cb-kube-api-access-pmct8\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.713801 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.713766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.716165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.716139    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87bd9c00-842d-4074-a12b-0561a3ad88cb-cert\") pod \"kserve-controller-manager-d6f4b65b8-l4pxm\" (UID: \"87bd9c00-842d-4074-a12b-0561a3ad88cb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:24.916536 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:24.916494    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:25.196139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:25.196111    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"]
Sep 11 18:16:25.198699 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:16:25.198670    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bd9c00_842d_4074_a12b_0561a3ad88cb.slice/crio-6d2a0dac84dfac0492a65034692e698f99648999837337d4d8a5ca0ab6844825 WatchSource:0}: Error finding container 6d2a0dac84dfac0492a65034692e698f99648999837337d4d8a5ca0ab6844825: Status 404 returned error can't find the container with id 6d2a0dac84dfac0492a65034692e698f99648999837337d4d8a5ca0ab6844825
Sep 11 18:16:25.698053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:25.698018    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm" event={"ID":"87bd9c00-842d-4074-a12b-0561a3ad88cb","Type":"ContainerStarted","Data":"6d2a0dac84dfac0492a65034692e698f99648999837337d4d8a5ca0ab6844825"}
Sep 11 18:16:28.716040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:28.715998    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm" event={"ID":"87bd9c00-842d-4074-a12b-0561a3ad88cb","Type":"ContainerStarted","Data":"d80f4ecded99842a6c9c0b7974cd93dfa48bb329f137ed56faaad001f091a7f7"}
Sep 11 18:16:28.716443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:28.716072    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:59.726467 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:59.726433    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm"
Sep 11 18:16:59.746462 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:16:59.746388    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-l4pxm" podStartSLOduration=34.035002675 podStartE2EDuration="36.746359284s" totalImagesPullingTime="2.711356609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:28.739657793 +0000 UTC m=+366.160432207" watchObservedRunningTime="2026-09-11 18:16:59.746359284 +0000 UTC m=+397.167133700"
Sep 11 18:17:18.718597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.718564    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"]
Sep 11 18:17:18.721106 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.721089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.723416 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.723391    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:17:18.724091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.724076    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cckg\""
Sep 11 18:17:18.724194 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.724078    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:17:18.736120 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.736092    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"]
Sep 11 18:17:18.763850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.763761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.763850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.763818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.764054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.763890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx6vn\" (UniqueName: \"kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.826455 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.826418    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"]
Sep 11 18:17:18.829465 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.829447    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.843673 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.843642    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"]
Sep 11 18:17:18.865005 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.864974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.865005 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.865234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865034    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.865234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv8gh\" (UniqueName: \"kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.865234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.865234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx6vn\" (UniqueName: \"kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.865424 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.865480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.865438    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.875479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.875450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx6vn\" (UniqueName: \"kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:18.925327 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.925294    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"]
Sep 11 18:17:18.927967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.927947    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:18.946420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.946391    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"]
Sep 11 18:17:18.965878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.965842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hf7s\" (UniqueName: \"kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:18.965878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.965879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.966128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:18.966128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966084    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.966128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv8gh\" (UniqueName: \"kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.966255 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966139    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:18.966293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.966401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.966383    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:18.974824 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:18.974736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv8gh\" (UniqueName: \"kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:19.029480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.029435    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"]
Sep 11 18:17:19.029696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.029672    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:19.032268 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.032037    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.045675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.045647    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"]
Sep 11 18:17:19.067013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.066976    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn49r\" (UniqueName: \"kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.067217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.067058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hf7s\" (UniqueName: \"kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.067217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.067210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.068304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.068273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.068424 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.068379    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.068494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.068468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.068746 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.068725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.068944 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.068924    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.076373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.076350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hf7s\" (UniqueName: \"kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.138479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.138445    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:19.169912 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.169868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn49r\" (UniqueName: \"kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.170106 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.169958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.170106 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.170044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.170480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.170451    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.170560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.170464    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.180065 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.180034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn49r\" (UniqueName: \"kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.236692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.236617    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:19.319210 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.319176    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"]
Sep 11 18:17:19.323139 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:19.323109    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ad6290_742b_4c1b_ba0a_e9c27f67b9db.slice/crio-45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808 WatchSource:0}: Error finding container 45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808: Status 404 returned error can't find the container with id 45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808
Sep 11 18:17:19.362559 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.362527    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:19.420336 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.420227    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"]
Sep 11 18:17:19.520415 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.520380    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"]
Sep 11 18:17:19.526431 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:19.526400    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc5e565_d9f8_4c5d_8cdb_7bd9063ef3ad.slice/crio-8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6 WatchSource:0}: Error finding container 8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6: Status 404 returned error can't find the container with id 8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6
Sep 11 18:17:19.644121 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.644087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"]
Sep 11 18:17:19.646401 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:19.646372    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c0872e_2446_44a8_b27b_fc9931ba4803.slice/crio-d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae WatchSource:0}: Error finding container d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae: Status 404 returned error can't find the container with id d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae
Sep 11 18:17:19.962755 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.962719    2566 generic.go:356] "Generic (PLEG): container finished" podID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerID="8407013b621ea0f9ef654cec8221c72f0c9cfca8492914a535d56cfcde951a4e" exitCode=0
Sep 11 18:17:19.963184 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.962817    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj" event={"ID":"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad","Type":"ContainerDied","Data":"8407013b621ea0f9ef654cec8221c72f0c9cfca8492914a535d56cfcde951a4e"}
Sep 11 18:17:19.963184 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.962871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj" event={"ID":"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad","Type":"ContainerStarted","Data":"8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6"}
Sep 11 18:17:19.964488 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.964463    2566 generic.go:356] "Generic (PLEG): container finished" podID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerID="2a6eaa7d7343fc4383ce847d3845bf91e0d73b198a8e4ffa63ea35f63d783f29" exitCode=0
Sep 11 18:17:19.964575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.964551    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8" event={"ID":"56ad6290-742b-4c1b-ba0a-e9c27f67b9db","Type":"ContainerDied","Data":"2a6eaa7d7343fc4383ce847d3845bf91e0d73b198a8e4ffa63ea35f63d783f29"}
Sep 11 18:17:19.964638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.964605    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8" event={"ID":"56ad6290-742b-4c1b-ba0a-e9c27f67b9db","Type":"ContainerStarted","Data":"45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808"}
Sep 11 18:17:19.966187 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.966164    2566 generic.go:356] "Generic (PLEG): container finished" podID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerID="66dc6b999e95f171af55d0996bf9495b5cd356e9e32a028cf449f76629309aa4" exitCode=0
Sep 11 18:17:19.966293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.966216    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm" event={"ID":"d2c0872e-2446-44a8-b27b-fc9931ba4803","Type":"ContainerDied","Data":"66dc6b999e95f171af55d0996bf9495b5cd356e9e32a028cf449f76629309aa4"}
Sep 11 18:17:19.966293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.966254    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm" event={"ID":"d2c0872e-2446-44a8-b27b-fc9931ba4803","Type":"ContainerStarted","Data":"d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae"}
Sep 11 18:17:19.967871 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.967851    2566 generic.go:356] "Generic (PLEG): container finished" podID="10650314-74dd-49cc-94c7-2cd8addef968" containerID="74bbf6d06a2246bdeecab14ddcce7b07484d55cadf8bda81a2bba01aeeb674d9" exitCode=0
Sep 11 18:17:19.967926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.967894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m" event={"ID":"10650314-74dd-49cc-94c7-2cd8addef968","Type":"ContainerDied","Data":"74bbf6d06a2246bdeecab14ddcce7b07484d55cadf8bda81a2bba01aeeb674d9"}
Sep 11 18:17:19.968076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:19.967928    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m" event={"ID":"10650314-74dd-49cc-94c7-2cd8addef968","Type":"ContainerStarted","Data":"ec1c34f14dcc14ff485307abddc399e50fe6392ce749a62d7f900726bb3b4ca7"}
Sep 11 18:17:20.974054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:20.974023    2566 generic.go:356] "Generic (PLEG): container finished" podID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerID="38ba299620ee3d3dad22b634c8f6d24d1aec360b52fe3456dfb0949b5de9ddde" exitCode=0
Sep 11 18:17:20.974539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:20.974112    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8" event={"ID":"56ad6290-742b-4c1b-ba0a-e9c27f67b9db","Type":"ContainerDied","Data":"38ba299620ee3d3dad22b634c8f6d24d1aec360b52fe3456dfb0949b5de9ddde"}
Sep 11 18:17:21.981300 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.981269    2566 generic.go:356] "Generic (PLEG): container finished" podID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerID="67a4df94dfcdc0eb3ac77cf6341020696944353dfd66e9a948aaf88c9247becb" exitCode=0
Sep 11 18:17:21.981735 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.981354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm" event={"ID":"d2c0872e-2446-44a8-b27b-fc9931ba4803","Type":"ContainerDied","Data":"67a4df94dfcdc0eb3ac77cf6341020696944353dfd66e9a948aaf88c9247becb"}
Sep 11 18:17:21.983246 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.983224    2566 generic.go:356] "Generic (PLEG): container finished" podID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerID="2faf3f73b5b3dda2612bd02cea15354a1858a20ca562ba55f418a69e9694a1e1" exitCode=0
Sep 11 18:17:21.983342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.983302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj" event={"ID":"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad","Type":"ContainerDied","Data":"2faf3f73b5b3dda2612bd02cea15354a1858a20ca562ba55f418a69e9694a1e1"}
Sep 11 18:17:21.992138 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.992113    2566 generic.go:356] "Generic (PLEG): container finished" podID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerID="a0c7d6bec1dd3fd1c84e0173552b9c51c5d337c4eadc4e9e10db21e13e7fcb8d" exitCode=0
Sep 11 18:17:21.992257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:21.992180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8" event={"ID":"56ad6290-742b-4c1b-ba0a-e9c27f67b9db","Type":"ContainerDied","Data":"a0c7d6bec1dd3fd1c84e0173552b9c51c5d337c4eadc4e9e10db21e13e7fcb8d"}
Sep 11 18:17:22.999495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:22.999463    2566 generic.go:356] "Generic (PLEG): container finished" podID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerID="634537a324a23fd7d59cde927627d4566a1be4e82bf8e8e9da8fe701a4aa6fe6" exitCode=0
Sep 11 18:17:22.999906 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:22.999543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj" event={"ID":"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad","Type":"ContainerDied","Data":"634537a324a23fd7d59cde927627d4566a1be4e82bf8e8e9da8fe701a4aa6fe6"}
Sep 11 18:17:23.001675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.001653    2566 generic.go:356] "Generic (PLEG): container finished" podID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerID="24b3919edfbc3aea0ed1bf4646601ebc4cadd37ddc18a1f221081244d2417797" exitCode=0
Sep 11 18:17:23.001780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.001729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm" event={"ID":"d2c0872e-2446-44a8-b27b-fc9931ba4803","Type":"ContainerDied","Data":"24b3919edfbc3aea0ed1bf4646601ebc4cadd37ddc18a1f221081244d2417797"}
Sep 11 18:17:23.131554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.131526    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:23.205719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.205692    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle\") pod \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") "
Sep 11 18:17:23.205885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.205733    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx6vn\" (UniqueName: \"kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn\") pod \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") "
Sep 11 18:17:23.205885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.205803    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util\") pod \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\" (UID: \"56ad6290-742b-4c1b-ba0a-e9c27f67b9db\") "
Sep 11 18:17:23.206273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.206248    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle" (OuterVolumeSpecName: "bundle") pod "56ad6290-742b-4c1b-ba0a-e9c27f67b9db" (UID: "56ad6290-742b-4c1b-ba0a-e9c27f67b9db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:23.207720 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.207697    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn" (OuterVolumeSpecName: "kube-api-access-dx6vn") pod "56ad6290-742b-4c1b-ba0a-e9c27f67b9db" (UID: "56ad6290-742b-4c1b-ba0a-e9c27f67b9db"). InnerVolumeSpecName "kube-api-access-dx6vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:17:23.210696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.210675    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util" (OuterVolumeSpecName: "util") pod "56ad6290-742b-4c1b-ba0a-e9c27f67b9db" (UID: "56ad6290-742b-4c1b-ba0a-e9c27f67b9db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:23.307495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.307393    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:23.307495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.307436    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx6vn\" (UniqueName: \"kubernetes.io/projected/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-kube-api-access-dx6vn\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:23.307495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:23.307451    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56ad6290-742b-4c1b-ba0a-e9c27f67b9db-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.008782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.008746    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8"
Sep 11 18:17:24.008782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.008771    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qjnt8" event={"ID":"56ad6290-742b-4c1b-ba0a-e9c27f67b9db","Type":"ContainerDied","Data":"45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808"}
Sep 11 18:17:24.009216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.008843    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ffb4661bd3831fa2e7f98144e50b31a6860b7e0097a3a5a29a38c22a346808"
Sep 11 18:17:24.149490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.149459    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:24.185535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.185505    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:24.214571 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.214540    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle\") pod \"d2c0872e-2446-44a8-b27b-fc9931ba4803\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") "
Sep 11 18:17:24.215050 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.214603    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn49r\" (UniqueName: \"kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r\") pod \"d2c0872e-2446-44a8-b27b-fc9931ba4803\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") "
Sep 11 18:17:24.215050 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.214636    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util\") pod \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") "
Sep 11 18:17:24.215050 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.214653    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util\") pod \"d2c0872e-2446-44a8-b27b-fc9931ba4803\" (UID: \"d2c0872e-2446-44a8-b27b-fc9931ba4803\") "
Sep 11 18:17:24.215050 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.214698    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hf7s\" (UniqueName: \"kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s\") pod \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") "
Sep 11 18:17:24.215300 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.215057    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle\") pod \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\" (UID: \"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad\") "
Sep 11 18:17:24.215418 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.215258    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle" (OuterVolumeSpecName: "bundle") pod "d2c0872e-2446-44a8-b27b-fc9931ba4803" (UID: "d2c0872e-2446-44a8-b27b-fc9931ba4803"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:24.215580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.215553    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle" (OuterVolumeSpecName: "bundle") pod "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" (UID: "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:24.217101 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.217077    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r" (OuterVolumeSpecName: "kube-api-access-pn49r") pod "d2c0872e-2446-44a8-b27b-fc9931ba4803" (UID: "d2c0872e-2446-44a8-b27b-fc9931ba4803"). InnerVolumeSpecName "kube-api-access-pn49r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:17:24.217223 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.217176    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s" (OuterVolumeSpecName: "kube-api-access-7hf7s") pod "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" (UID: "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad"). InnerVolumeSpecName "kube-api-access-7hf7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:17:24.220765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.220740    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util" (OuterVolumeSpecName: "util") pod "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" (UID: "adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:24.223619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.223577    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util" (OuterVolumeSpecName: "util") pod "d2c0872e-2446-44a8-b27b-fc9931ba4803" (UID: "d2c0872e-2446-44a8-b27b-fc9931ba4803"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316634    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316664    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316674    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hf7s\" (UniqueName: \"kubernetes.io/projected/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-kube-api-access-7hf7s\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316684    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316693    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0872e-2446-44a8-b27b-fc9931ba4803-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:24.316719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:24.316701    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn49r\" (UniqueName: \"kubernetes.io/projected/d2c0872e-2446-44a8-b27b-fc9931ba4803-kube-api-access-pn49r\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:25.017641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.017611    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm"
Sep 11 18:17:25.017641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.017630    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cks8cm" event={"ID":"d2c0872e-2446-44a8-b27b-fc9931ba4803","Type":"ContainerDied","Data":"d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae"}
Sep 11 18:17:25.018113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.017709    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d255863876d9415e5c80d451c8a142d35a2c5cc5c39c2a631ba67a36452871ae"
Sep 11 18:17:25.019560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.019536    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj" event={"ID":"adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad","Type":"ContainerDied","Data":"8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6"}
Sep 11 18:17:25.019682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.019574    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f72e3ddab9dd7a1b4e7751f2da3aea9e75ceacce101b3a87b9b063ef90c29a6"
Sep 11 18:17:25.019682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:25.019572    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68t2fj"
Sep 11 18:17:32.058889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:32.058852    2566 generic.go:356] "Generic (PLEG): container finished" podID="10650314-74dd-49cc-94c7-2cd8addef968" containerID="47d988d3d0918426d81f159ca89c37894d69d65f16918fc5a3a21da540f5706d" exitCode=0
Sep 11 18:17:32.059258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:32.058935    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m" event={"ID":"10650314-74dd-49cc-94c7-2cd8addef968","Type":"ContainerDied","Data":"47d988d3d0918426d81f159ca89c37894d69d65f16918fc5a3a21da540f5706d"}
Sep 11 18:17:33.065407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:33.065370    2566 generic.go:356] "Generic (PLEG): container finished" podID="10650314-74dd-49cc-94c7-2cd8addef968" containerID="6e8bdacfec849fb45c24f44db8a1ad3c5804b7d23802962511cd931fdc6e9898" exitCode=0
Sep 11 18:17:33.065829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:33.065461    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m" event={"ID":"10650314-74dd-49cc-94c7-2cd8addef968","Type":"ContainerDied","Data":"6e8bdacfec849fb45c24f44db8a1ad3c5804b7d23802962511cd931fdc6e9898"}
Sep 11 18:17:34.193481 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.193457    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:34.302030 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.301989    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle\") pod \"10650314-74dd-49cc-94c7-2cd8addef968\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") "
Sep 11 18:17:34.302234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.302039    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv8gh\" (UniqueName: \"kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh\") pod \"10650314-74dd-49cc-94c7-2cd8addef968\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") "
Sep 11 18:17:34.302234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.302063    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util\") pod \"10650314-74dd-49cc-94c7-2cd8addef968\" (UID: \"10650314-74dd-49cc-94c7-2cd8addef968\") "
Sep 11 18:17:34.302655 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.302617    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle" (OuterVolumeSpecName: "bundle") pod "10650314-74dd-49cc-94c7-2cd8addef968" (UID: "10650314-74dd-49cc-94c7-2cd8addef968"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:34.304104 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.304077    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh" (OuterVolumeSpecName: "kube-api-access-hv8gh") pod "10650314-74dd-49cc-94c7-2cd8addef968" (UID: "10650314-74dd-49cc-94c7-2cd8addef968"). InnerVolumeSpecName "kube-api-access-hv8gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:17:34.306138 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.306117    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util" (OuterVolumeSpecName: "util") pod "10650314-74dd-49cc-94c7-2cd8addef968" (UID: "10650314-74dd-49cc-94c7-2cd8addef968"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:17:34.402924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.402843    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:34.402924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.402870    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv8gh\" (UniqueName: \"kubernetes.io/projected/10650314-74dd-49cc-94c7-2cd8addef968-kube-api-access-hv8gh\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:34.402924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:34.402880    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10650314-74dd-49cc-94c7-2cd8addef968-util\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:17:35.076341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:35.076319    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m"
Sep 11 18:17:35.076470 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:35.076344    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adkl5m" event={"ID":"10650314-74dd-49cc-94c7-2cd8addef968","Type":"ContainerDied","Data":"ec1c34f14dcc14ff485307abddc399e50fe6392ce749a62d7f900726bb3b4ca7"}
Sep 11 18:17:35.076470 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:35.076400    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec1c34f14dcc14ff485307abddc399e50fe6392ce749a62d7f900726bb3b4ca7"
Sep 11 18:17:40.347782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.347746    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"]
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348092    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="util"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348104    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="util"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348113    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="extract"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348118    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="extract"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348129    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="pull"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348134    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="pull"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348144    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="util"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348149    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="util"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348155    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="extract"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348160    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="extract"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348170    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="extract"
Sep 11 18:17:40.348171 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348175    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348184    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348188    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348193    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348198    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348205    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="util"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348209    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="util"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348216    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="util"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348221    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="util"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348229    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348234    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="pull"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348238    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348243    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348291    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c0872e-2446-44a8-b27b-fc9931ba4803" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348300    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ad6290-742b-4c1b-ba0a-e9c27f67b9db" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348306    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="10650314-74dd-49cc-94c7-2cd8addef968" containerName="extract"
Sep 11 18:17:40.348519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.348313    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc5e565-d9f8-4c5d-8cdb-7bd9063ef3ad" containerName="extract"
Sep 11 18:17:40.350457 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.350441    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:40.353284 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.353264    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 18:17:40.354367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.354345    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 18:17:40.354455 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.354409    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cztqz\""
Sep 11 18:17:40.375481 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.375454    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"]
Sep 11 18:17:40.457088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.457048    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzjgk\" (UniqueName: \"kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk\") pod \"limitador-operator-controller-manager-74495c69f8-gj54x\" (UID: \"d0a34f17-8068-4089-b555-140dfad03033\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:40.558529 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.558487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzjgk\" (UniqueName: \"kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk\") pod \"limitador-operator-controller-manager-74495c69f8-gj54x\" (UID: \"d0a34f17-8068-4089-b555-140dfad03033\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:40.571597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.571569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzjgk\" (UniqueName: \"kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk\") pod \"limitador-operator-controller-manager-74495c69f8-gj54x\" (UID: \"d0a34f17-8068-4089-b555-140dfad03033\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:40.660080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.659995    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:40.713264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.713230    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669cb74fb8-m2q7v"]
Sep 11 18:17:40.717612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.717583    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.734499 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.734425    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669cb74fb8-m2q7v"]
Sep 11 18:17:40.860381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860345    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-service-ca\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860383    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rhzs\" (UniqueName: \"kubernetes.io/projected/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-kube-api-access-9rhzs\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-trusted-ca-bundle\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860476    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-oauth-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.860841 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.860646    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-oauth-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.945234 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.945196    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"]
Sep 11 18:17:40.948188 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:40.948156    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a34f17_8068_4089_b555_140dfad03033.slice/crio-0c1a59a894938d6ba80665c558761a82ae681315803badf1355a9477a9b04e43 WatchSource:0}: Error finding container 0c1a59a894938d6ba80665c558761a82ae681315803badf1355a9477a9b04e43: Status 404 returned error can't find the container with id 0c1a59a894938d6ba80665c558761a82ae681315803badf1355a9477a9b04e43
Sep 11 18:17:40.961131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961105    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-service-ca\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961260 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961136    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rhzs\" (UniqueName: \"kubernetes.io/projected/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-kube-api-access-9rhzs\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961326 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-trusted-ca-bundle\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961334    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961368    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-oauth-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961474 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961409    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.961525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-oauth-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.962020 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.961998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-service-ca\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.962134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.962102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-trusted-ca-bundle\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.962189 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.962164    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.962248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.962214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-oauth-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.963852 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.963827    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-serving-cert\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.963934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.963890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-console-oauth-config\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:40.978124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:40.978105    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rhzs\" (UniqueName: \"kubernetes.io/projected/3d0ea0e4-fd97-4729-85f5-fec09a6a27ec-kube-api-access-9rhzs\") pod \"console-669cb74fb8-m2q7v\" (UID: \"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec\") " pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:41.030568 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:41.030537    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:41.108165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:41.108129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x" event={"ID":"d0a34f17-8068-4089-b555-140dfad03033","Type":"ContainerStarted","Data":"0c1a59a894938d6ba80665c558761a82ae681315803badf1355a9477a9b04e43"}
Sep 11 18:17:41.317130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:41.317104    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669cb74fb8-m2q7v"]
Sep 11 18:17:41.319546 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:41.319519    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0ea0e4_fd97_4729_85f5_fec09a6a27ec.slice/crio-6d35984938bc6dac6c7fcfadd4c111b4d13ded73e31d96cfa047e2e24c086677 WatchSource:0}: Error finding container 6d35984938bc6dac6c7fcfadd4c111b4d13ded73e31d96cfa047e2e24c086677: Status 404 returned error can't find the container with id 6d35984938bc6dac6c7fcfadd4c111b4d13ded73e31d96cfa047e2e24c086677
Sep 11 18:17:42.117806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:42.117757    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cb74fb8-m2q7v" event={"ID":"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec","Type":"ContainerStarted","Data":"5b3119c4bf56438b0177f8aee0d2f16064d6836b7c73ca7fff6d248a2cb75848"}
Sep 11 18:17:42.118268 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:42.117830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cb74fb8-m2q7v" event={"ID":"3d0ea0e4-fd97-4729-85f5-fec09a6a27ec","Type":"ContainerStarted","Data":"6d35984938bc6dac6c7fcfadd4c111b4d13ded73e31d96cfa047e2e24c086677"}
Sep 11 18:17:42.140893 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:42.140837    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669cb74fb8-m2q7v" podStartSLOduration=2.140818344 podStartE2EDuration="2.140818344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:42.139601707 +0000 UTC m=+439.560376111" watchObservedRunningTime="2026-09-11 18:17:42.140818344 +0000 UTC m=+439.561592742"
Sep 11 18:17:44.132283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.132245    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x" event={"ID":"d0a34f17-8068-4089-b555-140dfad03033","Type":"ContainerStarted","Data":"1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166"}
Sep 11 18:17:44.132667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.132307    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:44.159222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.156392    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x" podStartSLOduration=1.911881562 podStartE2EDuration="4.156372118s" totalImagesPullingTime="2.244490556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:44.151565376 +0000 UTC m=+441.572339778" watchObservedRunningTime="2026-09-11 18:17:44.156372118 +0000 UTC m=+441.577146520"
Sep 11 18:17:44.918979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.918941    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"]
Sep 11 18:17:44.922895 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.922862    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:44.929541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.929520    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 18:17:44.931303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.931285    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-khjpd\""
Sep 11 18:17:44.938208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.938184    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"]
Sep 11 18:17:44.999771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:44.999730    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrshc\" (UniqueName: \"kubernetes.io/projected/63221dd1-0a26-464d-ac9f-0dec7e26dacd-kube-api-access-qrshc\") pod \"dns-operator-controller-manager-7b84cd7c9c-smssk\" (UID: \"63221dd1-0a26-464d-ac9f-0dec7e26dacd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:45.100525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:45.100491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrshc\" (UniqueName: \"kubernetes.io/projected/63221dd1-0a26-464d-ac9f-0dec7e26dacd-kube-api-access-qrshc\") pod \"dns-operator-controller-manager-7b84cd7c9c-smssk\" (UID: \"63221dd1-0a26-464d-ac9f-0dec7e26dacd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:45.119587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:45.119553    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrshc\" (UniqueName: \"kubernetes.io/projected/63221dd1-0a26-464d-ac9f-0dec7e26dacd-kube-api-access-qrshc\") pod \"dns-operator-controller-manager-7b84cd7c9c-smssk\" (UID: \"63221dd1-0a26-464d-ac9f-0dec7e26dacd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:45.232772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:45.232697    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:45.510061 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:45.510033    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"]
Sep 11 18:17:45.512065 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:17:45.512021    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63221dd1_0a26_464d_ac9f_0dec7e26dacd.slice/crio-64790d3efac33247e9047d323d3e194be2704db4e494812a3948130198917835 WatchSource:0}: Error finding container 64790d3efac33247e9047d323d3e194be2704db4e494812a3948130198917835: Status 404 returned error can't find the container with id 64790d3efac33247e9047d323d3e194be2704db4e494812a3948130198917835
Sep 11 18:17:46.144303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:46.144272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk" event={"ID":"63221dd1-0a26-464d-ac9f-0dec7e26dacd","Type":"ContainerStarted","Data":"64790d3efac33247e9047d323d3e194be2704db4e494812a3948130198917835"}
Sep 11 18:17:48.159062 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:48.159030    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk" event={"ID":"63221dd1-0a26-464d-ac9f-0dec7e26dacd","Type":"ContainerStarted","Data":"630456dc19825ba86b91322aad532fc8038e24fe1b368638731f029fae77bf95"}
Sep 11 18:17:48.159459 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:48.159168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:17:48.183687 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:48.183632    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk" podStartSLOduration=2.458049616 podStartE2EDuration="4.183616984s" totalImagesPullingTime="1.725567368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:48.182149382 +0000 UTC m=+445.602923785" watchObservedRunningTime="2026-09-11 18:17:48.183616984 +0000 UTC m=+445.604391386"
Sep 11 18:17:51.031699 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:51.031658    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:51.032250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:51.031749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:51.036748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:51.036726    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:51.179555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:51.179523    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669cb74fb8-m2q7v"
Sep 11 18:17:51.251196 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:51.251160    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:17:55.140736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:55.140699    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:17:59.167368 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:17:59.167332    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-smssk"
Sep 11 18:18:07.484400 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.484361    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"]
Sep 11 18:18:07.489541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.489516    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.492381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.492361    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zwkz4\""
Sep 11 18:18:07.504195 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.504169    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"]
Sep 11 18:18:07.597395 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.597356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdt85\" (UniqueName: \"kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.597580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.597415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.698533 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.698493    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdt85\" (UniqueName: \"kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.698720 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.698547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.698964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.698946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.711366 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.711330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdt85\" (UniqueName: \"kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85\") pod \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:07.799841 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:07.799724    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:08.101282 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.101260    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"]
Sep 11 18:18:08.104325 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:18:08.104298    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4800fc_f430_444e_8f5d_36dc1a16bb27.slice/crio-70eec217807e70bd57cc95c11d12f9b0b1ba0022540266f60c8409320dd8e1a5 WatchSource:0}: Error finding container 70eec217807e70bd57cc95c11d12f9b0b1ba0022540266f60c8409320dd8e1a5: Status 404 returned error can't find the container with id 70eec217807e70bd57cc95c11d12f9b0b1ba0022540266f60c8409320dd8e1a5
Sep 11 18:18:08.163427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.163395    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"]
Sep 11 18:18:08.171318 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.171293    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"]
Sep 11 18:18:08.192266 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.192236    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:08.197094 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.197070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.211293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.211270    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"]
Sep 11 18:18:08.211453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.211434    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x" podUID="d0a34f17-8068-4089-b555-140dfad03033" containerName="manager" containerID="cri-o://1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166" gracePeriod=2
Sep 11 18:18:08.219407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.219270    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:08.222818 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.222771    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"]
Sep 11 18:18:08.249292 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:08.249248    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gj54x\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="d0a34f17-8068-4089-b555-140dfad03033" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:18:08.254780 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.254753    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"]
Sep 11 18:18:08.255151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.255136    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a34f17-8068-4089-b555-140dfad03033" containerName="manager"
Sep 11 18:18:08.255151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.255152    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a34f17-8068-4089-b555-140dfad03033" containerName="manager"
Sep 11 18:18:08.255282 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.255219    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a34f17-8068-4089-b555-140dfad03033" containerName="manager"
Sep 11 18:18:08.258323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.258304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:08.260525 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:08.260490    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gj54x\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="d0a34f17-8068-4089-b555-140dfad03033" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:18:08.267889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.267861    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"]
Sep 11 18:18:08.304230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.304197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhqx\" (UniqueName: \"kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.304391 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.304263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.405476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.405438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.405619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.405571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhqx\" (UniqueName: \"kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.405619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.405611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59n5h\" (UniqueName: \"kubernetes.io/projected/da42e5cd-97fa-4d8b-9e2e-8c5441294bd4-kube-api-access-59n5h\") pod \"limitador-operator-controller-manager-74495c69f8-scr78\" (UID: \"da42e5cd-97fa-4d8b-9e2e-8c5441294bd4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:08.405896 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.405873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.421069 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.421042    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhqx\" (UniqueName: \"kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx\") pod \"kuadrant-operator-controller-manager-5f685c496f-2b6bj\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.441663 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.441638    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:18:08.443516 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:08.443491    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gj54x\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="d0a34f17-8068-4089-b555-140dfad03033" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:18:08.506986 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.506952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59n5h\" (UniqueName: \"kubernetes.io/projected/da42e5cd-97fa-4d8b-9e2e-8c5441294bd4-kube-api-access-59n5h\") pod \"limitador-operator-controller-manager-74495c69f8-scr78\" (UID: \"da42e5cd-97fa-4d8b-9e2e-8c5441294bd4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:08.507759 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.507741    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:08.519681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.519654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59n5h\" (UniqueName: \"kubernetes.io/projected/da42e5cd-97fa-4d8b-9e2e-8c5441294bd4-kube-api-access-59n5h\") pod \"limitador-operator-controller-manager-74495c69f8-scr78\" (UID: \"da42e5cd-97fa-4d8b-9e2e-8c5441294bd4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:08.590987 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.590958    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:08.608355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.608325    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzjgk\" (UniqueName: \"kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk\") pod \"d0a34f17-8068-4089-b555-140dfad03033\" (UID: \"d0a34f17-8068-4089-b555-140dfad03033\") "
Sep 11 18:18:08.610371 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.610343    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk" (OuterVolumeSpecName: "kube-api-access-rzjgk") pod "d0a34f17-8068-4089-b555-140dfad03033" (UID: "d0a34f17-8068-4089-b555-140dfad03033"). InnerVolumeSpecName "kube-api-access-rzjgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:08.709480 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.709443    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzjgk\" (UniqueName: \"kubernetes.io/projected/d0a34f17-8068-4089-b555-140dfad03033-kube-api-access-rzjgk\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:08.795749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.795720    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:08.798636 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:18:08.798601    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb774271d_cc6e_46ec_bb74_a0b74080a773.slice/crio-08e09e3af4dc1030ac127d536b38c169748cd685b659a7821548da15a451ffa1 WatchSource:0}: Error finding container 08e09e3af4dc1030ac127d536b38c169748cd685b659a7821548da15a451ffa1: Status 404 returned error can't find the container with id 08e09e3af4dc1030ac127d536b38c169748cd685b659a7821548da15a451ffa1
Sep 11 18:18:08.870073 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:08.869947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"]
Sep 11 18:18:08.872966 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:18:08.872935    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda42e5cd_97fa_4d8b_9e2e_8c5441294bd4.slice/crio-474128ddde2b322de9c27741a4eab8794e6c03adbcf45c70a9ae22204968341b WatchSource:0}: Error finding container 474128ddde2b322de9c27741a4eab8794e6c03adbcf45c70a9ae22204968341b: Status 404 returned error can't find the container with id 474128ddde2b322de9c27741a4eab8794e6c03adbcf45c70a9ae22204968341b
Sep 11 18:18:09.063226 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.063184    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a34f17-8068-4089-b555-140dfad03033" path="/var/lib/kubelet/pods/d0a34f17-8068-4089-b555-140dfad03033/volumes"
Sep 11 18:18:09.288413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.288377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78" event={"ID":"da42e5cd-97fa-4d8b-9e2e-8c5441294bd4","Type":"ContainerStarted","Data":"5c46f94d53cd350b150b1b04977aaccefdd860eea2e02b84206d3f579c4ff644"}
Sep 11 18:18:09.288605 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.288438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78" event={"ID":"da42e5cd-97fa-4d8b-9e2e-8c5441294bd4","Type":"ContainerStarted","Data":"474128ddde2b322de9c27741a4eab8794e6c03adbcf45c70a9ae22204968341b"}
Sep 11 18:18:09.288605 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.288479    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:09.290399 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.290340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" event={"ID":"b774271d-cc6e-46ec-bb74-a0b74080a773","Type":"ContainerStarted","Data":"08e09e3af4dc1030ac127d536b38c169748cd685b659a7821548da15a451ffa1"}
Sep 11 18:18:09.292254 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.292229    2566 generic.go:356] "Generic (PLEG): container finished" podID="d0a34f17-8068-4089-b555-140dfad03033" containerID="1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166" exitCode=0
Sep 11 18:18:09.292363 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.292274    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gj54x"
Sep 11 18:18:09.292363 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.292284    2566 scope.go:117] "RemoveContainer" containerID="1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166"
Sep 11 18:18:09.303732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.303704    2566 scope.go:117] "RemoveContainer" containerID="1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166"
Sep 11 18:18:09.304216 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:09.304188    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166\": container with ID starting with 1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166 not found: ID does not exist" containerID="1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166"
Sep 11 18:18:09.304314 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.304227    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166"} err="failed to get container status \"1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166\": rpc error: code = NotFound desc = could not find container \"1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166\": container with ID starting with 1fe2496a2e91aea2cc2074d3fdc8ff86d6d7a6f725551447a48060a0851b6166 not found: ID does not exist"
Sep 11 18:18:09.320675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:09.320627    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78" podStartSLOduration=1.320607169 podStartE2EDuration="1.320607169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:09.319007047 +0000 UTC m=+466.739781532" watchObservedRunningTime="2026-09-11 18:18:09.320607169 +0000 UTC m=+466.741381574"
Sep 11 18:18:12.315511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.315476    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" event={"ID":"b774271d-cc6e-46ec-bb74-a0b74080a773","Type":"ContainerStarted","Data":"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"}
Sep 11 18:18:12.315943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.315543    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:12.317340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.317312    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" containerName="manager" containerID="cri-o://750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b" gracePeriod=2
Sep 11 18:18:12.340633 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.340586    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" podStartSLOduration=1.322119609 podStartE2EDuration="4.340565669s" totalImagesPullingTime="3.01844606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:12.339900288 +0000 UTC m=+469.760674691" watchObservedRunningTime="2026-09-11 18:18:12.340565669 +0000 UTC m=+469.761340073"
Sep 11 18:18:12.562047 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.562017    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:12.563941 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:12.563917    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:12.648068 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.647985    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume\") pod \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") "
Sep 11 18:18:12.648197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.648108    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdt85\" (UniqueName: \"kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85\") pod \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\" (UID: \"9a4800fc-f430-444e-8f5d-36dc1a16bb27\") "
Sep 11 18:18:12.648246 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.648223    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a4800fc-f430-444e-8f5d-36dc1a16bb27" (UID: "9a4800fc-f430-444e-8f5d-36dc1a16bb27"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:18:12.648382 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.648364    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a4800fc-f430-444e-8f5d-36dc1a16bb27-extensions-socket-volume\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:12.650126 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.650102    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85" (OuterVolumeSpecName: "kube-api-access-jdt85") pod "9a4800fc-f430-444e-8f5d-36dc1a16bb27" (UID: "9a4800fc-f430-444e-8f5d-36dc1a16bb27"). InnerVolumeSpecName "kube-api-access-jdt85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:12.749186 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:12.749151    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdt85\" (UniqueName: \"kubernetes.io/projected/9a4800fc-f430-444e-8f5d-36dc1a16bb27-kube-api-access-jdt85\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:13.060591 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:13.060555    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:13.062024 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.062004    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" path="/var/lib/kubelet/pods/9a4800fc-f430-444e-8f5d-36dc1a16bb27/volumes"
Sep 11 18:18:13.324084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.323994    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" containerID="750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b" exitCode=2
Sep 11 18:18:13.324084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.324043    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:13.324084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.324052    2566 scope.go:117] "RemoveContainer" containerID="750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b"
Sep 11 18:18:13.328290 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:13.328263    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-qvsc7\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qvsc7"
Sep 11 18:18:13.332681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.332663    2566 scope.go:117] "RemoveContainer" containerID="750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b"
Sep 11 18:18:13.332963 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:13.332944    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b\": container with ID starting with 750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b not found: ID does not exist" containerID="750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b"
Sep 11 18:18:13.333018 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:13.332972    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b"} err="failed to get container status \"750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b\": rpc error: code = NotFound desc = could not find container \"750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b\": container with ID starting with 750b57d73bc4f572212ca12bda609b275069470bfda08702fadb9300de839d9b not found: ID does not exist"
Sep 11 18:18:16.272732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.272692    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77459d67c-5m2nr" podUID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" containerName="console" containerID="cri-o://3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641" gracePeriod=15
Sep 11 18:18:16.517707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.517682    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:18:16.581914 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.581826    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.581914 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.581878    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.581914 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.581914    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.582183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.581931    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.582183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.581949    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.582183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582019    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qpqj\" (UniqueName: \"kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.582183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582041    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config\") pod \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\" (UID: \"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84\") "
Sep 11 18:18:16.582390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582340    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:16.582390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582342    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:16.582525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582401    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:16.582593 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.582566    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config" (OuterVolumeSpecName: "console-config") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:16.584141 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.584114    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:18:16.584262 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.584240    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj" (OuterVolumeSpecName: "kube-api-access-6qpqj") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "kube-api-access-6qpqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:16.584315 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.584244    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" (UID: "c0a749d5-bcf2-49a5-bbb9-aa941a9fde84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:18:16.683192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683156    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qpqj\" (UniqueName: \"kubernetes.io/projected/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-kube-api-access-6qpqj\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683185    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683195    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-oauth-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683204    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-serving-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683214    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-trusted-ca-bundle\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683223    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:16.683420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:16.683230    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84-console-oauth-config\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:17.349701 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.349608    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" containerID="3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641" exitCode=0
Sep 11 18:18:17.349701 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.349656    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459d67c-5m2nr"
Sep 11 18:18:17.350229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.349695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459d67c-5m2nr" event={"ID":"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84","Type":"ContainerDied","Data":"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"}
Sep 11 18:18:17.350229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.349743    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459d67c-5m2nr" event={"ID":"c0a749d5-bcf2-49a5-bbb9-aa941a9fde84","Type":"ContainerDied","Data":"02e8df0fe0b7140be7d33736a6a2347dae418f3fd4a577ca8fa8f4c46f5c7136"}
Sep 11 18:18:17.350229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.349763    2566 scope.go:117] "RemoveContainer" containerID="3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"
Sep 11 18:18:17.358336 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.358309    2566 scope.go:117] "RemoveContainer" containerID="3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"
Sep 11 18:18:17.358648 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:17.358629    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641\": container with ID starting with 3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641 not found: ID does not exist" containerID="3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"
Sep 11 18:18:17.358703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.358659    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641"} err="failed to get container status \"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641\": rpc error: code = NotFound desc = could not find container \"3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641\": container with ID starting with 3f51fc1167f12ba0d16c74a29dc125fadd1d3c316a3e40dcb59285d062860641 not found: ID does not exist"
Sep 11 18:18:17.368366 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.368338    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:18:17.371414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:17.371388    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77459d67c-5m2nr"]
Sep 11 18:18:19.061158 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:19.061124    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" path="/var/lib/kubelet/pods/c0a749d5-bcf2-49a5-bbb9-aa941a9fde84/volumes"
Sep 11 18:18:20.304519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:20.304491    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-scr78"
Sep 11 18:18:23.327093 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.326992    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:23.670196 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670162    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:18:23.670537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670525    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" containerName="console"
Sep 11 18:18:23.670587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670539    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" containerName="console"
Sep 11 18:18:23.670587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670555    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" containerName="manager"
Sep 11 18:18:23.670587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670561    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" containerName="manager"
Sep 11 18:18:23.670678 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670629    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a4800fc-f430-444e-8f5d-36dc1a16bb27" containerName="manager"
Sep 11 18:18:23.670678 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.670640    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a749d5-bcf2-49a5-bbb9-aa941a9fde84" containerName="console"
Sep 11 18:18:23.673796 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.673766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.691567 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.691536    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:18:23.742125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.742093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqg9p\" (UniqueName: \"kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.742317 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.742141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.843002 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.842966    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqg9p\" (UniqueName: \"kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.843190 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.843015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.843397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.843377    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.868374 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.868335    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqg9p\" (UniqueName: \"kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wbc2h\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:23.984027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:23.983993    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:24.269866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:24.269840    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:18:24.271387 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:18:24.271365    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd07201_2262_4463_8a65_72094f2f5d56.slice/crio-283b9da66622aa90539870e9264cdec80f73fa68853f19c36272a9c9cac87053 WatchSource:0}: Error finding container 283b9da66622aa90539870e9264cdec80f73fa68853f19c36272a9c9cac87053: Status 404 returned error can't find the container with id 283b9da66622aa90539870e9264cdec80f73fa68853f19c36272a9c9cac87053
Sep 11 18:18:24.391876 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:24.391835    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" event={"ID":"7bd07201-2262-4463-8a65-72094f2f5d56","Type":"ContainerStarted","Data":"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"}
Sep 11 18:18:24.392294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:24.391900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" event={"ID":"7bd07201-2262-4463-8a65-72094f2f5d56","Type":"ContainerStarted","Data":"283b9da66622aa90539870e9264cdec80f73fa68853f19c36272a9c9cac87053"}
Sep 11 18:18:24.392294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:24.391960    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:24.426427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:24.426240    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" podStartSLOduration=1.426223798 podStartE2EDuration="1.426223798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:24.425340722 +0000 UTC m=+481.846115139" watchObservedRunningTime="2026-09-11 18:18:24.426223798 +0000 UTC m=+481.846998201"
Sep 11 18:18:35.400645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.400611    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:18:35.468117 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.468079    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:35.468313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.468275    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" podUID="b774271d-cc6e-46ec-bb74-a0b74080a773" containerName="manager" containerID="cri-o://58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413" gracePeriod=10
Sep 11 18:18:35.718909 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.718883    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:35.851993 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.851962    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnhqx\" (UniqueName: \"kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx\") pod \"b774271d-cc6e-46ec-bb74-a0b74080a773\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") "
Sep 11 18:18:35.852186 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.852011    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume\") pod \"b774271d-cc6e-46ec-bb74-a0b74080a773\" (UID: \"b774271d-cc6e-46ec-bb74-a0b74080a773\") "
Sep 11 18:18:35.852445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.852414    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b774271d-cc6e-46ec-bb74-a0b74080a773" (UID: "b774271d-cc6e-46ec-bb74-a0b74080a773"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:18:35.854033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.854010    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx" (OuterVolumeSpecName: "kube-api-access-qnhqx") pod "b774271d-cc6e-46ec-bb74-a0b74080a773" (UID: "b774271d-cc6e-46ec-bb74-a0b74080a773"). InnerVolumeSpecName "kube-api-access-qnhqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:35.953511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.953430    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b774271d-cc6e-46ec-bb74-a0b74080a773-extensions-socket-volume\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:35.953511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:35.953456    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnhqx\" (UniqueName: \"kubernetes.io/projected/b774271d-cc6e-46ec-bb74-a0b74080a773-kube-api-access-qnhqx\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:18:36.455551 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.455519    2566 generic.go:356] "Generic (PLEG): container finished" podID="b774271d-cc6e-46ec-bb74-a0b74080a773" containerID="58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413" exitCode=0
Sep 11 18:18:36.455911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.455560    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"
Sep 11 18:18:36.455911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.455607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" event={"ID":"b774271d-cc6e-46ec-bb74-a0b74080a773","Type":"ContainerDied","Data":"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"}
Sep 11 18:18:36.455911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.455655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj" event={"ID":"b774271d-cc6e-46ec-bb74-a0b74080a773","Type":"ContainerDied","Data":"08e09e3af4dc1030ac127d536b38c169748cd685b659a7821548da15a451ffa1"}
Sep 11 18:18:36.455911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.455677    2566 scope.go:117] "RemoveContainer" containerID="58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"
Sep 11 18:18:36.464841 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.464825    2566 scope.go:117] "RemoveContainer" containerID="58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"
Sep 11 18:18:36.465128 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:18:36.465110    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413\": container with ID starting with 58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413 not found: ID does not exist" containerID="58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"
Sep 11 18:18:36.465180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.465136    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413"} err="failed to get container status \"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413\": rpc error: code = NotFound desc = could not find container \"58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413\": container with ID starting with 58cf72436ab350f9a586cff923aef8e18aade91aa7d0c58d986587a253e4b413 not found: ID does not exist"
Sep 11 18:18:36.491452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.491422    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:36.495541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:36.495519    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2b6bj"]
Sep 11 18:18:37.060711 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:18:37.060675    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b774271d-cc6e-46ec-bb74-a0b74080a773" path="/var/lib/kubelet/pods/b774271d-cc6e-46ec-bb74-a0b74080a773/volumes"
Sep 11 18:19:12.170708 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.170672    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"]
Sep 11 18:19:12.171166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.171083    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b774271d-cc6e-46ec-bb74-a0b74080a773" containerName="manager"
Sep 11 18:19:12.171166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.171096    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b774271d-cc6e-46ec-bb74-a0b74080a773" containerName="manager"
Sep 11 18:19:12.171166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.171165    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b774271d-cc6e-46ec-bb74-a0b74080a773" containerName="manager"
Sep 11 18:19:12.173636 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.173621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.175931 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.175906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 18:19:12.175931 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.175925    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:19:12.176458 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.176444    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f9l6q\""
Sep 11 18:19:12.176509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.176487    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 18:19:12.182661 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.182631    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"]
Sep 11 18:19:12.268102 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.268064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbvq\" (UniqueName: \"kubernetes.io/projected/d63494c8-a964-4447-99d5-2281452a4c16-kube-api-access-4zbvq\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.268284 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.268110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d63494c8-a964-4447-99d5-2281452a4c16-data\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.369005 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.368958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbvq\" (UniqueName: \"kubernetes.io/projected/d63494c8-a964-4447-99d5-2281452a4c16-kube-api-access-4zbvq\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.369005 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.369012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d63494c8-a964-4447-99d5-2281452a4c16-data\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.369403 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.369380    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d63494c8-a964-4447-99d5-2281452a4c16-data\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.383247 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.383210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbvq\" (UniqueName: \"kubernetes.io/projected/d63494c8-a964-4447-99d5-2281452a4c16-kube-api-access-4zbvq\") pod \"postgres-69fb4594cf-swmbj\" (UID: \"d63494c8-a964-4447-99d5-2281452a4c16\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.485385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.485289    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:12.759000 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:12.758967    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"]
Sep 11 18:19:12.761007 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:19:12.760976    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63494c8_a964_4447_99d5_2281452a4c16.slice/crio-dac9b0516ce6932ad516f8623ed02865b99bead08ec6710cc23fbd0640565b74 WatchSource:0}: Error finding container dac9b0516ce6932ad516f8623ed02865b99bead08ec6710cc23fbd0640565b74: Status 404 returned error can't find the container with id dac9b0516ce6932ad516f8623ed02865b99bead08ec6710cc23fbd0640565b74
Sep 11 18:19:13.670494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:13.670459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj" event={"ID":"d63494c8-a964-4447-99d5-2281452a4c16","Type":"ContainerStarted","Data":"dac9b0516ce6932ad516f8623ed02865b99bead08ec6710cc23fbd0640565b74"}
Sep 11 18:19:17.697580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:17.697536    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj" event={"ID":"d63494c8-a964-4447-99d5-2281452a4c16","Type":"ContainerStarted","Data":"8f0b07563832cf2be616bc9c193bb8645ffeb8d2eb3ae589428dc1cd0e63e414"}
Sep 11 18:19:17.697989 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:17.697701    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:19:17.715415 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:17.715365    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj" podStartSLOduration=1.111398677 podStartE2EDuration="5.715349862s" totalImagesPullingTime="4.603951185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:19:17.713819149 +0000 UTC m=+535.134593553" watchObservedRunningTime="2026-09-11 18:19:17.715349862 +0000 UTC m=+535.136124269"
Sep 11 18:19:23.730577 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:19:23.730544    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-swmbj"
Sep 11 18:20:09.008351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.008314    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"]
Sep 11 18:20:09.010967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.010949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.013630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.013606    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 18:20:09.023953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.023932    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"]
Sep 11 18:20:09.064476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.064441    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qfm9\" (UniqueName: \"kubernetes.io/projected/a271417a-8a33-4956-b0c7-7f4bb821f0f1-kube-api-access-4qfm9\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.064638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.064515    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a271417a-8a33-4956-b0c7-7f4bb821f0f1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.165124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.165087    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qfm9\" (UniqueName: \"kubernetes.io/projected/a271417a-8a33-4956-b0c7-7f4bb821f0f1-kube-api-access-4qfm9\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.165301 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.165163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a271417a-8a33-4956-b0c7-7f4bb821f0f1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.165834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.165809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a271417a-8a33-4956-b0c7-7f4bb821f0f1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.179004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.178975    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qfm9\" (UniqueName: \"kubernetes.io/projected/a271417a-8a33-4956-b0c7-7f4bb821f0f1-kube-api-access-4qfm9\") pod \"payload-pre-processing-59fbc47bf8-h866m\" (UID: \"a271417a-8a33-4956-b0c7-7f4bb821f0f1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.321195 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.321107    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:09.590982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.590958    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"]
Sep 11 18:20:09.592848 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:20:09.592821    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda271417a_8a33_4956_b0c7_7f4bb821f0f1.slice/crio-7f122b3b34aecfd2ab9cffecd7069559cd22b9ee5140421bd4af824045b8f441 WatchSource:0}: Error finding container 7f122b3b34aecfd2ab9cffecd7069559cd22b9ee5140421bd4af824045b8f441: Status 404 returned error can't find the container with id 7f122b3b34aecfd2ab9cffecd7069559cd22b9ee5140421bd4af824045b8f441
Sep 11 18:20:09.973377 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:09.973343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m" event={"ID":"a271417a-8a33-4956-b0c7-7f4bb821f0f1","Type":"ContainerStarted","Data":"7f122b3b34aecfd2ab9cffecd7069559cd22b9ee5140421bd4af824045b8f441"}
Sep 11 18:20:11.985664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:11.985627    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m" event={"ID":"a271417a-8a33-4956-b0c7-7f4bb821f0f1","Type":"ContainerStarted","Data":"cd68d0beb5ff83028c397d540db8cbd42f0e8040b1dcb6cf2d821fe2f6333397"}
Sep 11 18:20:11.986133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:11.985751    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:12.004006 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:12.003947    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m" podStartSLOduration=2.567195784 podStartE2EDuration="4.003931859s" totalImagesPullingTime="1.436736075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:12.00265293 +0000 UTC m=+589.423427335" watchObservedRunningTime="2026-09-11 18:20:12.003931859 +0000 UTC m=+589.424706262"
Sep 11 18:20:22.992842 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:22.992811    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h866m"
Sep 11 18:20:22.993930 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:22.993904    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:20:22.994346 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:22.994325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:20:32.799976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.799935    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"]
Sep 11 18:20:32.803370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.803344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.806188 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.806169    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 18:20:32.806294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.806170    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qdfkl\""
Sep 11 18:20:32.806346 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.806170    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 18:20:32.806450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.806436    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 18:20:32.816652 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.816630    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"]
Sep 11 18:20:32.980020 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.979980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.980208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.980058    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.980208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.980139    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.980208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.980169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.980208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.980197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbfsx\" (UniqueName: \"kubernetes.io/projected/d1f959a5-3166-4c52-a9c8-d87943a79c5f-kube-api-access-mbfsx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:32.980419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:32.980237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.080854 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.080854 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbfsx\" (UniqueName: \"kubernetes.io/projected/d1f959a5-3166-4c52-a9c8-d87943a79c5f-kube-api-access-mbfsx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.080992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.081305    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081454 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.081340    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.081454 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.081360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.083095 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.083072    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f959a5-3166-4c52-a9c8-d87943a79c5f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.083231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.083214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f959a5-3166-4c52-a9c8-d87943a79c5f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.088587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.088565    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbfsx\" (UniqueName: \"kubernetes.io/projected/d1f959a5-3166-4c52-a9c8-d87943a79c5f-kube-api-access-mbfsx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz\" (UID: \"d1f959a5-3166-4c52-a9c8-d87943a79c5f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.113816 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.113757    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:33.395077 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.394999    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"]
Sep 11 18:20:33.398548 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:20:33.398521    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f959a5_3166_4c52_a9c8_d87943a79c5f.slice/crio-6d69f4b4fddf299f806e023588093142048a32cb223173441ceac460ffff05c9 WatchSource:0}: Error finding container 6d69f4b4fddf299f806e023588093142048a32cb223173441ceac460ffff05c9: Status 404 returned error can't find the container with id 6d69f4b4fddf299f806e023588093142048a32cb223173441ceac460ffff05c9
Sep 11 18:20:33.400280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:33.400262    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:20:34.109397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:34.109359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz" event={"ID":"d1f959a5-3166-4c52-a9c8-d87943a79c5f","Type":"ContainerStarted","Data":"6d69f4b4fddf299f806e023588093142048a32cb223173441ceac460ffff05c9"}
Sep 11 18:20:35.116822 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:35.116776    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz" event={"ID":"d1f959a5-3166-4c52-a9c8-d87943a79c5f","Type":"ContainerStarted","Data":"5b539085a6585025151f1246f2d7687f9790e9949ccc5ffe9ee3ecbdf05158ec"}
Sep 11 18:20:35.149727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:35.149646    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz" podStartSLOduration=2.026605228 podStartE2EDuration="3.149621761s" totalImagesPullingTime="1.123016533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:35.148942268 +0000 UTC m=+612.569716674" watchObservedRunningTime="2026-09-11 18:20:35.149621761 +0000 UTC m=+612.570396166"
Sep 11 18:20:43.114638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:43.114600    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:43.115130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:43.114669    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:43.126579 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:43.126556    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:20:43.179168 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:20:43.179140    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz"
Sep 11 18:21:16.404802 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.404764    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"]
Sep 11 18:21:16.408045 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.408027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.410252 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.410229    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 18:21:16.417716 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.417690    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"]
Sep 11 18:21:16.574273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574230    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.574461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574361    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.574461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwsc\" (UniqueName: \"kubernetes.io/projected/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-kube-api-access-ddwsc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.574575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574454    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.574575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574493    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.574575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.574556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675237    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwsc\" (UniqueName: \"kubernetes.io/projected/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-kube-api-access-ddwsc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675741 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.675808 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.675765    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.677594 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.677569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.677799 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.677769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.682910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.682883    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwsc\" (UniqueName: \"kubernetes.io/projected/f8df2ee0-56e3-4b10-996a-72a5048d1e7a-kube-api-access-ddwsc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qjwrf\" (UID: \"f8df2ee0-56e3-4b10-996a-72a5048d1e7a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.718955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.718916    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:16.991285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:16.991263    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"]
Sep 11 18:21:16.993106 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:21:16.993079    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8df2ee0_56e3_4b10_996a_72a5048d1e7a.slice/crio-48c2f63d02ce22791a5231fc53e65a9983250cd2c636bcaf0f14a567ac36f89a WatchSource:0}: Error finding container 48c2f63d02ce22791a5231fc53e65a9983250cd2c636bcaf0f14a567ac36f89a: Status 404 returned error can't find the container with id 48c2f63d02ce22791a5231fc53e65a9983250cd2c636bcaf0f14a567ac36f89a
Sep 11 18:21:17.345066 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:17.344984    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf" event={"ID":"f8df2ee0-56e3-4b10-996a-72a5048d1e7a","Type":"ContainerStarted","Data":"66f53db7dca7de165703fde888d2cb5679c254655685c9e9d77d2172515fad0c"}
Sep 11 18:21:17.345066 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:17.345040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf" event={"ID":"f8df2ee0-56e3-4b10-996a-72a5048d1e7a","Type":"ContainerStarted","Data":"48c2f63d02ce22791a5231fc53e65a9983250cd2c636bcaf0f14a567ac36f89a"}
Sep 11 18:21:17.363247 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:17.363190    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf" podStartSLOduration=1.185543009 podStartE2EDuration="1.363171268s" totalImagesPullingTime="177.628259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:21:17.362431135 +0000 UTC m=+654.783205572" watchObservedRunningTime="2026-09-11 18:21:17.363171268 +0000 UTC m=+654.783945672"
Sep 11 18:21:26.719125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:26.719080    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:26.719585 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:26.719159    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:26.731370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:26.731335    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:21:27.412732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:21:27.412695    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qjwrf"
Sep 11 18:23:23.982264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:23.982232    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:23:23.984874 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:23.984852    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:23.988373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:23.988344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-553596-openshift-default-dockercfg-7864s\""
Sep 11 18:23:23.998089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:23.998061    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:23:24.073208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.073136    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:23:24.078034 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.078006    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.079967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.079943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-d73031-openshift-default-dockercfg-qfgcz\""
Sep 11 18:23:24.084742 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.084709    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:23:24.117193 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117303    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117319    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117336    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wvh\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117531    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117604    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117650 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.117910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117716    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.117910 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.117733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8rb\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.218763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.218725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.218763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.218767    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219023 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.218956    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219147 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219103    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219147 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219252 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8rb\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219299    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219381    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.219408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220107    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220226    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wvh\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220272    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220541    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.219311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.220611    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221284    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.221581    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.222131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.222019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.222836 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.222757    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.222936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.222887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.223384 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.223364    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.228052 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.228025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.228411 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.228393    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.228479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.228458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wvh\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh\") pod \"e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") " pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.228517 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.228460    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8rb\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb\") pod \"e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") " pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.296668 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.296581    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:24.390743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.390717    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:24.576523 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.576495    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:23:24.577024 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:24.577002    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1094a1f4_0f75_4ad1_a14a_9609be44ef6a.slice/crio-b68db6da8527a0c40d3b6d0ff38f28266ca2aa41e0e71219ce4c39f1e7370ba7 WatchSource:0}: Error finding container b68db6da8527a0c40d3b6d0ff38f28266ca2aa41e0e71219ce4c39f1e7370ba7: Status 404 returned error can't find the container with id b68db6da8527a0c40d3b6d0ff38f28266ca2aa41e0e71219ce4c39f1e7370ba7
Sep 11 18:23:24.579134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.579105    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:24.579219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.579163    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:24.579219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.579190    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:24.684618 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.684583    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:23:24.719320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:24.719276    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f13dad_54f6_4150_b14e_58e2ebab4b8d.slice/crio-e41340813463382752858a8b02ecf65d9c956903bd6837be7e4e4159b4a5a31f WatchSource:0}: Error finding container e41340813463382752858a8b02ecf65d9c956903bd6837be7e4e4159b4a5a31f: Status 404 returned error can't find the container with id e41340813463382752858a8b02ecf65d9c956903bd6837be7e4e4159b4a5a31f
Sep 11 18:23:24.721775 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.721730    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:24.721913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.721864    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:24.721973 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:24.721912    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:25.041704 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.041660    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerStarted","Data":"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"}
Sep 11 18:23:25.041704 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.041725    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerStarted","Data":"e41340813463382752858a8b02ecf65d9c956903bd6837be7e4e4159b4a5a31f"}
Sep 11 18:23:25.043580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.043554    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerStarted","Data":"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"}
Sep 11 18:23:25.043689 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.043597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerStarted","Data":"b68db6da8527a0c40d3b6d0ff38f28266ca2aa41e0e71219ce4c39f1e7370ba7"}
Sep 11 18:23:25.067130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.067070    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podStartSLOduration=1.067054892 podStartE2EDuration="1.067054892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:25.064806927 +0000 UTC m=+782.485581327" watchObservedRunningTime="2026-09-11 18:23:25.067054892 +0000 UTC m=+782.487829294"
Sep 11 18:23:25.297565 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.297472    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:25.302366 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.302331    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:25.329528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.329470    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podStartSLOduration=2.329449563 podStartE2EDuration="2.329449563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:25.10156567 +0000 UTC m=+782.522340074" watchObservedRunningTime="2026-09-11 18:23:25.329449563 +0000 UTC m=+782.750223966"
Sep 11 18:23:25.391080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.391049    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:25.395888 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:25.395861    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:26.049714 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:26.049673    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:26.050183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:26.049734    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:26.050755 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:26.050731    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:26.050882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:26.050826    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:30.333319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.333286    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:23:30.336325 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.336304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.338334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.338315    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-553596\""
Sep 11 18:23:30.338409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.338327    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-553596-dockercfg-v2rdr\""
Sep 11 18:23:30.347928 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.347890    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:23:30.482293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.482254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.482467 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.482338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcwjt\" (UniqueName: \"kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.583850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.583763    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.584004 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.583889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcwjt\" (UniqueName: \"kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.584481 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.584462    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.593697 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.593669    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcwjt\" (UniqueName: \"kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt\") pod \"payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.649458 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.649417    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:30.925283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:30.925251    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:23:30.926897 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:30.926867    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48b8477_5776_4381_9f6a_b9d510ebbc24.slice/crio-8652e004c90cfeb33a2a1708776ff485735a6f36a55a3e785600c0a918736390 WatchSource:0}: Error finding container 8652e004c90cfeb33a2a1708776ff485735a6f36a55a3e785600c0a918736390: Status 404 returned error can't find the container with id 8652e004c90cfeb33a2a1708776ff485735a6f36a55a3e785600c0a918736390
Sep 11 18:23:31.080328 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.080289    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" event={"ID":"d48b8477-5776-4381-9f6a-b9d510ebbc24","Type":"ContainerStarted","Data":"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"}
Sep 11 18:23:31.080509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.080446    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:31.080509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.080496    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" event={"ID":"d48b8477-5776-4381-9f6a-b9d510ebbc24","Type":"ContainerStarted","Data":"8652e004c90cfeb33a2a1708776ff485735a6f36a55a3e785600c0a918736390"}
Sep 11 18:23:31.098044 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.097994    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" podStartSLOduration=1.097977853 podStartE2EDuration="1.097977853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:31.095879862 +0000 UTC m=+788.516654266" watchObservedRunningTime="2026-09-11 18:23:31.097977853 +0000 UTC m=+788.518752293"
Sep 11 18:23:31.465012 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.462503    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:23:31.468535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.468422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.470963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.470935    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-89bb6c-openshift-default-dockercfg-lx572\""
Sep 11 18:23:31.485739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.485709    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:23:31.594106 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594068    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594111    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594194    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46b7f\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.594560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.594454    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695446    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46b7f\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695842 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.695938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.695910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.696173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.696103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.696173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.696125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.696173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.696131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.696173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.696159    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.697859 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.697842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.698019 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.698005    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.702958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.702933    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.703094 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.703074    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46b7f\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f\") pod \"e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") " pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:31.783739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:31.783645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:32.060304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:32.060280    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:23:32.061973 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:32.061944    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2fd0db_7708_4975_9fba_15290a4ae3d9.slice/crio-a1aef6ff545a0928244f152e22aeab2c1b89e78a7f0b9f014d8e337bb2261abf WatchSource:0}: Error finding container a1aef6ff545a0928244f152e22aeab2c1b89e78a7f0b9f014d8e337bb2261abf: Status 404 returned error can't find the container with id a1aef6ff545a0928244f152e22aeab2c1b89e78a7f0b9f014d8e337bb2261abf
Sep 11 18:23:32.064581 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:32.064540    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:32.064673 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:32.064620    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:32.064673 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:32.064656    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:32.088337 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:32.088311    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerStarted","Data":"a1aef6ff545a0928244f152e22aeab2c1b89e78a7f0b9f014d8e337bb2261abf"}
Sep 11 18:23:33.023758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.023718    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:23:33.028198 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.028176    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.030250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.030224    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2f7a9131-openshift-default-dockercfg-pghq5\""
Sep 11 18:23:33.040527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.040504    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:23:33.095850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.095817    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerStarted","Data":"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"}
Sep 11 18:23:33.111215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111181    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111219    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qp9q\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111352    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111417    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111646 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111472    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111646 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.111646 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.111539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.117620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.117572    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podStartSLOduration=2.117555945 podStartE2EDuration="2.117555945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:33.116036536 +0000 UTC m=+790.536810963" watchObservedRunningTime="2026-09-11 18:23:33.117555945 +0000 UTC m=+790.538330347"
Sep 11 18:23:33.212249 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.212216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.212526 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.212507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qp9q\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.212683 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.212667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.212953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.212933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213573 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213702 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213589    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213702 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213702 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213874 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.213934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.213910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.214306 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.214260    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.214391 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.214360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.215723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.215702    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.215915 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.215899    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.227496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.227471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.234056 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.234031    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qp9q\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q\") pod \"e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") " pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.339493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.339398    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:33.627721 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.627696    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:23:33.629035 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:33.629003    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b351ca5_637d_4003_a022_d952621b94f6.slice/crio-ba7672842a376a17fe6a023aa6ec0502b6d429d33aa1200629eb38c4a16959f2 WatchSource:0}: Error finding container ba7672842a376a17fe6a023aa6ec0502b6d429d33aa1200629eb38c4a16959f2: Status 404 returned error can't find the container with id ba7672842a376a17fe6a023aa6ec0502b6d429d33aa1200629eb38c4a16959f2
Sep 11 18:23:33.634031 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.634000    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:33.634114 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.634067    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:33.634114 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.634092    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:33.784443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.784408    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:33.789854 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:33.789828    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:34.103045 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.103013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerStarted","Data":"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"}
Sep 11 18:23:34.103409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.103069    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerStarted","Data":"ba7672842a376a17fe6a023aa6ec0502b6d429d33aa1200629eb38c4a16959f2"}
Sep 11 18:23:34.103409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.103166    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:34.104143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.104126    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:23:34.123690 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.123638    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podStartSLOduration=1.123620204 podStartE2EDuration="1.123620204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:34.12087033 +0000 UTC m=+791.541644734" watchObservedRunningTime="2026-09-11 18:23:34.123620204 +0000 UTC m=+791.544394608"
Sep 11 18:23:34.339955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.339914    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:34.345236 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:34.345206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:35.108942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:35.108907    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:35.109756 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:35.109739    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:23:40.557619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.557575    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:23:40.562809 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.562766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.565498 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.565473    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-89bb6c-serving-cert\""
Sep 11 18:23:40.566113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.566091    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:23:40.566561 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.566543    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bqwkv\""
Sep 11 18:23:40.619882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.615087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:23:40.703157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.702435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.703157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.702500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.703157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.702545    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttq2\" (UniqueName: \"kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.703157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.702653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.803930 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.803891    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.804315 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.804280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.804534 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.804517    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.804673 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.804660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttq2\" (UniqueName: \"kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.805563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.805534    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.807425 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.807405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.808783 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.808712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.821053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.821030    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttq2\" (UniqueName: \"kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2\") pod \"maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:40.929595 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:40.929568    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:41.240219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:41.240190    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:23:41.241999 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:41.241957    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384dfd31_780c_429c_bb29_3ba94f25166b.slice/crio-ab4eb4bdb61e6704c55ecec45420bcec1dbbd2e9289941b274b690c040bfff73 WatchSource:0}: Error finding container ab4eb4bdb61e6704c55ecec45420bcec1dbbd2e9289941b274b690c040bfff73: Status 404 returned error can't find the container with id ab4eb4bdb61e6704c55ecec45420bcec1dbbd2e9289941b274b690c040bfff73
Sep 11 18:23:42.093157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.092399    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:23:42.093157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.092911    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:23:42.093157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.092964    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:23:42.156842 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.156756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" event={"ID":"384dfd31-780c-429c-bb29-3ba94f25166b","Type":"ContainerStarted","Data":"ab4eb4bdb61e6704c55ecec45420bcec1dbbd2e9289941b274b690c040bfff73"}
Sep 11 18:23:42.974431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.974391    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:23:42.988490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.984621    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:23:42.988490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.984770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:42.991129 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:42.990701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-12eb53-openshift-default-dockercfg-q4bcf\""
Sep 11 18:23:43.131800 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.131800 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131917    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.131992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.132021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.132067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4df\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.132396 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.132127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233712 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233712 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233761    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233867    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.233977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4df\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.233993    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234445 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234685 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234663    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.234765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.235011 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.234989    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.237022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.236996    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.237354 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.237208    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.253360 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.253327    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4df\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.254492 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.254447    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token\") pod \"e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") " pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:43.304420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:43.304377    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:44.178736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.178087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" event={"ID":"384dfd31-780c-429c-bb29-3ba94f25166b","Type":"ContainerStarted","Data":"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"}
Sep 11 18:23:44.178736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.178228    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:44.196829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.196698    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" podStartSLOduration=1.441904068 podStartE2EDuration="4.196679089s" totalImagesPullingTime="2.754775021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:44.194328432 +0000 UTC m=+801.615102836" watchObservedRunningTime="2026-09-11 18:23:44.196679089 +0000 UTC m=+801.617453491"
Sep 11 18:23:44.211434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.211402    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:23:44.212823 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:44.212781    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5885e866_7bfd_47fc_b2be_a1560665708a.slice/crio-3d874132d0c6fa78a03aff20057805f0466f7969244e755d1afc235047d40f3d WatchSource:0}: Error finding container 3d874132d0c6fa78a03aff20057805f0466f7969244e755d1afc235047d40f3d: Status 404 returned error can't find the container with id 3d874132d0c6fa78a03aff20057805f0466f7969244e755d1afc235047d40f3d
Sep 11 18:23:44.215732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.215703    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:44.215819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.215763    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:44.215858 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:44.215824    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.187251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.187221    2566 generic.go:356] "Generic (PLEG): container finished" podID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerID="541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c" exitCode=0
Sep 11 18:23:45.187716 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.187296    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerDied","Data":"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"}
Sep 11 18:23:45.187812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.187754    2566 scope.go:117] "RemoveContainer" containerID="541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"
Sep 11 18:23:45.189115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189084    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.189225 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189173    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.189225 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189186    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerID="63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff" exitCode=0
Sep 11 18:23:45.189340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189222    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.189340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerDied","Data":"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"}
Sep 11 18:23:45.189642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.189626    2566 scope.go:117] "RemoveContainer" containerID="63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"
Sep 11 18:23:45.190659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.190637    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.190763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.190704    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.190763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.190751    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:23:45.190907 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.190873    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerStarted","Data":"2c0b3f6e4714e8e8faeaaac8158f7e8f8622f4f82a2d07a31768175aabf809d3"}
Sep 11 18:23:45.190975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.190914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerStarted","Data":"3d874132d0c6fa78a03aff20057805f0466f7969244e755d1afc235047d40f3d"}
Sep 11 18:23:45.259437 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.259312    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podStartSLOduration=3.259292017 podStartE2EDuration="3.259292017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:45.25624787 +0000 UTC m=+802.677022274" watchObservedRunningTime="2026-09-11 18:23:45.259292017 +0000 UTC m=+802.680066422"
Sep 11 18:23:45.304782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.304758    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:45.311184 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:45.311163    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:46.198531 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.198493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerStarted","Data":"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"}
Sep 11 18:23:46.200474 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.200451    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerStarted","Data":"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"}
Sep 11 18:23:46.200636 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.200616    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:46.201648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.201630    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:23:46.297359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.297324    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:46.297536 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.297518    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:46.297588 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.297559    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:46.391286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.391245    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:46.391501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.391477    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:23:46.391577 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:46.391536    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:23:47.297197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:47.297158    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:47.297755 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:47.297720    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:47.391640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:47.391598    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:23:47.391934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:47.391907    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:23:48.297755 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:48.297711    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:48.298249 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:48.297776    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:48.391885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:48.391846    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:23:48.392074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:48.391909    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:23:49.297160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:49.297110    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:49.297383 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:49.297182    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:49.391938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:49.391897    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:23:49.392417 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:49.391960    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:23:50.202926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:50.202238    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:23:50.297812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:50.297156    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:50.297812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:50.297237    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:50.391809 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:50.391725    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:23:50.391809 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:50.391806    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:23:51.298059 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:51.298014    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:51.298283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:51.298081    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:51.625333 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:51.625248    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:51.626572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:51.626548    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:51.628262 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:51.628236    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:23:52.297582 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:52.297539    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 18:23:52.297883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:52.297612    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 18:23:53.304672 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:53.304638    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:53.305153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:53.305132    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:53.306141 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:53.306122    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:23:55.902494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:55.902451    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"]
Sep 11 18:23:55.906772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:55.906749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:23:55.908899 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:55.908880    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:23:55.912065 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:55.912040    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"]
Sep 11 18:23:56.021019 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:56.020982    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8\" (UID: \"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:23:56.122892 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:56.122772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8\" (UID: \"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:23:56.123410 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:56.123387    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8\" (UID: \"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:23:56.221222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:56.221182    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:23:56.540527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:56.540504    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"]
Sep 11 18:23:56.542573 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:23:56.542547    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc6202b_2cab_4e25_a4f8_3a86f942a1fb.slice/crio-963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7 WatchSource:0}: Error finding container 963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7: Status 404 returned error can't find the container with id 963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7
Sep 11 18:23:57.285006 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:57.284962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8" event={"ID":"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb","Type":"ContainerStarted","Data":"963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7"}
Sep 11 18:23:59.305306 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:59.305263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8" event={"ID":"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb","Type":"ContainerStarted","Data":"1735bc64eb304a73b6d3eacf915528021d2dfeaebf87a23a8e6ae4e453b50062"}
Sep 11 18:23:59.321341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:23:59.321233    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8" podStartSLOduration=2.054957495 podStartE2EDuration="4.321216957s" totalImagesPullingTime="2.266259462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:59.320085968 +0000 UTC m=+816.740860371" watchObservedRunningTime="2026-09-11 18:23:59.321216957 +0000 UTC m=+816.741991417"
Sep 11 18:24:00.313444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.313357    2566 generic.go:356] "Generic (PLEG): container finished" podID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerID="fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7" exitCode=0
Sep 11 18:24:00.313444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.313425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerDied","Data":"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"}
Sep 11 18:24:00.314003 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.313953    2566 scope.go:117] "RemoveContainer" containerID="fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"
Sep 11 18:24:00.315286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.315248    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:00.315407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.315322    2566 generic.go:356] "Generic (PLEG): container finished" podID="2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" containerID="1735bc64eb304a73b6d3eacf915528021d2dfeaebf87a23a8e6ae4e453b50062" exitCode=0
Sep 11 18:24:00.315407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.315343    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:00.315407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.315391    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:00.315407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:00.315395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8" event={"ID":"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb","Type":"ContainerDied","Data":"1735bc64eb304a73b6d3eacf915528021d2dfeaebf87a23a8e6ae4e453b50062"}
Sep 11 18:24:01.322275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.322245    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b351ca5-637d-4003-a022-d952621b94f6" containerID="798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d" exitCode=0
Sep 11 18:24:01.322751 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.322321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerDied","Data":"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"}
Sep 11 18:24:01.322844 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.322760    2566 scope.go:117] "RemoveContainer" containerID="798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"
Sep 11 18:24:01.324083 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.324049    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:01.324185 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.324125    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:01.324185 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.324163    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:01.324431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.324414    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerStarted","Data":"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"}
Sep 11 18:24:01.485541 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.485515    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:24:01.583604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.583511    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca\") pod \"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb\" (UID: \"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb\") "
Sep 11 18:24:01.583889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.583866    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" (UID: "2dc6202b-2cab-4e25-a4f8-3a86f942a1fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:01.684605 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.684566    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:01.784640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.784607    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:24:01.786049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.786027    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:01.786161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:01.786075    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:02.332848 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.332819    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"
Sep 11 18:24:02.333313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.332893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8" event={"ID":"2dc6202b-2cab-4e25-a4f8-3a86f942a1fb","Type":"ContainerDied","Data":"963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7"}
Sep 11 18:24:02.333313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.332933    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="963864af29f422e3279690482167027d0dea45897d6f9d0617deab5afcce2ad7"
Sep 11 18:24:02.335241 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.335215    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerStarted","Data":"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"}
Sep 11 18:24:02.339830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.339810    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:24:02.341230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.341210    2566 patch_prober.go:28] interesting pod/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 18:24:02.341321 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.341252    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 18:24:02.784846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.784774    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:02.785071 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:02.784878    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:03.339781 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:03.339746    2566 patch_prober.go:28] interesting pod/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 18:24:03.340274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:03.339827    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 18:24:03.785009 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:03.784952    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:03.785560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:03.785288    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:04.103292 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:04.103191    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:24:04.339983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:04.339945    2566 patch_prober.go:28] interesting pod/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 18:24:04.340365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:04.339999    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 18:24:04.784173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:04.784125    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:04.784384 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:04.784197    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:05.109871 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:05.108903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:24:05.340516 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:05.340478    2566 patch_prober.go:28] interesting pod/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 18:24:05.340940 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:05.340534    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 18:24:05.785110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:05.785066    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:05.785328 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:05.785135    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:06.340460 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.340428    2566 patch_prober.go:28] interesting pod/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 18:24:06.340641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.340490    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 18:24:06.788811 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.788146    2566 patch_prober.go:28] interesting pod/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 18:24:06.788811 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.788209    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 18:24:06.915821 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.911076    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"]
Sep 11 18:24:06.915821 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:06.914829    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f7a9131-6csm8"]
Sep 11 18:24:07.040883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:07.040758    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:24:07.043851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:07.041072    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy" containerID="cri-o://2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481" gracePeriod=30
Sep 11 18:24:07.142810 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:07.135676    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" path="/var/lib/kubelet/pods/2dc6202b-2cab-4e25-a4f8-3a86f942a1fb/volumes"
Sep 11 18:24:07.797494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:07.797451    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:24:07.800717 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:07.800690    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:24:13.292709 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.292683    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:24:13.417592 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.417504    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b351ca5-637d-4003-a022-d952621b94f6" containerID="2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481" exitCode=0
Sep 11 18:24:13.417592 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.417553    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"
Sep 11 18:24:13.417837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.417594    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerDied","Data":"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"}
Sep 11 18:24:13.417837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.417651    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw" event={"ID":"5b351ca5-637d-4003-a022-d952621b94f6","Type":"ContainerDied","Data":"ba7672842a376a17fe6a023aa6ec0502b6d429d33aa1200629eb38c4a16959f2"}
Sep 11 18:24:13.417837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.417678    2566 scope.go:117] "RemoveContainer" containerID="2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"
Sep 11 18:24:13.419122 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.419100    2566 generic.go:356] "Generic (PLEG): container finished" podID="5885e866-7bfd-47fc-b2be-a1560665708a" containerID="2c0b3f6e4714e8e8faeaaac8158f7e8f8622f4f82a2d07a31768175aabf809d3" exitCode=0
Sep 11 18:24:13.419226 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.419141    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerDied","Data":"2c0b3f6e4714e8e8faeaaac8158f7e8f8622f4f82a2d07a31768175aabf809d3"}
Sep 11 18:24:13.419512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.419500    2566 scope.go:117] "RemoveContainer" containerID="2c0b3f6e4714e8e8faeaaac8158f7e8f8622f4f82a2d07a31768175aabf809d3"
Sep 11 18:24:13.420765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.420736    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:13.420895 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.420841    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:13.420961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.420926    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:13.427465 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.427447    2566 scope.go:117] "RemoveContainer" containerID="798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"
Sep 11 18:24:13.435743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.435727    2566 scope.go:117] "RemoveContainer" containerID="2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"
Sep 11 18:24:13.436015 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:13.435993    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481\": container with ID starting with 2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481 not found: ID does not exist" containerID="2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"
Sep 11 18:24:13.436076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.436023    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481"} err="failed to get container status \"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481\": rpc error: code = NotFound desc = could not find container \"2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481\": container with ID starting with 2d1ebd705ac7eed0f9e11f7e694f4f80e44abc0453e90fe9d29a3118cb4d6481 not found: ID does not exist"
Sep 11 18:24:13.436076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.436039    2566 scope.go:117] "RemoveContainer" containerID="798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"
Sep 11 18:24:13.436290 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:13.436266    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d\": container with ID starting with 798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d not found: ID does not exist" containerID="798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"
Sep 11 18:24:13.436334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.436300    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d"} err="failed to get container status \"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d\": rpc error: code = NotFound desc = could not find container \"798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d\": container with ID starting with 798938ae347c61f1f0d4deefc59c21adf0781219907810d04b370cc70eee1f2d not found: ID does not exist"
Sep 11 18:24:13.438343 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438320    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qp9q\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438499 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438363    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438499 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438393    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438499 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438455    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438505    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438539    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438624    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438678    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.438758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438700    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket\") pod \"5b351ca5-637d-4003-a022-d952621b94f6\" (UID: \"5b351ca5-637d-4003-a022-d952621b94f6\") "
Sep 11 18:24:13.439164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.438942    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:13.439314 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.439285    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b351ca5-637d-4003-a022-d952621b94f6-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.439473 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.439446    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:13.439727 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.439673    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:13.439835 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.439741    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:13.439835 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.439755    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:13.441543 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.441513    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:13.441834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.441781    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:13.442023 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.441999    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q" (OuterVolumeSpecName: "kube-api-access-7qp9q") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "kube-api-access-7qp9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:13.442150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.442126    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b351ca5-637d-4003-a022-d952621b94f6" (UID: "5b351ca5-637d-4003-a022-d952621b94f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:24:13.540302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540264    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540299    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540313    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540324    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540336    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540348    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b351ca5-637d-4003-a022-d952621b94f6-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540361    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b351ca5-637d-4003-a022-d952621b94f6-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.540553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.540375    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qp9q\" (UniqueName: \"kubernetes.io/projected/5b351ca5-637d-4003-a022-d952621b94f6-kube-api-access-7qp9q\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:13.743645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.743595    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:24:13.747958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.747917    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw"]
Sep 11 18:24:13.963991 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.963950    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964508    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" containerName="revoke-keys"
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964531    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" containerName="revoke-keys"
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964544    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964552    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964568    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.964645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964574    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.965054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964678    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.965054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964689    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc6202b-2cab-4e25-a4f8-3a86f942a1fb" containerName="revoke-keys"
Sep 11 18:24:13.965054 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.964695    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b351ca5-637d-4003-a022-d952621b94f6" containerName="istio-proxy"
Sep 11 18:24:13.967200 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.967181    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:13.969424 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.969404    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f8c01007-serving-cert\""
Sep 11 18:24:13.980087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:13.980031    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:14.044506 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.044461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.044665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.044517    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n2hc\" (UniqueName: \"kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.044665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.044578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.044740 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.044724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.145436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.145391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.145610 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.145450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.145610 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.145481    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n2hc\" (UniqueName: \"kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.145610 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.145520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.145610 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:14.145588    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-serving-cert: secret "maas-api-e2e-migrate-f8c01007-serving-cert" not found
Sep 11 18:24:14.145753 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:14.145660    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls podName:1c15b580-47ea-4fc2-88f2-f738c4fd0789 nodeName:}" failed. No retries permitted until 2026-09-11 18:24:14.645640789 +0000 UTC m=+832.066415179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls") pod "maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" (UID: "1c15b580-47ea-4fc2-88f2-f738c4fd0789") : secret "maas-api-e2e-migrate-f8c01007-serving-cert" not found
Sep 11 18:24:14.146108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.146088    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.148065 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.148041    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.167551 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.167524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n2hc\" (UniqueName: \"kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.428393 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.428365    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerStarted","Data":"8ab6810bf8b75606bb9bb4725d6a751812718b41cdd5d3f4c12fdfb40cb82461"}
Sep 11 18:24:14.650907 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.650862    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.654092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.654054    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") pod \"maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:14.879184 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:14.879087    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:15.077525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.077487    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b351ca5-637d-4003-a022-d952621b94f6" path="/var/lib/kubelet/pods/5b351ca5-637d-4003-a022-d952621b94f6/volumes"
Sep 11 18:24:15.175101 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.172485    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:15.175538 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:24:15.175506    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c15b580_47ea_4fc2_88f2_f738c4fd0789.slice/crio-ee6be0d0fea005fa21ed98ec941af7ecd0888d7b4733721af85815bb68aa7c2d WatchSource:0}: Error finding container ee6be0d0fea005fa21ed98ec941af7ecd0888d7b4733721af85815bb68aa7c2d: Status 404 returned error can't find the container with id ee6be0d0fea005fa21ed98ec941af7ecd0888d7b4733721af85815bb68aa7c2d
Sep 11 18:24:15.304712 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.304678    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:24:15.306139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.306110    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:24:15.306273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.306166    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 18:24:15.441365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:15.441274    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" event={"ID":"1c15b580-47ea-4fc2-88f2-f738c4fd0789","Type":"ContainerStarted","Data":"ee6be0d0fea005fa21ed98ec941af7ecd0888d7b4733721af85815bb68aa7c2d"}
Sep 11 18:24:16.200637 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:16.200602    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:24:16.305128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:16.305093    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:24:16.305272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:16.305143    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 18:24:16.451093 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:16.451006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" event={"ID":"1c15b580-47ea-4fc2-88f2-f738c4fd0789","Type":"ContainerStarted","Data":"f7785a3eb981d250006cc174b5f7861411942068d0a3862866e73f2f676fce94"}
Sep 11 18:24:16.451543 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:16.451095    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:17.305084 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:17.305048    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:24:17.305273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:17.305103    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 18:24:18.305766 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:18.305721    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:24:18.306179 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:18.305812    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 18:24:19.304868 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:19.304833    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:24:19.305059 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:19.304958    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 18:24:20.309376 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:20.309345    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:24:20.310248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:20.310229    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:24:20.334099 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:20.334043    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" podStartSLOduration=6.889487623 podStartE2EDuration="7.334027345s" totalImagesPullingTime="444.539722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:16.474458001 +0000 UTC m=+833.895232419" watchObservedRunningTime="2026-09-11 18:24:20.334027345 +0000 UTC m=+837.754801785"
Sep 11 18:24:23.475362 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:23.475331    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:40.667363 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.667327    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"]
Sep 11 18:24:40.671134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.671116    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:40.674744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.674728    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:24:40.681469 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.681447    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"]
Sep 11 18:24:40.730970 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.730937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m\" (UID: \"4b90b757-5467-42b1-96b6-cf71c9a9ba6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:40.832173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.832133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m\" (UID: \"4b90b757-5467-42b1-96b6-cf71c9a9ba6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:40.832777 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.832756    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m\" (UID: \"4b90b757-5467-42b1-96b6-cf71c9a9ba6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:40.982655 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:40.982620    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:41.257608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:41.257574    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"]
Sep 11 18:24:41.259144 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:24:41.259115    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b90b757_5467_42b1_96b6_cf71c9a9ba6f.slice/crio-7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684 WatchSource:0}: Error finding container 7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684: Status 404 returned error can't find the container with id 7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684
Sep 11 18:24:41.617341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:41.617304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m" event={"ID":"4b90b757-5467-42b1-96b6-cf71c9a9ba6f","Type":"ContainerStarted","Data":"8bfa23ed5996770063a51c767acccc059ab277be5041c3ff8bb70d7876968e22"}
Sep 11 18:24:41.617491 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:41.617367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m" event={"ID":"4b90b757-5467-42b1-96b6-cf71c9a9ba6f","Type":"ContainerStarted","Data":"7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684"}
Sep 11 18:24:41.636868 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:41.636819    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m" podStartSLOduration=1.636804793 podStartE2EDuration="1.636804793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:41.634564386 +0000 UTC m=+859.055338801" watchObservedRunningTime="2026-09-11 18:24:41.636804793 +0000 UTC m=+859.057579196"
Sep 11 18:24:42.624687 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:42.624647    2566 generic.go:356] "Generic (PLEG): container finished" podID="4b90b757-5467-42b1-96b6-cf71c9a9ba6f" containerID="8bfa23ed5996770063a51c767acccc059ab277be5041c3ff8bb70d7876968e22" exitCode=0
Sep 11 18:24:42.625111 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:42.624715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m" event={"ID":"4b90b757-5467-42b1-96b6-cf71c9a9ba6f","Type":"ContainerDied","Data":"8bfa23ed5996770063a51c767acccc059ab277be5041c3ff8bb70d7876968e22"}
Sep 11 18:24:43.766090 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:43.766061    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:43.857176 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:43.857135    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca\") pod \"4b90b757-5467-42b1-96b6-cf71c9a9ba6f\" (UID: \"4b90b757-5467-42b1-96b6-cf71c9a9ba6f\") "
Sep 11 18:24:43.857485 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:43.857457    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b90b757-5467-42b1-96b6-cf71c9a9ba6f" (UID: "4b90b757-5467-42b1-96b6-cf71c9a9ba6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:43.958139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:43.958103    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b90b757-5467-42b1-96b6-cf71c9a9ba6f-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:44.637860 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:44.637821    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m" event={"ID":"4b90b757-5467-42b1-96b6-cf71c9a9ba6f","Type":"ContainerDied","Data":"7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684"}
Sep 11 18:24:44.637860 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:44.637856    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"
Sep 11 18:24:44.638116 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:44.637898    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bd554de57a261991bf5db61d60b7583192f796af4620d76205bc81a6059f684"
Sep 11 18:24:52.485863 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.485810    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:52.486370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.486211    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" podUID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" containerName="maas-api" containerID="cri-o://f7785a3eb981d250006cc174b5f7861411942068d0a3862866e73f2f676fce94" gracePeriod=30
Sep 11 18:24:52.688177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.688145    2566 generic.go:356] "Generic (PLEG): container finished" podID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" containerID="f7785a3eb981d250006cc174b5f7861411942068d0a3862866e73f2f676fce94" exitCode=0
Sep 11 18:24:52.688344 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.688225    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" event={"ID":"1c15b580-47ea-4fc2-88f2-f738c4fd0789","Type":"ContainerDied","Data":"f7785a3eb981d250006cc174b5f7861411942068d0a3862866e73f2f676fce94"}
Sep 11 18:24:52.709633 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.709602    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"]
Sep 11 18:24:52.714083 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.714058    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8c01007-4pl5m"]
Sep 11 18:24:52.740864 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.740810    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:52.845238 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.845197    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca\") pod \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") "
Sep 11 18:24:52.845437 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.845295    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs\") pod \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") "
Sep 11 18:24:52.845437 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.845376    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") pod \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") "
Sep 11 18:24:52.845982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.845685    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c15b580-47ea-4fc2-88f2-f738c4fd0789" (UID: "1c15b580-47ea-4fc2-88f2-f738c4fd0789"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:52.845982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.845812    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n2hc\" (UniqueName: \"kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc\") pod \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\" (UID: \"1c15b580-47ea-4fc2-88f2-f738c4fd0789\") "
Sep 11 18:24:52.846718 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.846218    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c15b580-47ea-4fc2-88f2-f738c4fd0789-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:52.849076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.849048    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c15b580-47ea-4fc2-88f2-f738c4fd0789" (UID: "1c15b580-47ea-4fc2-88f2-f738c4fd0789"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:24:52.850283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.850243    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c15b580-47ea-4fc2-88f2-f738c4fd0789" (UID: "1c15b580-47ea-4fc2-88f2-f738c4fd0789"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:24:52.850596 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.850575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc" (OuterVolumeSpecName: "kube-api-access-8n2hc") pod "1c15b580-47ea-4fc2-88f2-f738c4fd0789" (UID: "1c15b580-47ea-4fc2-88f2-f738c4fd0789"). InnerVolumeSpecName "kube-api-access-8n2hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:52.947041 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.946985    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:52.947041 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.947021    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c15b580-47ea-4fc2-88f2-f738c4fd0789-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:52.947041 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:52.947035    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n2hc\" (UniqueName: \"kubernetes.io/projected/1c15b580-47ea-4fc2-88f2-f738c4fd0789-kube-api-access-8n2hc\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:24:53.061964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.061884    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b90b757-5467-42b1-96b6-cf71c9a9ba6f" path="/var/lib/kubelet/pods/4b90b757-5467-42b1-96b6-cf71c9a9ba6f/volumes"
Sep 11 18:24:53.566253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566218    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:24:53.566728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566711    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" containerName="maas-api"
Sep 11 18:24:53.566770 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566730    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" containerName="maas-api"
Sep 11 18:24:53.566770 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566739    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b90b757-5467-42b1-96b6-cf71c9a9ba6f" containerName="revoke-keys"
Sep 11 18:24:53.566770 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566746    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b90b757-5467-42b1-96b6-cf71c9a9ba6f" containerName="revoke-keys"
Sep 11 18:24:53.566913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566865    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b90b757-5467-42b1-96b6-cf71c9a9ba6f" containerName="revoke-keys"
Sep 11 18:24:53.566913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.566876    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" containerName="maas-api"
Sep 11 18:24:53.570293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.570271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.572478 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.572458    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ed21d135-openshift-default-dockercfg-xfdn9\""
Sep 11 18:24:53.582260 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.582238    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:24:53.653319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653325    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653422    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spdm5\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653629    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.653822 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.653648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.696599 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.696570    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"
Sep 11 18:24:53.696756 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.696599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx" event={"ID":"1c15b580-47ea-4fc2-88f2-f738c4fd0789","Type":"ContainerDied","Data":"ee6be0d0fea005fa21ed98ec941af7ecd0888d7b4733721af85815bb68aa7c2d"}
Sep 11 18:24:53.696756 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.696681    2566 scope.go:117] "RemoveContainer" containerID="f7785a3eb981d250006cc174b5f7861411942068d0a3862866e73f2f676fce94"
Sep 11 18:24:53.712748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.712724    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:53.717658 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.717634    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8c01007-5668674d88-gz7gx"]
Sep 11 18:24:53.754876 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.754835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.754906    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.754979    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755049    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spdm5\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755155    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755188    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.755283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.755218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.756682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.756648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.756879 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.756854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.756974 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.756952    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.757181 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.757161    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.757494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.757472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.761812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.759195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.761812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.760506    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.766177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.766144    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.766367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.766319    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spdm5\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5\") pod \"e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") " pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:53.882979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:53.882891    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:54.161521 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.161438    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:24:54.164320 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:24:54.164295    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22d8808_039f_4e38_980b_29bbb02c3bbc.slice/crio-4361f35b3e3039bcc09ea169e7bab8135bf94ff6bc0c2cd35f52e5aaf37cf1d6 WatchSource:0}: Error finding container 4361f35b3e3039bcc09ea169e7bab8135bf94ff6bc0c2cd35f52e5aaf37cf1d6: Status 404 returned error can't find the container with id 4361f35b3e3039bcc09ea169e7bab8135bf94ff6bc0c2cd35f52e5aaf37cf1d6
Sep 11 18:24:54.166517 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.166485    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:54.166586 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.166549    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:54.166625 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.166596    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:24:54.705152 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.705116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerStarted","Data":"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"}
Sep 11 18:24:54.705580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.705181    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerStarted","Data":"4361f35b3e3039bcc09ea169e7bab8135bf94ff6bc0c2cd35f52e5aaf37cf1d6"}
Sep 11 18:24:54.731519 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.731469    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podStartSLOduration=1.731453583 podStartE2EDuration="1.731453583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:54.728979421 +0000 UTC m=+872.149753822" watchObservedRunningTime="2026-09-11 18:24:54.731453583 +0000 UTC m=+872.152228046"
Sep 11 18:24:54.884056 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:54.884010    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:55.064723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:55.064649    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c15b580-47ea-4fc2-88f2-f738c4fd0789" path="/var/lib/kubelet/pods/1c15b580-47ea-4fc2-88f2-f738c4fd0789/volumes"
Sep 11 18:24:55.888681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:55.888653    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:56.718153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:56.718122    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:56.719015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:56.718993    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:24:57.865308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.865275    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:24:57.869294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.869268    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:57.872101 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.871679    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ed21d135-serving-cert\""
Sep 11 18:24:57.880133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.880106    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:24:57.999420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.999389    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj4x\" (UniqueName: \"kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:57.999625 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.999426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:57.999625 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.999581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:57.999719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:57.999697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.100409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.100375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.100608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.100468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.100608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.100512    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj4x\" (UniqueName: \"kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.100608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.100542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.100776 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:58.100682    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-serving-cert: secret "maas-api-e2e-ait-ed21d135-serving-cert" not found
Sep 11 18:24:58.100776 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:24:58.100742    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls podName:853cc27e-c2ad-4adb-b327-562007d01575 nodeName:}" failed. No retries permitted until 2026-09-11 18:24:58.600727367 +0000 UTC m=+876.021501748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls") pod "maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" (UID: "853cc27e-c2ad-4adb-b327-562007d01575") : secret "maas-api-e2e-ait-ed21d135-serving-cert" not found
Sep 11 18:24:58.101108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.101086    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.102966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.102945    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.108244 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.108223    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj4x\" (UniqueName: \"kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.605185 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.605145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.607596 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.607568    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") pod \"maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:58.783007 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:58.782975    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:59.060211 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:24:59.060184    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853cc27e_c2ad_4adb_b327_562007d01575.slice/crio-03a627ef0ee9a5a0b2ab4681d20ed8927b81836975589224670e2829f1c5e00f WatchSource:0}: Error finding container 03a627ef0ee9a5a0b2ab4681d20ed8927b81836975589224670e2829f1c5e00f: Status 404 returned error can't find the container with id 03a627ef0ee9a5a0b2ab4681d20ed8927b81836975589224670e2829f1c5e00f
Sep 11 18:24:59.062235 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:59.062184    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:24:59.739117 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:59.739082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" event={"ID":"853cc27e-c2ad-4adb-b327-562007d01575","Type":"ContainerStarted","Data":"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"}
Sep 11 18:24:59.739303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:59.739142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" event={"ID":"853cc27e-c2ad-4adb-b327-562007d01575","Type":"ContainerStarted","Data":"03a627ef0ee9a5a0b2ab4681d20ed8927b81836975589224670e2829f1c5e00f"}
Sep 11 18:24:59.739303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:59.739204    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:24:59.757108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:24:59.757057    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" podStartSLOduration=2.302215528 podStartE2EDuration="2.757040041s" totalImagesPullingTime="454.824513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:59.755306673 +0000 UTC m=+877.176081075" watchObservedRunningTime="2026-09-11 18:24:59.757040041 +0000 UTC m=+877.177814443"
Sep 11 18:25:05.769025 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:05.768974    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:25:12.761965 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:12.761918    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:25:12.762551 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:12.762015    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:25:14.843172 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.843140    2566 generic.go:356] "Generic (PLEG): container finished" podID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerID="8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9" exitCode=0
Sep 11 18:25:14.843708 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.843219    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerDied","Data":"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"}
Sep 11 18:25:14.843818 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.843771    2566 scope.go:117] "RemoveContainer" containerID="8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"
Sep 11 18:25:14.844967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.844935    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:25:14.845064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.845001    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:25:14.845064 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:14.845030    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:25:15.870508 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:15.869373    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerStarted","Data":"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"}
Sep 11 18:25:15.883971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:15.883935    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:15.884229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:15.884202    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:15.884288 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:15.884266    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:16.883551 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:16.883520    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:16.883955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:16.883569    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:17.883599 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:17.883558    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:17.884046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:17.883626    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:18.883613 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:18.883578    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:18.884057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:18.883896    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:19.884095 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:19.884052    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:19.884530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:19.884157    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:20.883862 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:20.883819    2566 patch_prober.go:28] interesting pod/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 18:25:20.884044 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:20.883883    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 18:25:21.886659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:21.886632    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:21.887141 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:21.887080    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:21.887767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:21.887749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:23.035737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:23.035706    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:25:23.037224 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:23.037198    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:25:38.141971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.141933    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:25:38.142408 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.142186    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" podUID="853cc27e-c2ad-4adb-b327-562007d01575" containerName="maas-api" containerID="cri-o://e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f" gracePeriod=30
Sep 11 18:25:38.389338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.389314    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:25:38.507894 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.507864    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") pod \"853cc27e-c2ad-4adb-b327-562007d01575\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") "
Sep 11 18:25:38.508072 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.507902    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvj4x\" (UniqueName: \"kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x\") pod \"853cc27e-c2ad-4adb-b327-562007d01575\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") "
Sep 11 18:25:38.508072 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.507957    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca\") pod \"853cc27e-c2ad-4adb-b327-562007d01575\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") "
Sep 11 18:25:38.508072 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.507995    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs\") pod \"853cc27e-c2ad-4adb-b327-562007d01575\" (UID: \"853cc27e-c2ad-4adb-b327-562007d01575\") "
Sep 11 18:25:38.508363 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.508342    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "853cc27e-c2ad-4adb-b327-562007d01575" (UID: "853cc27e-c2ad-4adb-b327-562007d01575"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:25:38.510075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.510047    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "853cc27e-c2ad-4adb-b327-562007d01575" (UID: "853cc27e-c2ad-4adb-b327-562007d01575"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:25:38.510075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.510056    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x" (OuterVolumeSpecName: "kube-api-access-vvj4x") pod "853cc27e-c2ad-4adb-b327-562007d01575" (UID: "853cc27e-c2ad-4adb-b327-562007d01575"). InnerVolumeSpecName "kube-api-access-vvj4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:38.510075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.510064    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "853cc27e-c2ad-4adb-b327-562007d01575" (UID: "853cc27e-c2ad-4adb-b327-562007d01575"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:25:38.609744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.609704    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvj4x\" (UniqueName: \"kubernetes.io/projected/853cc27e-c2ad-4adb-b327-562007d01575-kube-api-access-vvj4x\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:38.609744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.609738    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/853cc27e-c2ad-4adb-b327-562007d01575-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:38.609744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.609751    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:38.610020 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:38.609765    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/853cc27e-c2ad-4adb-b327-562007d01575-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:39.017235 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.017201    2566 generic.go:356] "Generic (PLEG): container finished" podID="853cc27e-c2ad-4adb-b327-562007d01575" containerID="e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f" exitCode=0
Sep 11 18:25:39.017404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.017244    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"
Sep 11 18:25:39.017404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.017281    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" event={"ID":"853cc27e-c2ad-4adb-b327-562007d01575","Type":"ContainerDied","Data":"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"}
Sep 11 18:25:39.017404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.017330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd" event={"ID":"853cc27e-c2ad-4adb-b327-562007d01575","Type":"ContainerDied","Data":"03a627ef0ee9a5a0b2ab4681d20ed8927b81836975589224670e2829f1c5e00f"}
Sep 11 18:25:39.017404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.017352    2566 scope.go:117] "RemoveContainer" containerID="e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"
Sep 11 18:25:39.031161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.031138    2566 scope.go:117] "RemoveContainer" containerID="e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"
Sep 11 18:25:39.031469 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:25:39.031451    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f\": container with ID starting with e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f not found: ID does not exist" containerID="e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"
Sep 11 18:25:39.031525 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.031480    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f"} err="failed to get container status \"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f\": rpc error: code = NotFound desc = could not find container \"e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f\": container with ID starting with e19232584177791a99de26ddecf5d392461ed91e6c94c9a1c9db6fca4503b43f not found: ID does not exist"
Sep 11 18:25:39.045055 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.045031    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:25:39.049465 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.049443    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed21d135-5d79bcc699-skqtd"]
Sep 11 18:25:39.061415 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.061390    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853cc27e-c2ad-4adb-b327-562007d01575" path="/var/lib/kubelet/pods/853cc27e-c2ad-4adb-b327-562007d01575/volumes"
Sep 11 18:25:39.463936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.463902    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:25:39.464328 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:39.464108    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy" containerID="cri-o://7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248" gracePeriod=30
Sep 11 18:25:44.724635 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.724577    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:44.877270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877233    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spdm5\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877306    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877400    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877571 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877465    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877571 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877516    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877571 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877543    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877589    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877624    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:44.877827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data\") pod \"d22d8808-039f-4e38-980b-29bbb02c3bbc\" (UID: \"d22d8808-039f-4e38-980b-29bbb02c3bbc\") "
Sep 11 18:25:44.877827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877744    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:44.878074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877955    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:25:44.878074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.877975    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:44.878178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.878110    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:44.878240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.878202    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.878240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.878222    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d22d8808-039f-4e38-980b-29bbb02c3bbc-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.878240 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.878236    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.878392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.878248    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.879604 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.879582    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:44.879739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.879722    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5" (OuterVolumeSpecName: "kube-api-access-spdm5") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "kube-api-access-spdm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:44.879739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.879725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:44.879837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.879725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d22d8808-039f-4e38-980b-29bbb02c3bbc" (UID: "d22d8808-039f-4e38-980b-29bbb02c3bbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:25:44.979285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.979185    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.979285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.979220    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spdm5\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-kube-api-access-spdm5\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.979285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.979233    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.979285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.979244    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.979285 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:44.979255    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d22d8808-039f-4e38-980b-29bbb02c3bbc-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:25:45.059096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.059061    2566 generic.go:356] "Generic (PLEG): container finished" podID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerID="7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248" exitCode=0
Sep 11 18:25:45.059261 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.059143    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"
Sep 11 18:25:45.062452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.062424    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerDied","Data":"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"}
Sep 11 18:25:45.062583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.062468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7" event={"ID":"d22d8808-039f-4e38-980b-29bbb02c3bbc","Type":"ContainerDied","Data":"4361f35b3e3039bcc09ea169e7bab8135bf94ff6bc0c2cd35f52e5aaf37cf1d6"}
Sep 11 18:25:45.062583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.062495    2566 scope.go:117] "RemoveContainer" containerID="7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"
Sep 11 18:25:45.072390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.072372    2566 scope.go:117] "RemoveContainer" containerID="8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"
Sep 11 18:25:45.083468 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.083387    2566 scope.go:117] "RemoveContainer" containerID="7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"
Sep 11 18:25:45.085602 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:25:45.085578    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248\": container with ID starting with 7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248 not found: ID does not exist" containerID="7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"
Sep 11 18:25:45.085681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.085608    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248"} err="failed to get container status \"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248\": rpc error: code = NotFound desc = could not find container \"7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248\": container with ID starting with 7b591875c86e38b52d98640ca6cd6230f7fd5cca6d51d14a5e006a4b9474a248 not found: ID does not exist"
Sep 11 18:25:45.085681 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.085626    2566 scope.go:117] "RemoveContainer" containerID="8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"
Sep 11 18:25:45.085969 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:25:45.085950    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9\": container with ID starting with 8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9 not found: ID does not exist" containerID="8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"
Sep 11 18:25:45.086033 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.085974    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9"} err="failed to get container status \"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9\": rpc error: code = NotFound desc = could not find container \"8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9\": container with ID starting with 8bdc14d60c87f02ac4eb23b8293f98df42a4db44c1f685103c0712b1572a20e9 not found: ID does not exist"
Sep 11 18:25:45.086387 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.086367    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:25:45.095313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:45.095287    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7"]
Sep 11 18:25:47.062570 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.062534    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" path="/var/lib/kubelet/pods/d22d8808-039f-4e38-980b-29bbb02c3bbc/volumes"
Sep 11 18:25:47.062949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.062882    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:25:47.063431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063411    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:25:47.063513 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063434    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:25:47.063513 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063454    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853cc27e-c2ad-4adb-b327-562007d01575" containerName="maas-api"
Sep 11 18:25:47.063513 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063462    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="853cc27e-c2ad-4adb-b327-562007d01575" containerName="maas-api"
Sep 11 18:25:47.063672 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063655    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="853cc27e-c2ad-4adb-b327-562007d01575" containerName="maas-api"
Sep 11 18:25:47.063729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063674    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:25:47.063729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.063687    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:25:47.068952 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.068913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.071170 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.071150    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-23f49f11-serving-cert\""
Sep 11 18:25:47.074420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.074393    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:25:47.199710 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.199672    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.199926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.199748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdg5x\" (UniqueName: \"kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.199926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.199776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.200026 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.199965    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.301364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.301331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.301560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.301400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.301560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.301448    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdg5x\" (UniqueName: \"kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.301560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.301473    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.301984 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.301957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.303885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.303856    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.304016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.303996    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.309124 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.309098    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdg5x\" (UniqueName: \"kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x\") pod \"maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.382293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.382207    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:47.659614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.659590    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:25:47.661467 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:25:47.661434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b993d6_4b97_410c_9ee3_a42a3aec3d82.slice/crio-218dc82c1d4b187eeef4321874de03948bab11d07ad3033d07bc2be236c4603b WatchSource:0}: Error finding container 218dc82c1d4b187eeef4321874de03948bab11d07ad3033d07bc2be236c4603b: Status 404 returned error can't find the container with id 218dc82c1d4b187eeef4321874de03948bab11d07ad3033d07bc2be236c4603b
Sep 11 18:25:47.663198 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:47.663178    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:25:48.079735 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:48.079702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" event={"ID":"86b993d6-4b97-410c-9ee3-a42a3aec3d82","Type":"ContainerStarted","Data":"218dc82c1d4b187eeef4321874de03948bab11d07ad3033d07bc2be236c4603b"}
Sep 11 18:25:49.087393 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:49.087359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" event={"ID":"86b993d6-4b97-410c-9ee3-a42a3aec3d82","Type":"ContainerStarted","Data":"a5dc21cc8f19ad5dc8228bae373e1791759728be584285c5f99427204d02fa68"}
Sep 11 18:25:49.087870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:49.087425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:25:49.108662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:49.108616    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" podStartSLOduration=1.327229017 podStartE2EDuration="2.108599944s" totalImagesPullingTime="781.370927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:25:49.10525018 +0000 UTC m=+926.526024584" watchObservedRunningTime="2026-09-11 18:25:49.108599944 +0000 UTC m=+926.529374350"
Sep 11 18:25:55.099123 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:25:55.099096    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:26:04.122682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.122643    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"]
Sep 11 18:26:04.123135 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.123119    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:26:04.123135 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.123135    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22d8808-039f-4e38-980b-29bbb02c3bbc" containerName="istio-proxy"
Sep 11 18:26:04.126293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.126277    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:04.128351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.128327    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:26:04.134505 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.134478    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"]
Sep 11 18:26:04.167945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.167910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm\" (UID: \"d7cd28e9-61c4-408e-b704-18a652e1b063\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:04.269386 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.269350    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm\" (UID: \"d7cd28e9-61c4-408e-b704-18a652e1b063\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:04.270013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.269990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm\" (UID: \"d7cd28e9-61c4-408e-b704-18a652e1b063\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:04.438950 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.438912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:04.713648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:04.713609    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"]
Sep 11 18:26:04.714852 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:26:04.714822    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7cd28e9_61c4_408e_b704_18a652e1b063.slice/crio-c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1 WatchSource:0}: Error finding container c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1: Status 404 returned error can't find the container with id c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1
Sep 11 18:26:05.184732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:05.184695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm" event={"ID":"d7cd28e9-61c4-408e-b704-18a652e1b063","Type":"ContainerStarted","Data":"8e879223c88d06c86d64abcdc6950431bade13a7664ca984df47444b543db5cd"}
Sep 11 18:26:05.185133 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:05.184747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm" event={"ID":"d7cd28e9-61c4-408e-b704-18a652e1b063","Type":"ContainerStarted","Data":"c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1"}
Sep 11 18:26:05.199888 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:05.199459    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm" podStartSLOduration=1.199440069 podStartE2EDuration="1.199440069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:05.199134213 +0000 UTC m=+942.619908618" watchObservedRunningTime="2026-09-11 18:26:05.199440069 +0000 UTC m=+942.620214472"
Sep 11 18:26:06.198630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:06.198592    2566 generic.go:356] "Generic (PLEG): container finished" podID="d7cd28e9-61c4-408e-b704-18a652e1b063" containerID="8e879223c88d06c86d64abcdc6950431bade13a7664ca984df47444b543db5cd" exitCode=0
Sep 11 18:26:06.199037 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:06.198649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm" event={"ID":"d7cd28e9-61c4-408e-b704-18a652e1b063","Type":"ContainerDied","Data":"8e879223c88d06c86d64abcdc6950431bade13a7664ca984df47444b543db5cd"}
Sep 11 18:26:07.350143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.350115    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:07.400143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.400094    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca\") pod \"d7cd28e9-61c4-408e-b704-18a652e1b063\" (UID: \"d7cd28e9-61c4-408e-b704-18a652e1b063\") "
Sep 11 18:26:07.400423 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.400398    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7cd28e9-61c4-408e-b704-18a652e1b063" (UID: "d7cd28e9-61c4-408e-b704-18a652e1b063"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:26:07.400545 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.400533    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7cd28e9-61c4-408e-b704-18a652e1b063-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:07.765465 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.765430    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"]
Sep 11 18:26:07.765916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.765901    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7cd28e9-61c4-408e-b704-18a652e1b063" containerName="revoke-keys"
Sep 11 18:26:07.765972 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.765918    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7cd28e9-61c4-408e-b704-18a652e1b063" containerName="revoke-keys"
Sep 11 18:26:07.766008 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.765999    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7cd28e9-61c4-408e-b704-18a652e1b063" containerName="revoke-keys"
Sep 11 18:26:07.769161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.769143    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:07.780151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.780128    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"]
Sep 11 18:26:07.907243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:07.907209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-23f49f11-p27cn\" (UID: \"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:08.008748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.008711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-23f49f11-p27cn\" (UID: \"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:08.009362 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.009341    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-23f49f11-p27cn\" (UID: \"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:08.080383 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.080294    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:08.211720 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.211694    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"
Sep 11 18:26:08.211884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.211697    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm" event={"ID":"d7cd28e9-61c4-408e-b704-18a652e1b063","Type":"ContainerDied","Data":"c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1"}
Sep 11 18:26:08.211884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.211847    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c40a844d30f738ce24c7a201012514d2356055198e9109dec8211265e4bf49d1"
Sep 11 18:26:08.353489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:08.353414    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"]
Sep 11 18:26:08.356824 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:26:08.356796    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf53ffbe_a827_4cdb_b51f_4a26d660ddbd.slice/crio-3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4 WatchSource:0}: Error finding container 3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4: Status 404 returned error can't find the container with id 3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4
Sep 11 18:26:09.219249 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:09.219212    2566 generic.go:356] "Generic (PLEG): container finished" podID="bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" containerID="d88a4a03a1e63e5f083d0c88ebc97d18fce9757eef1d8ed6e756e323f5031262" exitCode=0
Sep 11 18:26:09.219443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:09.219308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn" event={"ID":"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd","Type":"ContainerDied","Data":"d88a4a03a1e63e5f083d0c88ebc97d18fce9757eef1d8ed6e756e323f5031262"}
Sep 11 18:26:09.219443 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:09.219370    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn" event={"ID":"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd","Type":"ContainerStarted","Data":"3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4"}
Sep 11 18:26:10.367475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:10.367448    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:10.431348 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:10.431319    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca\") pod \"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd\" (UID: \"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd\") "
Sep 11 18:26:10.431691 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:10.431667    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" (UID: "bf53ffbe-a827-4cdb-b51f-4a26d660ddbd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:26:10.532304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:10.532224    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:11.240079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:11.240048    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn" event={"ID":"bf53ffbe-a827-4cdb-b51f-4a26d660ddbd","Type":"ContainerDied","Data":"3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4"}
Sep 11 18:26:11.240079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:11.240082    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"
Sep 11 18:26:11.240079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:11.240095    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3324b5fd4a00b959d6faedd7f69bb8a39ff5de6cc0e9e8ce89a4c4e405c1e2a4"
Sep 11 18:26:14.898438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:14.898404    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:26:14.898923 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:14.898607    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" containerName="maas-api" containerID="cri-o://b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163" gracePeriod=30
Sep 11 18:26:15.068983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.068953    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:26:15.069157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.069132    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerName="maas-api" containerID="cri-o://a5dc21cc8f19ad5dc8228bae373e1791759728be584285c5f99427204d02fa68" gracePeriod=30
Sep 11 18:26:15.094597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.094560    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.66:8443/health\": dial tcp 10.133.0.66:8443: connect: connection refused"
Sep 11 18:26:15.167027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.166939    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"]
Sep 11 18:26:15.171834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.171773    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-89bb6c-6m9zm"]
Sep 11 18:26:15.199741 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.199711    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:26:15.267830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.267777    2566 generic.go:356] "Generic (PLEG): container finished" podID="384dfd31-780c-429c-bb29-3ba94f25166b" containerID="b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163" exitCode=0
Sep 11 18:26:15.267830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.267827    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" event={"ID":"384dfd31-780c-429c-bb29-3ba94f25166b","Type":"ContainerDied","Data":"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"}
Sep 11 18:26:15.268092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.267852    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"
Sep 11 18:26:15.268092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.267884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" event={"ID":"384dfd31-780c-429c-bb29-3ba94f25166b","Type":"ContainerDied","Data":"ab4eb4bdb61e6704c55ecec45420bcec1dbbd2e9289941b274b690c040bfff73"}
Sep 11 18:26:15.268092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.267922    2566 scope.go:117] "RemoveContainer" containerID="b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"
Sep 11 18:26:15.270431 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.270405    2566 generic.go:356] "Generic (PLEG): container finished" podID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerID="a5dc21cc8f19ad5dc8228bae373e1791759728be584285c5f99427204d02fa68" exitCode=0
Sep 11 18:26:15.270554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.270521    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" event={"ID":"86b993d6-4b97-410c-9ee3-a42a3aec3d82","Type":"ContainerDied","Data":"a5dc21cc8f19ad5dc8228bae373e1791759728be584285c5f99427204d02fa68"}
Sep 11 18:26:15.279821 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.279774    2566 scope.go:117] "RemoveContainer" containerID="b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"
Sep 11 18:26:15.280177 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:26:15.280150    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163\": container with ID starting with b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163 not found: ID does not exist" containerID="b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"
Sep 11 18:26:15.280963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.280191    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163"} err="failed to get container status \"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163\": rpc error: code = NotFound desc = could not find container \"b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163\": container with ID starting with b977e768123f7363ea4bfbf8352483a03acc6258005e5f1e6930e92b9b366163 not found: ID does not exist"
Sep 11 18:26:15.281484 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.281464    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs\") pod \"384dfd31-780c-429c-bb29-3ba94f25166b\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") "
Sep 11 18:26:15.281566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.281507    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca\") pod \"384dfd31-780c-429c-bb29-3ba94f25166b\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") "
Sep 11 18:26:15.281631 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.281567    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lttq2\" (UniqueName: \"kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2\") pod \"384dfd31-780c-429c-bb29-3ba94f25166b\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") "
Sep 11 18:26:15.281690 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.281670    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls\") pod \"384dfd31-780c-429c-bb29-3ba94f25166b\" (UID: \"384dfd31-780c-429c-bb29-3ba94f25166b\") "
Sep 11 18:26:15.282016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.281989    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "384dfd31-780c-429c-bb29-3ba94f25166b" (UID: "384dfd31-780c-429c-bb29-3ba94f25166b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:26:15.284243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.284217    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "384dfd31-780c-429c-bb29-3ba94f25166b" (UID: "384dfd31-780c-429c-bb29-3ba94f25166b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:15.284356 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.284322    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "384dfd31-780c-429c-bb29-3ba94f25166b" (UID: "384dfd31-780c-429c-bb29-3ba94f25166b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:15.284356 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.284324    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2" (OuterVolumeSpecName: "kube-api-access-lttq2") pod "384dfd31-780c-429c-bb29-3ba94f25166b" (UID: "384dfd31-780c-429c-bb29-3ba94f25166b"). InnerVolumeSpecName "kube-api-access-lttq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:26:15.339946 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.339920    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:26:15.382524 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.382488    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.382524 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.382518    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/384dfd31-780c-429c-bb29-3ba94f25166b-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.382524 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.382533    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lttq2\" (UniqueName: \"kubernetes.io/projected/384dfd31-780c-429c-bb29-3ba94f25166b-kube-api-access-lttq2\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.382865 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.382542    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/384dfd31-780c-429c-bb29-3ba94f25166b-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.428389 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.428352    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"]
Sep 11 18:26:15.432556 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.432527    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-23f49f11-p27cn"]
Sep 11 18:26:15.483831 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.483775    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs\") pod \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") "
Sep 11 18:26:15.483994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.483935    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca\") pod \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") "
Sep 11 18:26:15.483994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.483956    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls\") pod \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") "
Sep 11 18:26:15.484119 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.484046    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdg5x\" (UniqueName: \"kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x\") pod \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\" (UID: \"86b993d6-4b97-410c-9ee3-a42a3aec3d82\") "
Sep 11 18:26:15.484334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.484304    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86b993d6-4b97-410c-9ee3-a42a3aec3d82" (UID: "86b993d6-4b97-410c-9ee3-a42a3aec3d82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:26:15.484416 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.484388    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b993d6-4b97-410c-9ee3-a42a3aec3d82-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.487312 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.487285    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x" (OuterVolumeSpecName: "kube-api-access-zdg5x") pod "86b993d6-4b97-410c-9ee3-a42a3aec3d82" (UID: "86b993d6-4b97-410c-9ee3-a42a3aec3d82"). InnerVolumeSpecName "kube-api-access-zdg5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:26:15.487434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.487307    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "86b993d6-4b97-410c-9ee3-a42a3aec3d82" (UID: "86b993d6-4b97-410c-9ee3-a42a3aec3d82"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:15.487434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.487285    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86b993d6-4b97-410c-9ee3-a42a3aec3d82" (UID: "86b993d6-4b97-410c-9ee3-a42a3aec3d82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:15.585475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.585364    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdg5x\" (UniqueName: \"kubernetes.io/projected/86b993d6-4b97-410c-9ee3-a42a3aec3d82-kube-api-access-zdg5x\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.585475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.585427    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.585475 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.585443    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b993d6-4b97-410c-9ee3-a42a3aec3d82-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:15.601048 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.601006    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:26:15.604587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:15.604555    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6"]
Sep 11 18:26:16.278615 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:16.278585    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"
Sep 11 18:26:16.279146 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:16.278619    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx" event={"ID":"86b993d6-4b97-410c-9ee3-a42a3aec3d82","Type":"ContainerDied","Data":"218dc82c1d4b187eeef4321874de03948bab11d07ad3033d07bc2be236c4603b"}
Sep 11 18:26:16.279146 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:16.278679    2566 scope.go:117] "RemoveContainer" containerID="a5dc21cc8f19ad5dc8228bae373e1791759728be584285c5f99427204d02fa68"
Sep 11 18:26:16.303110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:16.303084    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:26:16.307565 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:16.307542    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23f49f11-f74dbfd9c-7f5sx"]
Sep 11 18:26:17.061906 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:17.061872    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" path="/var/lib/kubelet/pods/384dfd31-780c-429c-bb29-3ba94f25166b/volumes"
Sep 11 18:26:17.062290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:17.062277    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" path="/var/lib/kubelet/pods/86b993d6-4b97-410c-9ee3-a42a3aec3d82/volumes"
Sep 11 18:26:17.062561 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:17.062550    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" path="/var/lib/kubelet/pods/bf53ffbe-a827-4cdb-b51f-4a26d660ddbd/volumes"
Sep 11 18:26:17.062840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:17.062827    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7cd28e9-61c4-408e-b704-18a652e1b063" path="/var/lib/kubelet/pods/d7cd28e9-61c4-408e-b704-18a652e1b063/volumes"
Sep 11 18:26:18.191972 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:18.191932    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89bb6c-7847df7f7f-llpz6" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.59:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:26:26.802695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:26.802655    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:26:26.803266 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:26.802953    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy" containerID="cri-o://7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae" gracePeriod=30
Sep 11 18:26:32.055129 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.055100    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:26:32.146645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146566    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146600    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146645 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146619    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146653    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146775    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146875    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.146921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146899    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.147128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.146924    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.147128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147007    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46b7f\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f\") pod \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\" (UID: \"fe2fd0db-7708-4975-9fba-15290a4ae3d9\") "
Sep 11 18:26:32.147128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147004    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:26:32.147128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147026    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:26:32.147308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147152    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:26:32.147308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147235    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:26:32.147528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147500    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:26:32.147528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147507    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.147692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147550    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.147692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147564    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.147692 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.147575    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.149654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.149627    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:26:32.149767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.149673    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:26:32.149767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.149725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f" (OuterVolumeSpecName: "kube-api-access-46b7f") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "kube-api-access-46b7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:26:32.149767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.149756    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe2fd0db-7708-4975-9fba-15290a4ae3d9" (UID: "fe2fd0db-7708-4975-9fba-15290a4ae3d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:26:32.248079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.248041    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.248079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.248073    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.248079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.248084    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46b7f\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-kube-api-access-46b7f\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.248308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.248093    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.248308 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.248101    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2fd0db-7708-4975-9fba-15290a4ae3d9-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:26:32.381643 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.381612    2566 generic.go:356] "Generic (PLEG): container finished" podID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerID="7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae" exitCode=0
Sep 11 18:26:32.381819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.381663    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"
Sep 11 18:26:32.381819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.381664    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerDied","Data":"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"}
Sep 11 18:26:32.381819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.381798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq" event={"ID":"fe2fd0db-7708-4975-9fba-15290a4ae3d9","Type":"ContainerDied","Data":"a1aef6ff545a0928244f152e22aeab2c1b89e78a7f0b9f014d8e337bb2261abf"}
Sep 11 18:26:32.381934 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.381828    2566 scope.go:117] "RemoveContainer" containerID="7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"
Sep 11 18:26:32.391323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.391309    2566 scope.go:117] "RemoveContainer" containerID="fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"
Sep 11 18:26:32.399495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.399477    2566 scope.go:117] "RemoveContainer" containerID="7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"
Sep 11 18:26:32.399763 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:26:32.399744    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae\": container with ID starting with 7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae not found: ID does not exist" containerID="7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"
Sep 11 18:26:32.399857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.399773    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae"} err="failed to get container status \"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae\": rpc error: code = NotFound desc = could not find container \"7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae\": container with ID starting with 7535e104e16b90a62efe2920846731dc95aa3bc24b3dc1ea0e05486f853c7eae not found: ID does not exist"
Sep 11 18:26:32.399857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.399808    2566 scope.go:117] "RemoveContainer" containerID="fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"
Sep 11 18:26:32.400047 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:26:32.400031    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7\": container with ID starting with fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7 not found: ID does not exist" containerID="fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"
Sep 11 18:26:32.400095 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.400055    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7"} err="failed to get container status \"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7\": rpc error: code = NotFound desc = could not find container \"fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7\": container with ID starting with fad6eb22af45126357e833ac86b9bfe75ae42a8612f476356fa840da8d3ecbb7 not found: ID does not exist"
Sep 11 18:26:32.404081 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.404058    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:26:32.409687 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:32.409665    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq"]
Sep 11 18:26:33.062561 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.062524    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" path="/var/lib/kubelet/pods/fe2fd0db-7708-4975-9fba-15290a4ae3d9/volumes"
Sep 11 18:26:33.926046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926015    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:26:33.926436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926424    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:26:33.926436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926438    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926449    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926455    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926466    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" containerName="revoke-keys"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926471    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" containerName="revoke-keys"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926480    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" containerName="maas-api"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926485    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" containerName="maas-api"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926492    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerName="maas-api"
Sep 11 18:26:33.926528 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerName="maas-api"
Sep 11 18:26:33.926798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926563    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf53ffbe-a827-4cdb-b51f-4a26d660ddbd" containerName="revoke-keys"
Sep 11 18:26:33.926798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926570    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:26:33.926798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926576    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b993d6-4b97-410c-9ee3-a42a3aec3d82" containerName="maas-api"
Sep 11 18:26:33.926798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.926583    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="384dfd31-780c-429c-bb29-3ba94f25166b" containerName="maas-api"
Sep 11 18:26:33.931221 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.931197    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:33.933906 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.933863    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-386ac7-serving-cert\""
Sep 11 18:26:33.933906 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.933898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:26:33.934086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.933906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bqwkv\""
Sep 11 18:26:33.940153 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.940074    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:26:33.963466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.963426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:33.963466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.963463    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gz9\" (UniqueName: \"kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:33.963723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.963554    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:33.963723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:33.963592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.064463 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.064423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.065034 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.064470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gz9\" (UniqueName: \"kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.065034 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.064542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.065034 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.064593    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.065034 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:26:34.064648    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-serving-cert: secret "maas-api-e2e-explicit-386ac7-serving-cert" not found
Sep 11 18:26:34.065034 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:26:34.064729    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls podName:457703de-215c-4e5e-914f-ddab27f76fb4 nodeName:}" failed. No retries permitted until 2026-09-11 18:26:34.564704859 +0000 UTC m=+971.985479251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls") pod "maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" (UID: "457703de-215c-4e5e-914f-ddab27f76fb4") : secret "maas-api-e2e-explicit-386ac7-serving-cert" not found
Sep 11 18:26:34.065337 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.065320    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.067137 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.067116    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.075089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.075070    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gz9\" (UniqueName: \"kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.569156 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.569125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.571639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.571606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") pod \"maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:34.846256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:34.846167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:35.121951 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:35.121923    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:26:35.123003 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:26:35.122979    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457703de_215c_4e5e_914f_ddab27f76fb4.slice/crio-78dfb41b6e4b37c840d755ecb4cb439b02cf5a2f24daac6148a825cd37063dff WatchSource:0}: Error finding container 78dfb41b6e4b37c840d755ecb4cb439b02cf5a2f24daac6148a825cd37063dff: Status 404 returned error can't find the container with id 78dfb41b6e4b37c840d755ecb4cb439b02cf5a2f24daac6148a825cd37063dff
Sep 11 18:26:35.403388 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:35.403297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" event={"ID":"457703de-215c-4e5e-914f-ddab27f76fb4","Type":"ContainerStarted","Data":"78dfb41b6e4b37c840d755ecb4cb439b02cf5a2f24daac6148a825cd37063dff"}
Sep 11 18:26:36.412292 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:36.412258    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" event={"ID":"457703de-215c-4e5e-914f-ddab27f76fb4","Type":"ContainerStarted","Data":"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"}
Sep 11 18:26:36.412759 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:36.412401    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:26:36.429878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:36.429834    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" podStartSLOduration=3.058150322 podStartE2EDuration="3.429820099s" totalImagesPullingTime="371.669777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:36.428929183 +0000 UTC m=+973.849703578" watchObservedRunningTime="2026-09-11 18:26:36.429820099 +0000 UTC m=+973.850594501"
Sep 11 18:26:42.425008 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:26:42.424974    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:27:29.497471 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.497428    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:29.498242 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.498222    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2fd0db-7708-4975-9fba-15290a4ae3d9" containerName="istio-proxy"
Sep 11 18:27:29.502600 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.502582    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.505543 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.505508    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-386ac7\"/\"explicit-model-386ac7-kserve-self-signed-certs\""
Sep 11 18:27:29.505677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.505540    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-386ac7\"/\"openshift-service-ca.crt\""
Sep 11 18:27:29.505677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.505562    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-386ac7\"/\"default-dockercfg-mdhnh\""
Sep 11 18:27:29.505677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.505512    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-386ac7\"/\"kube-root-ca.crt\""
Sep 11 18:27:29.510463 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.510437    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:29.614986 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.614950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.615166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.614992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.615166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.615021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.615166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.615105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.615166 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.615141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9dqp\" (UniqueName: \"kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.615303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.615252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716354 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716407    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9dqp\" (UniqueName: \"kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716847 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716821    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.716942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.717002 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.716970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.718763 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.718739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.718889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.718833    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.724748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.724727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9dqp\" (UniqueName: \"kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp\") pod \"explicit-model-386ac7-kserve-7795f8f4c7-78xxh\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") " pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:29.814632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:29.814554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:30.087587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:30.087561    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:30.089335 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:27:30.089304    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46e5be91_564b_48b8_88a1_0181c256bfa3.slice/crio-e6fcb8f83c23169ab6ee373196874b27af6b7e6af331157e1f2b3831dc91c837 WatchSource:0}: Error finding container e6fcb8f83c23169ab6ee373196874b27af6b7e6af331157e1f2b3831dc91c837: Status 404 returned error can't find the container with id e6fcb8f83c23169ab6ee373196874b27af6b7e6af331157e1f2b3831dc91c837
Sep 11 18:27:30.743414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:30.743379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" event={"ID":"46e5be91-564b-48b8-88a1-0181c256bfa3","Type":"ContainerStarted","Data":"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"}
Sep 11 18:27:30.743414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:30.743420    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" event={"ID":"46e5be91-564b-48b8-88a1-0181c256bfa3","Type":"ContainerStarted","Data":"e6fcb8f83c23169ab6ee373196874b27af6b7e6af331157e1f2b3831dc91c837"}
Sep 11 18:27:30.762077 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:30.762028    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" podStartSLOduration=1.762013285 podStartE2EDuration="1.762013285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:27:30.760063308 +0000 UTC m=+1028.180837710" watchObservedRunningTime="2026-09-11 18:27:30.762013285 +0000 UTC m=+1028.182787688"
Sep 11 18:27:39.814866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:39.814833    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:39.814866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:39.814870    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:39.827621 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:39.827589    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:40.821040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:40.821012    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:41.432112 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.432079    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:41.546980 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.546944    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"]
Sep 11 18:27:41.551582 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.551563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:41.553577 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.553553    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:27:41.559859 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.559676    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"]
Sep 11 18:27:41.737142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.737055    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq\" (UID: \"bbbf54f0-e01d-404a-946a-1de2c205501f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:41.838311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.838274    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq\" (UID: \"bbbf54f0-e01d-404a-946a-1de2c205501f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:41.838781 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:41.838397    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:41.838781 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:41.838458    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:27:42.338442419 +0000 UTC m=+1039.759216800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:41.839088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.839067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq\" (UID: \"bbbf54f0-e01d-404a-946a-1de2c205501f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:41.865668 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:41.865639    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:42.136342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:42.136268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"]
Sep 11 18:27:42.138823 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:27:42.138782    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbf54f0_e01d_404a_946a_1de2c205501f.slice/crio-890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1 WatchSource:0}: Error finding container 890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1: Status 404 returned error can't find the container with id 890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1
Sep 11 18:27:42.341694 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:42.341667    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:42.341892 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:42.341727    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:27:43.34171391 +0000 UTC m=+1040.762488291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:42.824612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:42.824572    2566 generic.go:356] "Generic (PLEG): container finished" podID="bbbf54f0-e01d-404a-946a-1de2c205501f" containerID="10f598b7c50ad9583ffbeef5dd2d628f882df57676cc0b73896f0d14388affee" exitCode=0
Sep 11 18:27:42.824772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:42.824648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq" event={"ID":"bbbf54f0-e01d-404a-946a-1de2c205501f","Type":"ContainerDied","Data":"10f598b7c50ad9583ffbeef5dd2d628f882df57676cc0b73896f0d14388affee"}
Sep 11 18:27:42.824772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:42.824739    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq" event={"ID":"bbbf54f0-e01d-404a-946a-1de2c205501f","Type":"ContainerStarted","Data":"890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1"}
Sep 11 18:27:43.352307 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:43.352269    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:43.352686 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:43.352358    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:27:45.352339876 +0000 UTC m=+1042.773114270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:43.967748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:43.967720    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:44.059275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.059239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca\") pod \"bbbf54f0-e01d-404a-946a-1de2c205501f\" (UID: \"bbbf54f0-e01d-404a-946a-1de2c205501f\") "
Sep 11 18:27:44.059580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.059557    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bbbf54f0-e01d-404a-946a-1de2c205501f" (UID: "bbbf54f0-e01d-404a-946a-1de2c205501f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:27:44.160357 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.160269    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbbf54f0-e01d-404a-946a-1de2c205501f-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:44.837413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.837378    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"
Sep 11 18:27:44.837413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.837408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq" event={"ID":"bbbf54f0-e01d-404a-946a-1de2c205501f","Type":"ContainerDied","Data":"890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1"}
Sep 11 18:27:44.837855 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:44.837453    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="890a2269c75df9a4868f6f989b150f52057915d46bdae6a18be04fa69b140be1"
Sep 11 18:27:45.372599 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:45.372569    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:45.372815 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:45.372644    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:27:49.372624506 +0000 UTC m=+1046.793398897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:49.412544 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:49.412507    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:49.412962 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:49.412577    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:27:57.41256139 +0000 UTC m=+1054.833335772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:52.321343 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.321303    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:27:52.321806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.321552    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" containerName="maas-api" containerID="cri-o://79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6" gracePeriod=30
Sep 11 18:27:52.420305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.420268    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.69:8443/health\": dial tcp 10.133.0.69:8443: connect: connection refused"
Sep 11 18:27:52.542107 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.542075    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"]
Sep 11 18:27:52.545429 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.545403    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-386ac7-b9rfq"]
Sep 11 18:27:52.585768 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.585707    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:27:52.647167 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.647130    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") pod \"457703de-215c-4e5e-914f-ddab27f76fb4\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") "
Sep 11 18:27:52.647398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.647383    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs\") pod \"457703de-215c-4e5e-914f-ddab27f76fb4\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") "
Sep 11 18:27:52.647539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.647525    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca\") pod \"457703de-215c-4e5e-914f-ddab27f76fb4\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") "
Sep 11 18:27:52.647644 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.647631    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72gz9\" (UniqueName: \"kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9\") pod \"457703de-215c-4e5e-914f-ddab27f76fb4\" (UID: \"457703de-215c-4e5e-914f-ddab27f76fb4\") "
Sep 11 18:27:52.649636 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.649593    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "457703de-215c-4e5e-914f-ddab27f76fb4" (UID: "457703de-215c-4e5e-914f-ddab27f76fb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:27:52.652628 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.652591    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "457703de-215c-4e5e-914f-ddab27f76fb4" (UID: "457703de-215c-4e5e-914f-ddab27f76fb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:27:52.653826 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.653753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9" (OuterVolumeSpecName: "kube-api-access-72gz9") pod "457703de-215c-4e5e-914f-ddab27f76fb4" (UID: "457703de-215c-4e5e-914f-ddab27f76fb4"). InnerVolumeSpecName "kube-api-access-72gz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:27:52.653954 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.653871    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "457703de-215c-4e5e-914f-ddab27f76fb4" (UID: "457703de-215c-4e5e-914f-ddab27f76fb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:27:52.748776 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.748727    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:52.748776 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.748771    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457703de-215c-4e5e-914f-ddab27f76fb4-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:52.748776 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.748780    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457703de-215c-4e5e-914f-ddab27f76fb4-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:52.749035 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.748805    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72gz9\" (UniqueName: \"kubernetes.io/projected/457703de-215c-4e5e-914f-ddab27f76fb4-kube-api-access-72gz9\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:52.889927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.889830    2566 generic.go:356] "Generic (PLEG): container finished" podID="457703de-215c-4e5e-914f-ddab27f76fb4" containerID="79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6" exitCode=0
Sep 11 18:27:52.889927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.889871    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"
Sep 11 18:27:52.889927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.889911    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" event={"ID":"457703de-215c-4e5e-914f-ddab27f76fb4","Type":"ContainerDied","Data":"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"}
Sep 11 18:27:52.890202 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.889975    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg" event={"ID":"457703de-215c-4e5e-914f-ddab27f76fb4","Type":"ContainerDied","Data":"78dfb41b6e4b37c840d755ecb4cb439b02cf5a2f24daac6148a825cd37063dff"}
Sep 11 18:27:52.890202 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.890004    2566 scope.go:117] "RemoveContainer" containerID="79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"
Sep 11 18:27:52.899632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.899615    2566 scope.go:117] "RemoveContainer" containerID="79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"
Sep 11 18:27:52.899951 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:52.899929    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6\": container with ID starting with 79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6 not found: ID does not exist" containerID="79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"
Sep 11 18:27:52.900012 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.899962    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6"} err="failed to get container status \"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6\": rpc error: code = NotFound desc = could not find container \"79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6\": container with ID starting with 79683d8dd1f01cc04ac4ad7cbfa767b847dfb6638fbbf371da4d4555b1059ce6 not found: ID does not exist"
Sep 11 18:27:52.911946 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.911922    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:27:52.917178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:52.917154    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-386ac7-86f667b6d6-wdbtg"]
Sep 11 18:27:53.076660 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:53.076626    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" path="/var/lib/kubelet/pods/457703de-215c-4e5e-914f-ddab27f76fb4/volumes"
Sep 11 18:27:53.077021 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:53.077006    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbbf54f0-e01d-404a-946a-1de2c205501f" path="/var/lib/kubelet/pods/bbbf54f0-e01d-404a-946a-1de2c205501f/volumes"
Sep 11 18:27:54.126850 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.126817    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:27:54.127278 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127252    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbf54f0-e01d-404a-946a-1de2c205501f" containerName="revoke-keys"
Sep 11 18:27:54.127278 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127263    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbf54f0-e01d-404a-946a-1de2c205501f" containerName="revoke-keys"
Sep 11 18:27:54.127350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127287    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" containerName="maas-api"
Sep 11 18:27:54.127350 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127293    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" containerName="maas-api"
Sep 11 18:27:54.127412 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127347    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="457703de-215c-4e5e-914f-ddab27f76fb4" containerName="maas-api"
Sep 11 18:27:54.127412 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.127367    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbbf54f0-e01d-404a-946a-1de2c205501f" containerName="revoke-keys"
Sep 11 18:27:54.131966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.131950    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.134089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.134067    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-07f2626b-openshift-default-dockercfg-z7ll5\""
Sep 11 18:27:54.144205 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.144180    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:27:54.272164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272158    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272428 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272425    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272633 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.272633 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.272513    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhhp\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373398    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373669 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373669 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373463    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhhp\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373669 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373669 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.373902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373896    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.374058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373915    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.374058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.373984    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.374058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.374018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.374261 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.374237    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.374486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.374467    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.375884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.375857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.376022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.375992    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.382626 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.382570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.382731 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.382662    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhhp\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp\") pod \"e2e-mt-07f2626b-openshift-default-759467867b-2cqwz\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") " pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.443131 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.443095    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:54.773118 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:27:54.773089    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065ca208_bdba_4db4_a9c4_f6baf89cbd92.slice/crio-91a28d976a77eeb6ef2a73e14c41f8dab72719b966d60b06c4654745ceb01951 WatchSource:0}: Error finding container 91a28d976a77eeb6ef2a73e14c41f8dab72719b966d60b06c4654745ceb01951: Status 404 returned error can't find the container with id 91a28d976a77eeb6ef2a73e14c41f8dab72719b966d60b06c4654745ceb01951
Sep 11 18:27:54.775580 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.775544    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:27:54.775697 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.775630    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:27:54.775697 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.775674    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:27:54.811663 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.811636    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:27:54.907744 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.907702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerStarted","Data":"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"}
Sep 11 18:27:54.908025 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.907820    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerStarted","Data":"91a28d976a77eeb6ef2a73e14c41f8dab72719b966d60b06c4654745ceb01951"}
Sep 11 18:27:54.928701 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:54.928643    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podStartSLOduration=0.928620632 podStartE2EDuration="928.620632ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:27:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:27:54.925826527 +0000 UTC m=+1052.346600930" watchObservedRunningTime="2026-09-11 18:27:54.928620632 +0000 UTC m=+1052.349395036"
Sep 11 18:27:55.443854 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:55.443823    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:55.449851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:55.449823    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:55.913801 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:55.913706    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:55.914764 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:55.914746    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:27:57.505454 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:57.505421    2566 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-self-signed-certs: secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:57.505867 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:57.505489    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs podName:46e5be91-564b-48b8-88a1-0181c256bfa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:28:13.505476301 +0000 UTC m=+1070.926250683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs") pod "explicit-model-386ac7-kserve-7795f8f4c7-78xxh" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3") : secret "explicit-model-386ac7-kserve-self-signed-certs" not found
Sep 11 18:27:57.843935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:57.843846    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" podUID="46e5be91-564b-48b8-88a1-0181c256bfa3" containerName="main" containerID="cri-o://ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc" gracePeriod=45
Sep 11 18:27:58.099662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.099605    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:58.212874 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.212842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.212874 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.212874    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.213087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.212942    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9dqp\" (UniqueName: \"kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.213087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.212972    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.213087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213030    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.213087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213073    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs\") pod \"46e5be91-564b-48b8-88a1-0181c256bfa3\" (UID: \"46e5be91-564b-48b8-88a1-0181c256bfa3\") "
Sep 11 18:27:58.213236 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213155    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache" (OuterVolumeSpecName: "model-cache") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:27:58.213236 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213165    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:27:58.213327 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213288    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home" (OuterVolumeSpecName: "home") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:27:58.213407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213386    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-home\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.213407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213406    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-model-cache\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.213590 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.213416    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-tmp-dir\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.215256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.215228    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm" (OuterVolumeSpecName: "dshm") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:27:58.215345 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.215264    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp" (OuterVolumeSpecName: "kube-api-access-x9dqp") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "kube-api-access-x9dqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:27:58.215345 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.215309    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46e5be91-564b-48b8-88a1-0181c256bfa3" (UID: "46e5be91-564b-48b8-88a1-0181c256bfa3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:27:58.314938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.314904    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9dqp\" (UniqueName: \"kubernetes.io/projected/46e5be91-564b-48b8-88a1-0181c256bfa3-kube-api-access-x9dqp\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.314938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.314931    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e5be91-564b-48b8-88a1-0181c256bfa3-dshm\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.314938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.314941    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e5be91-564b-48b8-88a1-0181c256bfa3-tls-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:27:58.934341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.934303    2566 generic.go:356] "Generic (PLEG): container finished" podID="46e5be91-564b-48b8-88a1-0181c256bfa3" containerID="ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc" exitCode=0
Sep 11 18:27:58.934762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.934351    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"
Sep 11 18:27:58.934762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.934398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" event={"ID":"46e5be91-564b-48b8-88a1-0181c256bfa3","Type":"ContainerDied","Data":"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"}
Sep 11 18:27:58.934762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.934443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh" event={"ID":"46e5be91-564b-48b8-88a1-0181c256bfa3","Type":"ContainerDied","Data":"e6fcb8f83c23169ab6ee373196874b27af6b7e6af331157e1f2b3831dc91c837"}
Sep 11 18:27:58.934762 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.934464    2566 scope.go:117] "RemoveContainer" containerID="ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"
Sep 11 18:27:58.944231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.944212    2566 scope.go:117] "RemoveContainer" containerID="ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"
Sep 11 18:27:58.944474 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:27:58.944458    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc\": container with ID starting with ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc not found: ID does not exist" containerID="ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"
Sep 11 18:27:58.944524 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.944482    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc"} err="failed to get container status \"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc\": rpc error: code = NotFound desc = could not find container \"ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc\": container with ID starting with ea143e718f2ffb62de71db4120904fe35a83e706bf9e8af04adc7c1e20afe7fc not found: ID does not exist"
Sep 11 18:27:58.956497 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.956475    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:58.961316 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:58.961284    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-386ac7/explicit-model-386ac7-kserve-7795f8f4c7-78xxh"]
Sep 11 18:27:59.061376 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:27:59.061336    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e5be91-564b-48b8-88a1-0181c256bfa3" path="/var/lib/kubelet/pods/46e5be91-564b-48b8-88a1-0181c256bfa3/volumes"
Sep 11 18:28:04.064429 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.064391    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:04.064937 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.064879    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e5be91-564b-48b8-88a1-0181c256bfa3" containerName="main"
Sep 11 18:28:04.064937 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.064892    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e5be91-564b-48b8-88a1-0181c256bfa3" containerName="main"
Sep 11 18:28:04.065059 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.064996    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e5be91-564b-48b8-88a1-0181c256bfa3" containerName="main"
Sep 11 18:28:04.069421 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.069395    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.072833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.072812    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-07f2626b-serving-cert\""
Sep 11 18:28:04.072957 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.072866    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bqwkv\""
Sep 11 18:28:04.073437 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.073419    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:28:04.080920 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.080855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:04.177904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.177870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.178092 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.177914    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m9cj\" (UniqueName: \"kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.178176 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.178077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.178176 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.178156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.278738 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.278702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.278964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.278752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9cj\" (UniqueName: \"kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.278964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.278835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.278964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.278870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.279486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.279460    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.281154 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.281128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.281251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.281168    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.286693 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.286674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m9cj\" (UniqueName: \"kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj\") pod \"maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.381390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.381315    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:04.656922 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.656889    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:04.659660 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:28:04.659630    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18f9fe4_edda_4b9b_935b_6d653fd5732d.slice/crio-3e1dcd5fe742e2a379cef0721ed37d5c4c6f6c607aa81008586d31277049984b WatchSource:0}: Error finding container 3e1dcd5fe742e2a379cef0721ed37d5c4c6f6c607aa81008586d31277049984b: Status 404 returned error can't find the container with id 3e1dcd5fe742e2a379cef0721ed37d5c4c6f6c607aa81008586d31277049984b
Sep 11 18:28:04.972877 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:04.972838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" event={"ID":"f18f9fe4-edda-4b9b-935b-6d653fd5732d","Type":"ContainerStarted","Data":"3e1dcd5fe742e2a379cef0721ed37d5c4c6f6c607aa81008586d31277049984b"}
Sep 11 18:28:05.981278 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:05.981246    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" event={"ID":"f18f9fe4-edda-4b9b-935b-6d653fd5732d","Type":"ContainerStarted","Data":"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"}
Sep 11 18:28:05.981687 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:05.981447    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:06.004278 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.004224    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" podStartSLOduration=1.5976804420000001 podStartE2EDuration="2.004210194s" totalImagesPullingTime="406.529752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:28:06.000313072 +0000 UTC m=+1063.421087500" watchObservedRunningTime="2026-09-11 18:28:06.004210194 +0000 UTC m=+1063.424984596"
Sep 11 18:28:06.071106 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.071074    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:28:06.075554 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.075533    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.078772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.078747    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-d33a60-openshift-default-dockercfg-7rgn2\""
Sep 11 18:28:06.090045 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.090015    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.197767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5xpt\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198471    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198684    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.199537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.198748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.299966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.299882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.299966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.299935    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.299966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.299957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300079    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpt\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300288    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300528    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.300776 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.300754    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.302302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.302276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.302667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.302646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.308446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.308428    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.308446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.308440    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5xpt\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt\") pod \"e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") " pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.386569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.386534    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:06.665896 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.665865    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:28:06.667408 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:28:06.667379    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5eda62_7825_45fe_a9db_28113d006a0c.slice/crio-739aeee662ddc040af0c3a503fc1025cb205f821f165d64d94662a878084d5fe WatchSource:0}: Error finding container 739aeee662ddc040af0c3a503fc1025cb205f821f165d64d94662a878084d5fe: Status 404 returned error can't find the container with id 739aeee662ddc040af0c3a503fc1025cb205f821f165d64d94662a878084d5fe
Sep 11 18:28:06.669975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.669938    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:06.670049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.670023    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:06.670144 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.670097    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:06.996689 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.996648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" event={"ID":"dc5eda62-7825-45fe-a9db-28113d006a0c","Type":"ContainerStarted","Data":"a11a0be9d36efba9749123a90a770a2c7ab2521c8771ee8756ff7c66ed9afe93"}
Sep 11 18:28:06.997113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:06.996745    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" event={"ID":"dc5eda62-7825-45fe-a9db-28113d006a0c","Type":"ContainerStarted","Data":"739aeee662ddc040af0c3a503fc1025cb205f821f165d64d94662a878084d5fe"}
Sep 11 18:28:07.019498 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:07.019444    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" podStartSLOduration=1.019429155 podStartE2EDuration="1.019429155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:28:07.017892023 +0000 UTC m=+1064.438666427" watchObservedRunningTime="2026-09-11 18:28:07.019429155 +0000 UTC m=+1064.440203612"
Sep 11 18:28:07.387477 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:07.387382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:07.388869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:07.388839    2566 patch_prober.go:28] interesting pod/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 11 18:28:07.388981 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:07.388912    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 11 18:28:08.391055 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:08.391026    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:09.009806 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:09.009757    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:09.010571 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:09.010549    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:28:12.002918 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:12.002883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:26.385682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:26.383030    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:38132->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Sep 11 18:28:26.385682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:26.383111    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:38132->10.133.0.72:15021: read: connection reset by peer"
Sep 11 18:28:27.136456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.136422    2566 generic.go:356] "Generic (PLEG): container finished" podID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerID="0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566" exitCode=0
Sep 11 18:28:27.136647 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.136494    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerDied","Data":"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"}
Sep 11 18:28:27.136948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.136932    2566 scope.go:117] "RemoveContainer" containerID="0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"
Sep 11 18:28:27.139949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.138177    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:27.139949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.138259    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:27.139949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:27.138303    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:28:28.144943 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:28.144909    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerStarted","Data":"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"}
Sep 11 18:28:28.443969 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:28.443931    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:28:28.444160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:28.444136    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:28:28.444208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:28.444183    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 18:28:29.443738 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:29.443690    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:28:29.444251 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:29.443766    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 18:28:30.443638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:30.443605    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:28:30.443830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:30.443667    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 18:28:31.444139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:31.444102    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:28:31.444524 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:31.444161    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 18:28:32.443903 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:32.443864    2566 patch_prober.go:28] interesting pod/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 18:28:32.444086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:32.443923    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 18:28:33.447530 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:33.447494    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:28:33.447928 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:33.447884    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:28:33.448704 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:33.448683    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:28:38.020381 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.020345    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"]
Sep 11 18:28:38.023044 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.023027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:38.025313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.025291    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:28:38.032639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.032413    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"]
Sep 11 18:28:38.139484 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.139444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m\" (UID: \"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:38.240128 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.240094    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m\" (UID: \"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:38.240639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.240621    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m\" (UID: \"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:38.335682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.335599    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:38.611420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:38.611396    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"]
Sep 11 18:28:38.613327 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:28:38.613302    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bf0c61_f5d6_4a9f_bddb_83a451629c6c.slice/crio-345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4 WatchSource:0}: Error finding container 345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4: Status 404 returned error can't find the container with id 345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4
Sep 11 18:28:39.224390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:39.224291    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m" event={"ID":"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c","Type":"ContainerStarted","Data":"20942d61f57c7c586654deb2ef899f3f1416a007321a8a0bf745a3abf17c301b"}
Sep 11 18:28:39.224390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:39.224385    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m" event={"ID":"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c","Type":"ContainerStarted","Data":"345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4"}
Sep 11 18:28:39.242382 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:39.242337    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m" podStartSLOduration=1.242322588 podStartE2EDuration="1.242322588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:28:39.239986906 +0000 UTC m=+1096.660761311" watchObservedRunningTime="2026-09-11 18:28:39.242322588 +0000 UTC m=+1096.663096991"
Sep 11 18:28:40.232406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:40.232370    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" containerID="20942d61f57c7c586654deb2ef899f3f1416a007321a8a0bf745a3abf17c301b" exitCode=0
Sep 11 18:28:40.232951 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:40.232419    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m" event={"ID":"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c","Type":"ContainerDied","Data":"20942d61f57c7c586654deb2ef899f3f1416a007321a8a0bf745a3abf17c301b"}
Sep 11 18:28:41.384057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:41.384032    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:41.475209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:41.475173    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca\") pod \"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c\" (UID: \"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c\") "
Sep 11 18:28:41.476188 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:41.476153    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" (UID: "f7bf0c61-f5d6-4a9f-bddb-83a451629c6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:28:41.576886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:41.576780    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:28:42.246625 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:42.246590    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m" event={"ID":"f7bf0c61-f5d6-4a9f-bddb-83a451629c6c","Type":"ContainerDied","Data":"345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4"}
Sep 11 18:28:42.246869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:42.246643    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="345b6e7de002b87116c4f649317de747b46c2a58fe548337c9bf09d3c6f8dde4"
Sep 11 18:28:42.246869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:42.246598    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"
Sep 11 18:28:48.694239 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:48.694200    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:48.694736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:48.694462    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" podUID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" containerName="maas-api" containerID="cri-o://934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640" gracePeriod=30
Sep 11 18:28:48.940322 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:48.940296    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"]
Sep 11 18:28:48.945719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:48.945653    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07f2626b-b9h2m"]
Sep 11 18:28:48.949105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:48.949080    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:49.049548 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.049512    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca\") pod \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") "
Sep 11 18:28:49.049719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.049573    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls\") pod \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") "
Sep 11 18:28:49.049719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.049664    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs\") pod \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") "
Sep 11 18:28:49.049719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.049714    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m9cj\" (UniqueName: \"kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj\") pod \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\" (UID: \"f18f9fe4-edda-4b9b-935b-6d653fd5732d\") "
Sep 11 18:28:49.049999 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.049971    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f18f9fe4-edda-4b9b-935b-6d653fd5732d" (UID: "f18f9fe4-edda-4b9b-935b-6d653fd5732d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:28:49.050137 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.050118    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18f9fe4-edda-4b9b-935b-6d653fd5732d-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:28:49.051774 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.051742    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f18f9fe4-edda-4b9b-935b-6d653fd5732d" (UID: "f18f9fe4-edda-4b9b-935b-6d653fd5732d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:28:49.051946 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.051803    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f18f9fe4-edda-4b9b-935b-6d653fd5732d" (UID: "f18f9fe4-edda-4b9b-935b-6d653fd5732d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:28:49.052161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.052140    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj" (OuterVolumeSpecName: "kube-api-access-8m9cj") pod "f18f9fe4-edda-4b9b-935b-6d653fd5732d" (UID: "f18f9fe4-edda-4b9b-935b-6d653fd5732d"). InnerVolumeSpecName "kube-api-access-8m9cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:28:49.061847 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.061822    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" path="/var/lib/kubelet/pods/f7bf0c61-f5d6-4a9f-bddb-83a451629c6c/volumes"
Sep 11 18:28:49.151923 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.151783    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:28:49.151923 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.151916    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18f9fe4-edda-4b9b-935b-6d653fd5732d-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:28:49.151923 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.151931    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m9cj\" (UniqueName: \"kubernetes.io/projected/f18f9fe4-edda-4b9b-935b-6d653fd5732d-kube-api-access-8m9cj\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:28:49.297640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.297537    2566 generic.go:356] "Generic (PLEG): container finished" podID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" containerID="934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640" exitCode=0
Sep 11 18:28:49.297640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.297600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" event={"ID":"f18f9fe4-edda-4b9b-935b-6d653fd5732d","Type":"ContainerDied","Data":"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"}
Sep 11 18:28:49.297889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.297678    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq" event={"ID":"f18f9fe4-edda-4b9b-935b-6d653fd5732d","Type":"ContainerDied","Data":"3e1dcd5fe742e2a379cef0721ed37d5c4c6f6c607aa81008586d31277049984b"}
Sep 11 18:28:49.297889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.297686    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"
Sep 11 18:28:49.297889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.297707    2566 scope.go:117] "RemoveContainer" containerID="934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"
Sep 11 18:28:49.307074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.307042    2566 scope.go:117] "RemoveContainer" containerID="934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"
Sep 11 18:28:49.307499 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:28:49.307380    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640\": container with ID starting with 934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640 not found: ID does not exist" containerID="934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"
Sep 11 18:28:49.307736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.307691    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640"} err="failed to get container status \"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640\": rpc error: code = NotFound desc = could not find container \"934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640\": container with ID starting with 934d5f6077124a0fa59e86732744829ecd54d2e2cbb0fd960ae8b70550e96640 not found: ID does not exist"
Sep 11 18:28:49.314865 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.314840    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:49.323100 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:49.323079    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-07f2626b-fc8494df6-hjlmq"]
Sep 11 18:28:51.062832 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:51.062658    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" path="/var/lib/kubelet/pods/f18f9fe4-edda-4b9b-935b-6d653fd5732d/volumes"
Sep 11 18:28:55.959219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:55.959185    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:28:55.959603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:28:55.959405    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy" containerID="cri-o://3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b" gracePeriod=30
Sep 11 18:29:01.224632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.224603    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:29:01.271765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.271725    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhhp\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.271961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.271843    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.271961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.271896    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.271961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.271923    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.271961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.271958    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.272180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272074    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.272180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272098    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.272180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272121    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.272180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272174    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token\") pod \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\" (UID: \"065ca208-bdba-4db4-a9c4-f6baf89cbd92\") "
Sep 11 18:29:01.272365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272184    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:01.272365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272191    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:01.272462 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272399    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:01.272593 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272565    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data" (OuterVolumeSpecName: "istio-data") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:01.272593 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272576    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.272723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272613    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.272723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272629    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.272889 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.272867    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:29:01.274297 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.274273    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp" (OuterVolumeSpecName: "kube-api-access-hjhhp") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "kube-api-access-hjhhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:29:01.274409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.274393    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token" (OuterVolumeSpecName: "istio-token") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:29:01.274576 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.274549    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:29:01.274619 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.274580    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "065ca208-bdba-4db4-a9c4-f6baf89cbd92" (UID: "065ca208-bdba-4db4-a9c4-f6baf89cbd92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:01.373446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373411    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.373446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373442    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.373446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373454    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.373703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373467    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhhp\" (UniqueName: \"kubernetes.io/projected/065ca208-bdba-4db4-a9c4-f6baf89cbd92-kube-api-access-hjhhp\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.373703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373478    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.373703 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.373491    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065ca208-bdba-4db4-a9c4-f6baf89cbd92-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:01.375031 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.375004    2566 generic.go:356] "Generic (PLEG): container finished" podID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerID="3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b" exitCode=0
Sep 11 18:29:01.375151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.375050    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"
Sep 11 18:29:01.375151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.375087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerDied","Data":"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"}
Sep 11 18:29:01.375151 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.375138    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz" event={"ID":"065ca208-bdba-4db4-a9c4-f6baf89cbd92","Type":"ContainerDied","Data":"91a28d976a77eeb6ef2a73e14c41f8dab72719b966d60b06c4654745ceb01951"}
Sep 11 18:29:01.375274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.375161    2566 scope.go:117] "RemoveContainer" containerID="3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"
Sep 11 18:29:01.384795 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.384766    2566 scope.go:117] "RemoveContainer" containerID="0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"
Sep 11 18:29:01.396161 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.395988    2566 scope.go:117] "RemoveContainer" containerID="3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"
Sep 11 18:29:01.396726 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:29:01.396702    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b\": container with ID starting with 3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b not found: ID does not exist" containerID="3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"
Sep 11 18:29:01.396846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.396735    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b"} err="failed to get container status \"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b\": rpc error: code = NotFound desc = could not find container \"3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b\": container with ID starting with 3e52b516e240e91946be053255f70add114f3c23a460632fdc78856daab9bd7b not found: ID does not exist"
Sep 11 18:29:01.396846 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.396752    2566 scope.go:117] "RemoveContainer" containerID="0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"
Sep 11 18:29:01.397124 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:29:01.397105    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566\": container with ID starting with 0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566 not found: ID does not exist" containerID="0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"
Sep 11 18:29:01.397173 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.397129    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566"} err="failed to get container status \"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566\": rpc error: code = NotFound desc = could not find container \"0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566\": container with ID starting with 0544aca019fede0562d1591556de3ccea592b0cee95fd9c22e3ae39ec35cf566 not found: ID does not exist"
Sep 11 18:29:01.399659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.399583    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:29:01.402501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:01.402481    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz"]
Sep 11 18:29:03.061591 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:03.061552    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" path="/var/lib/kubelet/pods/065ca208-bdba-4db4-a9c4-f6baf89cbd92/volumes"
Sep 11 18:29:10.410512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410480    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:29:10.410924 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410911    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410925    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410939    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" containerName="maas-api"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410945    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" containerName="maas-api"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410956    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410962    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410967    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" containerName="revoke-keys"
Sep 11 18:29:10.410971 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.410973    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" containerName="revoke-keys"
Sep 11 18:29:10.411206 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.411053    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.411206 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.411062    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18f9fe4-edda-4b9b-935b-6d653fd5732d" containerName="maas-api"
Sep 11 18:29:10.411206 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.411067    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7bf0c61-f5d6-4a9f-bddb-83a451629c6c" containerName="revoke-keys"
Sep 11 18:29:10.411206 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.411072    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="065ca208-bdba-4db4-a9c4-f6baf89cbd92" containerName="istio-proxy"
Sep 11 18:29:10.415656 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.415639    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.418049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.418029    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-a761e9-openshift-default-dockercfg-4tsjq\""
Sep 11 18:29:10.428882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.428858    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:29:10.460109 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460081    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460118    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460138    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460157    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460265    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460322    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460348    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.460665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.460439    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqgw\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.560995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.560958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.560995 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561241 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561241 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561056    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqgw\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561241 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561300    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561367    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561535    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561683 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561639    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561739 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561699    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.561830 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.561781    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.562127 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.562110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.563197 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.563181    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.563540 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.563526    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.568740 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.568714    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.569108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.569091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqgw\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw\") pod \"e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") " pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:10.726432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:10.726393    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:11.008930 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.008778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:29:11.011543 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:29:11.011515    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfebeec_787a_4d0e_952f_c1528787ffec.slice/crio-f2c1414a205c41b366e1d69dc7f656e30a1db238cfc565f9188f45def1eba302 WatchSource:0}: Error finding container f2c1414a205c41b366e1d69dc7f656e30a1db238cfc565f9188f45def1eba302: Status 404 returned error can't find the container with id f2c1414a205c41b366e1d69dc7f656e30a1db238cfc565f9188f45def1eba302
Sep 11 18:29:11.014177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.014146    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:11.014256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.014207    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:11.014256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.014233    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:11.437868 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.437830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerStarted","Data":"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"}
Sep 11 18:29:11.438291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.437890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerStarted","Data":"f2c1414a205c41b366e1d69dc7f656e30a1db238cfc565f9188f45def1eba302"}
Sep 11 18:29:11.465572 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.465512    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podStartSLOduration=1.46549071 podStartE2EDuration="1.46549071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:11.460836435 +0000 UTC m=+1128.881610838" watchObservedRunningTime="2026-09-11 18:29:11.46549071 +0000 UTC m=+1128.886265115"
Sep 11 18:29:11.727439 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:11.727346    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:12.732200 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:12.732170    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:13.450639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:13.450596    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:13.451432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:13.451412    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:15.374359 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:15.374324    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:29:15.374721 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:15.374540    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerName="istio-proxy" containerID="cri-o://a11a0be9d36efba9749123a90a770a2c7ab2521c8771ee8756ff7c66ed9afe93" gracePeriod=30
Sep 11 18:29:17.192962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.192931    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:29:17.196764 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.196746    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.200401 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.200381    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-a761e9-serving-cert\""
Sep 11 18:29:17.201108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.201090    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:29:17.201205 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.201122    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bqwkv\""
Sep 11 18:29:17.209746 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.209726    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:29:17.330175 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.330144    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.330375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.330181    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.330375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.330236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfp2\" (UniqueName: \"kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.330375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.330309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.431732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.431696    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.431732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.431735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.432018 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.431766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfp2\" (UniqueName: \"kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.432018 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.431829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.432018 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:29:17.431887    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-serving-cert: secret "maas-api-e2e-shared-a-w2-a761e9-serving-cert" not found
Sep 11 18:29:17.432018 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:29:17.431972    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls podName:e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e nodeName:}" failed. No retries permitted until 2026-09-11 18:29:17.931952321 +0000 UTC m=+1135.352726702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls") pod "maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" (UID: "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e") : secret "maas-api-e2e-shared-a-w2-a761e9-serving-cert" not found
Sep 11 18:29:17.432367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.432350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.434144 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.434115    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.440300 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.440275    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfp2\" (UniqueName: \"kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.938300 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.938264    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:17.940641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:17.940606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:18.108382 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:18.108343    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:18.388268 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:18.388239    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:29:18.390436 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:29:18.390412    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39cc5d9_e9eb_4fcc_aa53_60bcdc085c0e.slice/crio-db3c9933d8b4097778e2e561d29de21ca1c656913ee31086ac7922d8d3ea63c8 WatchSource:0}: Error finding container db3c9933d8b4097778e2e561d29de21ca1c656913ee31086ac7922d8d3ea63c8: Status 404 returned error can't find the container with id db3c9933d8b4097778e2e561d29de21ca1c656913ee31086ac7922d8d3ea63c8
Sep 11 18:29:18.492870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:18.492836    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" event={"ID":"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e","Type":"ContainerStarted","Data":"db3c9933d8b4097778e2e561d29de21ca1c656913ee31086ac7922d8d3ea63c8"}
Sep 11 18:29:19.500544 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:19.500505    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" event={"ID":"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e","Type":"ContainerStarted","Data":"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"}
Sep 11 18:29:19.500983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:19.500645    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:19.519332 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:19.519259    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" podStartSLOduration=2.151419757 podStartE2EDuration="2.519240548s" totalImagesPullingTime="367.820791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:19.519189716 +0000 UTC m=+1136.939964122" watchObservedRunningTime="2026-09-11 18:29:19.519240548 +0000 UTC m=+1136.940014951"
Sep 11 18:29:20.508706 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.508670    2566 generic.go:356] "Generic (PLEG): container finished" podID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerID="a11a0be9d36efba9749123a90a770a2c7ab2521c8771ee8756ff7c66ed9afe93" exitCode=0
Sep 11 18:29:20.509089 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.508742    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" event={"ID":"dc5eda62-7825-45fe-a9db-28113d006a0c","Type":"ContainerDied","Data":"a11a0be9d36efba9749123a90a770a2c7ab2521c8771ee8756ff7c66ed9afe93"}
Sep 11 18:29:20.631311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.631245    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:29:20.769476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769441    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769496    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769549    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769629    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769702    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5xpt\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769854    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert\") pod \"dc5eda62-7825-45fe-a9db-28113d006a0c\" (UID: \"dc5eda62-7825-45fe-a9db-28113d006a0c\") "
Sep 11 18:29:20.769979 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769861    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:20.770178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.769995    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:20.770178 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770122    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:20.770293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770195    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:20.770349 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770314    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:29:20.770452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770436    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5eda62-7825-45fe-a9db-28113d006a0c-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.770510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770456    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.770510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770469    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.770510 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770483    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.770611 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.770513    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.772237 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.772210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:29:20.772355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.772211    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:29:20.772355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.772247    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:29:20.772355 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.772260    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt" (OuterVolumeSpecName: "kube-api-access-j5xpt") pod "dc5eda62-7825-45fe-a9db-28113d006a0c" (UID: "dc5eda62-7825-45fe-a9db-28113d006a0c"). InnerVolumeSpecName "kube-api-access-j5xpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:29:20.871963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.871928    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5xpt\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-kube-api-access-j5xpt\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.871963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.871956    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.871963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.871965    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:20.871963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:20.871972    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5eda62-7825-45fe-a9db-28113d006a0c-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:21.517295 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:21.517261    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq" event={"ID":"dc5eda62-7825-45fe-a9db-28113d006a0c","Type":"ContainerDied","Data":"739aeee662ddc040af0c3a503fc1025cb205f821f165d64d94662a878084d5fe"}
Sep 11 18:29:21.517754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:21.517302    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"
Sep 11 18:29:21.517754 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:21.517322    2566 scope.go:117] "RemoveContainer" containerID="a11a0be9d36efba9749123a90a770a2c7ab2521c8771ee8756ff7c66ed9afe93"
Sep 11 18:29:21.542006 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:21.541976    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:29:21.546433 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:21.546409    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq"]
Sep 11 18:29:23.062342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:23.062307    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" path="/var/lib/kubelet/pods/dc5eda62-7825-45fe-a9db-28113d006a0c/volumes"
Sep 11 18:29:25.515323 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:25.515289    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:29:36.594517 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.594480    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"]
Sep 11 18:29:36.595632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.595594    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerName="istio-proxy"
Sep 11 18:29:36.595632 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.595628    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerName="istio-proxy"
Sep 11 18:29:36.595982 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.595965    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc5eda62-7825-45fe-a9db-28113d006a0c" containerName="istio-proxy"
Sep 11 18:29:36.600493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.600472    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:36.604736 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.604710    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:29:36.607813 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.607771    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"]
Sep 11 18:29:36.626919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.626889    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6\" (UID: \"52b3c86b-9847-4781-b49a-e78bf10d79e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:36.728280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.728247    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6\" (UID: \"52b3c86b-9847-4781-b49a-e78bf10d79e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:36.728882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.728862    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6\" (UID: \"52b3c86b-9847-4781-b49a-e78bf10d79e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:36.914425 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:36.914342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:37.225574 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:37.225546    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"]
Sep 11 18:29:37.227595 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:29:37.227567    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b3c86b_9847_4781_b49a_e78bf10d79e1.slice/crio-6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e WatchSource:0}: Error finding container 6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e: Status 404 returned error can't find the container with id 6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e
Sep 11 18:29:37.620016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:37.619980    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6" event={"ID":"52b3c86b-9847-4781-b49a-e78bf10d79e1","Type":"ContainerStarted","Data":"9b07f12c5a68621a9a03fc29f3b5703a012545373687cd560eae0d47a588a6d3"}
Sep 11 18:29:37.620466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:37.620034    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6" event={"ID":"52b3c86b-9847-4781-b49a-e78bf10d79e1","Type":"ContainerStarted","Data":"6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e"}
Sep 11 18:29:37.637419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:37.637364    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6" podStartSLOduration=1.637345348 podStartE2EDuration="1.637345348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:37.635246692 +0000 UTC m=+1155.056021094" watchObservedRunningTime="2026-09-11 18:29:37.637345348 +0000 UTC m=+1155.058119751"
Sep 11 18:29:38.628430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:38.628398    2566 generic.go:356] "Generic (PLEG): container finished" podID="52b3c86b-9847-4781-b49a-e78bf10d79e1" containerID="9b07f12c5a68621a9a03fc29f3b5703a012545373687cd560eae0d47a588a6d3" exitCode=0
Sep 11 18:29:38.628816 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:38.628482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6" event={"ID":"52b3c86b-9847-4781-b49a-e78bf10d79e1","Type":"ContainerDied","Data":"9b07f12c5a68621a9a03fc29f3b5703a012545373687cd560eae0d47a588a6d3"}
Sep 11 18:29:39.796809 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:39.796771    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:39.860484 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:39.860454    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca\") pod \"52b3c86b-9847-4781-b49a-e78bf10d79e1\" (UID: \"52b3c86b-9847-4781-b49a-e78bf10d79e1\") "
Sep 11 18:29:39.860888 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:39.860863    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52b3c86b-9847-4781-b49a-e78bf10d79e1" (UID: "52b3c86b-9847-4781-b49a-e78bf10d79e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:29:39.961861 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:39.961827    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52b3c86b-9847-4781-b49a-e78bf10d79e1-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:29:40.649922 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:40.649887    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"
Sep 11 18:29:40.650079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:40.649919    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6" event={"ID":"52b3c86b-9847-4781-b49a-e78bf10d79e1","Type":"ContainerDied","Data":"6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e"}
Sep 11 18:29:40.650079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:40.649967    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b9ddf2fa6c78546fd08df0bdc5fb50cd58bc6d3f88b97941370d1bff353f11e"
Sep 11 18:29:41.659827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.659780    2566 generic.go:356] "Generic (PLEG): container finished" podID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerID="0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1" exitCode=0
Sep 11 18:29:41.660299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.659856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerDied","Data":"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"}
Sep 11 18:29:41.660299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.660285    2566 scope.go:117] "RemoveContainer" containerID="0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"
Sep 11 18:29:41.661535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.661504    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:41.661620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.661585    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:41.661620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:41.661615    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:42.675351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:42.675311    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerStarted","Data":"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"}
Sep 11 18:29:42.726624 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:42.726588    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:42.727663 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:42.727634    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:29:42.727773 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:42.727693    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 11 18:29:43.451397 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:43.451360    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:43.726956 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:43.726873    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:29:43.726956 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:43.726926    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 11 18:29:44.033953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.033852    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:29:44.035507 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.034938    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b3c86b-9847-4781-b49a-e78bf10d79e1" containerName="revoke-keys"
Sep 11 18:29:44.035858 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.035839    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b3c86b-9847-4781-b49a-e78bf10d79e1" containerName="revoke-keys"
Sep 11 18:29:44.036299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.036282    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b3c86b-9847-4781-b49a-e78bf10d79e1" containerName="revoke-keys"
Sep 11 18:29:44.042079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.042056    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.044448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.044428    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-6c3180-openshift-default-dockercfg-kpkv2\""
Sep 11 18:29:44.085115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.085079    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:29:44.105390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105360    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdgg\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.105915 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.105811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206628 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206628 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdgg\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206646    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.206942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.206781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207112    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207452 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207495    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.207750 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.207729    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.209159 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.209137    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.209415 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.209389    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.215125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.215099    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.215767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.215749    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdgg\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg\") pod \"e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") " pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.375848 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.375712    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:44.668614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.668563    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:29:44.676669 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:29:44.676618    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c54540a_397d_4d3c_80cf_a366568c0307.slice/crio-37453097862f20bb932de6673c7f07ca8627f6020d23e423ef073fe6f5bc4d00 WatchSource:0}: Error finding container 37453097862f20bb932de6673c7f07ca8627f6020d23e423ef073fe6f5bc4d00: Status 404 returned error can't find the container with id 37453097862f20bb932de6673c7f07ca8627f6020d23e423ef073fe6f5bc4d00
Sep 11 18:29:44.679656 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.679624    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:44.679765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.679705    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:44.679765 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.679748    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:29:44.692177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.692113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerStarted","Data":"37453097862f20bb932de6673c7f07ca8627f6020d23e423ef073fe6f5bc4d00"}
Sep 11 18:29:44.727395 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.727354    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:29:44.727853 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:44.727440    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 11 18:29:45.699685 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:45.699611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerStarted","Data":"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"}
Sep 11 18:29:45.724180 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:45.724123    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podStartSLOduration=1.7241075160000001 podStartE2EDuration="1.724107516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:45.721621254 +0000 UTC m=+1163.142395679" watchObservedRunningTime="2026-09-11 18:29:45.724107516 +0000 UTC m=+1163.144881918"
Sep 11 18:29:45.727406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:45.727373    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:29:45.727950 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:45.727920    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 11 18:29:46.377915 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.377870    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:46.381969 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.381943    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:46.707164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.707130    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:46.708142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.708121    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:29:46.726945 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.726903    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:29:46.727123 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:46.726965    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 11 18:29:47.732032 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:47.731998    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:47.733142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:47.733121    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:29:52.036160 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.036117    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"]
Sep 11 18:29:52.041091 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.041066    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f63893-4n9t6"]
Sep 11 18:29:52.066029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.066001    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:29:52.069700 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.069677    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.072047 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.072020    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-6c3180-serving-cert\""
Sep 11 18:29:52.082647 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.082619    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:29:52.186448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.186413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.186448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.186457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.186722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.186563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.186722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.186595    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhqf\" (UniqueName: \"kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.287305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.287218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.287305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.287263    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.287539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.287327    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.287539 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.287351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhqf\" (UniqueName: \"kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.288067 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.288045    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.289607 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.289586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.289757 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.289738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.295498 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.295472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhqf\" (UniqueName: \"kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf\") pod \"maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.382593 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.382564    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:52.660484 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.660455    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:29:52.661663 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:29:52.661636    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969ba387_c49c_4077_9603_25e4747e5984.slice/crio-5c86a058b9f97dd87d95eea7028587396863150073c3d69eccc0306f97314ffe WatchSource:0}: Error finding container 5c86a058b9f97dd87d95eea7028587396863150073c3d69eccc0306f97314ffe: Status 404 returned error can't find the container with id 5c86a058b9f97dd87d95eea7028587396863150073c3d69eccc0306f97314ffe
Sep 11 18:29:52.751344 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:52.751303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" event={"ID":"969ba387-c49c-4077-9603-25e4747e5984","Type":"ContainerStarted","Data":"5c86a058b9f97dd87d95eea7028587396863150073c3d69eccc0306f97314ffe"}
Sep 11 18:29:53.071963 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:53.071923    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b3c86b-9847-4781-b49a-e78bf10d79e1" path="/var/lib/kubelet/pods/52b3c86b-9847-4781-b49a-e78bf10d79e1/volumes"
Sep 11 18:29:53.759029 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:53.758992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" event={"ID":"969ba387-c49c-4077-9603-25e4747e5984","Type":"ContainerStarted","Data":"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"}
Sep 11 18:29:53.759200 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:53.759076    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:29:53.779896 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:53.779850    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" podStartSLOduration=1.441929398 podStartE2EDuration="1.77983316s" totalImagesPullingTime="337.903762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:53.776780399 +0000 UTC m=+1171.197554801" watchObservedRunningTime="2026-09-11 18:29:53.77983316 +0000 UTC m=+1171.200607564"
Sep 11 18:29:59.770506 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:29:59.770471    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:30:00.140782 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.140694    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"]
Sep 11 18:30:00.145150 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.145120    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"]
Sep 11 18:30:00.145286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.145270    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"
Sep 11 18:30:00.147569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.147542    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9kdx\""
Sep 11 18:30:00.148649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.148627    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"
Sep 11 18:30:00.160086 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.159280    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"]
Sep 11 18:30:00.161616 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.161592    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"
Sep 11 18:30:00.162614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.162592    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"]
Sep 11 18:30:00.170407 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.170388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"
Sep 11 18:30:00.451615 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.451588    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"]
Sep 11 18:30:00.452732 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:00.452698    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f4edd1_92c4_49c1_a4ae_3c891e05e4cc.slice/crio-e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2 WatchSource:0}: Error finding container e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2: Status 404 returned error can't find the container with id e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2
Sep 11 18:30:00.468261 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.468232    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"]
Sep 11 18:30:00.471367 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:00.471272    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a59c393_ef72_408b_bfa7_4ba685118566.slice/crio-a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a WatchSource:0}: Error finding container a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a: Status 404 returned error can't find the container with id a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a
Sep 11 18:30:00.811088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.811052    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759" event={"ID":"9a59c393-ef72-408b-bfa7-4ba685118566","Type":"ContainerStarted","Data":"a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a"}
Sep 11 18:30:00.812563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.812536    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x" event={"ID":"b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc","Type":"ContainerStarted","Data":"d03e7e53c5d9d9b7407101d46d42aba7fe713dc19ea81149c6539c99092db340"}
Sep 11 18:30:00.812686 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.812577    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x" event={"ID":"b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc","Type":"ContainerStarted","Data":"e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2"}
Sep 11 18:30:00.838069 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.838012    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x" podStartSLOduration=0.837997041 podStartE2EDuration="837.997041ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:00.83661078 +0000 UTC m=+1178.257385183" watchObservedRunningTime="2026-09-11 18:30:00.837997041 +0000 UTC m=+1178.258771442"
Sep 11 18:30:00.880883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.880856    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"]
Sep 11 18:30:00.884520 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.884501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:00.892743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.892620    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"]
Sep 11 18:30:00.977164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:00.977131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12eb53-nm942\" (UID: \"c82d2dde-a5a0-4797-9c32-811b041c5686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:01.078250 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.078165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12eb53-nm942\" (UID: \"c82d2dde-a5a0-4797-9c32-811b041c5686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:01.078835 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.078816    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12eb53-nm942\" (UID: \"c82d2dde-a5a0-4797-9c32-811b041c5686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:01.197730 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.197698    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:01.471590 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.471561    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"]
Sep 11 18:30:01.516850 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:01.516777    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82d2dde_a5a0_4797_9c32_811b041c5686.slice/crio-88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf WatchSource:0}: Error finding container 88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf: Status 404 returned error can't find the container with id 88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf
Sep 11 18:30:01.820513 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.820479    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc" containerID="d03e7e53c5d9d9b7407101d46d42aba7fe713dc19ea81149c6539c99092db340" exitCode=0
Sep 11 18:30:01.821030 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.820571    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x" event={"ID":"b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc","Type":"ContainerDied","Data":"d03e7e53c5d9d9b7407101d46d42aba7fe713dc19ea81149c6539c99092db340"}
Sep 11 18:30:01.821933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.821890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942" event={"ID":"c82d2dde-a5a0-4797-9c32-811b041c5686","Type":"ContainerStarted","Data":"88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf"}
Sep 11 18:30:01.823267 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.823246    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a59c393-ef72-408b-bfa7-4ba685118566" containerID="487ea14af9b61bcffc8f16f34d6862460d02911c3525b7e442180ed0ce1879fb" exitCode=0
Sep 11 18:30:01.823351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:01.823308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759" event={"ID":"9a59c393-ef72-408b-bfa7-4ba685118566","Type":"ContainerDied","Data":"487ea14af9b61bcffc8f16f34d6862460d02911c3525b7e442180ed0ce1879fb"}
Sep 11 18:30:02.830834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:02.830779    2566 generic.go:356] "Generic (PLEG): container finished" podID="c82d2dde-a5a0-4797-9c32-811b041c5686" containerID="11fcd73edb407c792d29ae97569ca1cbccb55375cf60de7413967ae9b8922552" exitCode=0
Sep 11 18:30:02.831311 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:02.830878    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942" event={"ID":"c82d2dde-a5a0-4797-9c32-811b041c5686","Type":"ContainerDied","Data":"11fcd73edb407c792d29ae97569ca1cbccb55375cf60de7413967ae9b8922552"}
Sep 11 18:30:02.969487 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:02.969462    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"
Sep 11 18:30:03.001172 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.001141    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"
Sep 11 18:30:03.839630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.839598    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"
Sep 11 18:30:03.840061 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.839630    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759" event={"ID":"9a59c393-ef72-408b-bfa7-4ba685118566","Type":"ContainerDied","Data":"a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a"}
Sep 11 18:30:03.840061 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.839681    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a96e976b2c4f0be4e13a5407afd8269b3d1ee0fb0a2c7e59b3f5a52e6123775a"
Sep 11 18:30:03.841434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.841409    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"
Sep 11 18:30:03.841434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.841414    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x" event={"ID":"b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc","Type":"ContainerDied","Data":"e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2"}
Sep 11 18:30:03.841627 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.841459    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e68852e1067a0e98b8991743dcbb430cfe4a90d5a65bc331188031e128c11fc2"
Sep 11 18:30:03.982983 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:03.982957    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:04.111598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.111513    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca\") pod \"c82d2dde-a5a0-4797-9c32-811b041c5686\" (UID: \"c82d2dde-a5a0-4797-9c32-811b041c5686\") "
Sep 11 18:30:04.111923 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.111902    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c82d2dde-a5a0-4797-9c32-811b041c5686" (UID: "c82d2dde-a5a0-4797-9c32-811b041c5686"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:30:04.213434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.213398    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82d2dde-a5a0-4797-9c32-811b041c5686-maas-api-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:04.848918 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.848878    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"
Sep 11 18:30:04.849299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.848931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942" event={"ID":"c82d2dde-a5a0-4797-9c32-811b041c5686","Type":"ContainerDied","Data":"88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf"}
Sep 11 18:30:04.849299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:04.848993    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88af3aa701ff7379b59ca3908a08ec004507b305c1c3173188e8e3bcf2b708bf"
Sep 11 18:30:11.613942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:11.613892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"]
Sep 11 18:30:11.616623 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:11.616598    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12eb53-29819190-g9759"]
Sep 11 18:30:11.801203 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:11.801138    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"]
Sep 11 18:30:11.803925 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:11.803903    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12eb53-nm942"]
Sep 11 18:30:13.069257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.069223    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a59c393-ef72-408b-bfa7-4ba685118566" path="/var/lib/kubelet/pods/9a59c393-ef72-408b-bfa7-4ba685118566/volumes"
Sep 11 18:30:13.069634 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.069538    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82d2dde-a5a0-4797-9c32-811b041c5686" path="/var/lib/kubelet/pods/c82d2dde-a5a0-4797-9c32-811b041c5686/volumes"
Sep 11 18:30:13.932110 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.932077    2566 generic.go:356] "Generic (PLEG): container finished" podID="5c54540a-397d-4d3c-80cf-a366568c0307" containerID="176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070" exitCode=0
Sep 11 18:30:13.932352 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.932150    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerDied","Data":"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"}
Sep 11 18:30:13.932558 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.932543    2566 scope.go:117] "RemoveContainer" containerID="176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"
Sep 11 18:30:13.933654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.933625    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:30:13.933708 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.933692    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:30:13.933742 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:13.933726    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:30:14.940369 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:14.940337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerStarted","Data":"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"}
Sep 11 18:30:15.376293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:15.376192    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:30:15.377155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:15.377125    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:30:15.377344 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:15.377320    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 18:30:16.376992 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:16.376951    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:30:16.377468 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:16.377031    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 18:30:16.707911 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:16.707875    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:30:17.376721 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:17.376679    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:30:17.376967 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:17.376750    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 18:30:18.376779 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:18.376736    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:30:18.377233 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:18.376849    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 18:30:18.814778 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:18.814743    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:30:18.815049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:18.815012    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" containerID="cri-o://8ab6810bf8b75606bb9bb4725d6a751812718b41cdd5d3f4c12fdfb40cb82461" gracePeriod=30
Sep 11 18:30:19.377812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:19.377069    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 18:30:19.377812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:19.377138    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 18:30:20.312148 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:20.312111    2566 patch_prober.go:28] interesting pod/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:30:20.312348 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:20.312180    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:30:20.380964 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:20.380933    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:30:20.381978 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:20.381960    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:30:23.093466 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:23.093439    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:30:23.098506 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:23.098479    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:30:23.191105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:23.191073    2566 scope.go:117] "RemoveContainer" containerID="1735bc64eb304a73b6d3eacf915528021d2dfeaebf87a23a8e6ae4e453b50062"
Sep 11 18:30:24.021135 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.021101    2566 generic.go:356] "Generic (PLEG): container finished" podID="5885e866-7bfd-47fc-b2be-a1560665708a" containerID="8ab6810bf8b75606bb9bb4725d6a751812718b41cdd5d3f4c12fdfb40cb82461" exitCode=0
Sep 11 18:30:24.021287 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.021267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerDied","Data":"8ab6810bf8b75606bb9bb4725d6a751812718b41cdd5d3f4c12fdfb40cb82461"}
Sep 11 18:30:24.021365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.021342    2566 scope.go:117] "RemoveContainer" containerID="2c0b3f6e4714e8e8faeaaac8158f7e8f8622f4f82a2d07a31768175aabf809d3"
Sep 11 18:30:24.073916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.073883    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:30:24.079969 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.079817    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:30:24.080679 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080659    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc" containerName="cleanup"
Sep 11 18:30:24.080679 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080680    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc" containerName="cleanup"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080702    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080711    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080749    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080757    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080769    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a59c393-ef72-408b-bfa7-4ba685118566" containerName="cleanup"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080776    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a59c393-ef72-408b-bfa7-4ba685118566" containerName="cleanup"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080817    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82d2dde-a5a0-4797-9c32-811b041c5686" containerName="revoke-keys"
Sep 11 18:30:24.080870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080850    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82d2dde-a5a0-4797-9c32-811b041c5686" containerName="revoke-keys"
Sep 11 18:30:24.081253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080973    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82d2dde-a5a0-4797-9c32-811b041c5686" containerName="revoke-keys"
Sep 11 18:30:24.081253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080986    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc" containerName="cleanup"
Sep 11 18:30:24.081253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.080998    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.081253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.081007    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a59c393-ef72-408b-bfa7-4ba685118566" containerName="cleanup"
Sep 11 18:30:24.081253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.081018    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" containerName="istio-proxy"
Sep 11 18:30:24.083994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.083973    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.086097 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.086077    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3e24a782-serving-cert\""
Sep 11 18:30:24.100623 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.100600    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:30:24.135339 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135311    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl4df\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135361    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135382    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135400    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135417    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135479 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135466    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135553    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135593    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy\") pod \"5885e866-7bfd-47fc-b2be-a1560665708a\" (UID: \"5885e866-7bfd-47fc-b2be-a1560665708a\") "
Sep 11 18:30:24.135748 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135669    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:24.136015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135768    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:24.136015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135810    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:24.136015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135877    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:30:24.136015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.135983    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data" (OuterVolumeSpecName: "istio-data") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:24.136192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.136192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.136304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wblsc\" (UniqueName: \"kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.136304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.136414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136327    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.136414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136344    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.136414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136357    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.136414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136369    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5885e866-7bfd-47fc-b2be-a1560665708a-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.136414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.136382    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.137698 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.137668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:24.137840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.137723    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df" (OuterVolumeSpecName: "kube-api-access-rl4df") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "kube-api-access-rl4df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:24.137840 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.137754    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:24.138000 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.137980    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5885e866-7bfd-47fc-b2be-a1560665708a" (UID: "5885e866-7bfd-47fc-b2be-a1560665708a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:30:24.237717 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.237673    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.237717 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.237721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.238010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.237853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wblsc\" (UniqueName: \"kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.238010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.237904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.238010 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:24.237859    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-serving-cert: secret "maas-api-e2e-mt-3e24a782-serving-cert" not found
Sep 11 18:30:24.238010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.237994    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5885e866-7bfd-47fc-b2be-a1560665708a-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.238010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.238005    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl4df\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-kube-api-access-rl4df\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.238227 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:24.238019    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls podName:68464490-4166-4a97-a581-6983b44aa4d9 nodeName:}" failed. No retries permitted until 2026-09-11 18:30:24.738001426 +0000 UTC m=+1202.158775812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls") pod "maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" (UID: "68464490-4166-4a97-a581-6983b44aa4d9") : secret "maas-api-e2e-mt-3e24a782-serving-cert" not found
Sep 11 18:30:24.238227 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.238041    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5885e866-7bfd-47fc-b2be-a1560665708a-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.238227 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.238057    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5885e866-7bfd-47fc-b2be-a1560665708a-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:30:24.238342 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.238321    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.240230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.240214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.247182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.247157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wblsc\" (UniqueName: \"kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.742902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.742861    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.745207 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.745174    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") pod \"maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:24.996012 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:24.995913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:25.029248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.029220    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"
Sep 11 18:30:25.029427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.029257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff" event={"ID":"5885e866-7bfd-47fc-b2be-a1560665708a","Type":"ContainerDied","Data":"3d874132d0c6fa78a03aff20057805f0466f7969244e755d1afc235047d40f3d"}
Sep 11 18:30:25.029427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.029318    2566 scope.go:117] "RemoveContainer" containerID="8ab6810bf8b75606bb9bb4725d6a751812718b41cdd5d3f4c12fdfb40cb82461"
Sep 11 18:30:25.056341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.056304    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:30:25.069159 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.069132    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff"]
Sep 11 18:30:25.282411 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.282377    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:30:25.284806 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:25.284743    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68464490_4166_4a97_a581_6983b44aa4d9.slice/crio-a0fb66a2c27caaf0bcf5a92f9c6bc1d10d1addc1a6037830d6887897cadfbdc3 WatchSource:0}: Error finding container a0fb66a2c27caaf0bcf5a92f9c6bc1d10d1addc1a6037830d6887897cadfbdc3: Status 404 returned error can't find the container with id a0fb66a2c27caaf0bcf5a92f9c6bc1d10d1addc1a6037830d6887897cadfbdc3
Sep 11 18:30:25.293228 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.293200    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:30:25.297666 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.297646    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.299882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.299848    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-bf9898-serving-cert\""
Sep 11 18:30:25.311183 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.311157    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:30:25.349496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.349451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.349496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.349500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.349841 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.349816    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.349937 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.349855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnhf2\" (UniqueName: \"kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.450759 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.450721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.450933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.450775    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnhf2\" (UniqueName: \"kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.450933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.450852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.450933 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.450882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.451122 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:25.451064    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-serving-cert: secret "maas-api-e2e-shared-a-w3-bf9898-serving-cert" not found
Sep 11 18:30:25.451372 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:25.451350    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls podName:3b624a9f-4388-491f-bec9-992c39206e76 nodeName:}" failed. No retries permitted until 2026-09-11 18:30:25.951326272 +0000 UTC m=+1203.372100672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls") pod "maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" (UID: "3b624a9f-4388-491f-bec9-992c39206e76") : secret "maas-api-e2e-shared-a-w3-bf9898-serving-cert" not found
Sep 11 18:30:25.451589 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.451564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.453989 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.453964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.459587 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.459557    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnhf2\" (UniqueName: \"kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.957393 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.957135    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:25.959768 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:25.959742    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:26.052670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:26.049473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" event={"ID":"68464490-4166-4a97-a581-6983b44aa4d9","Type":"ContainerStarted","Data":"a0fb66a2c27caaf0bcf5a92f9c6bc1d10d1addc1a6037830d6887897cadfbdc3"}
Sep 11 18:30:26.214056 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:26.213968    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:26.495591 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:26.495566    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:30:26.497434 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:26.497410    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b624a9f_4388_491f_bec9_992c39206e76.slice/crio-ea601cf7fc5c36b621208fa346f1c5747cb81f688e6c911e1398e22b45582334 WatchSource:0}: Error finding container ea601cf7fc5c36b621208fa346f1c5747cb81f688e6c911e1398e22b45582334: Status 404 returned error can't find the container with id ea601cf7fc5c36b621208fa346f1c5747cb81f688e6c911e1398e22b45582334
Sep 11 18:30:27.063074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063041    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5885e866-7bfd-47fc-b2be-a1560665708a" path="/var/lib/kubelet/pods/5885e866-7bfd-47fc-b2be-a1560665708a/volumes"
Sep 11 18:30:27.063394 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063372    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" event={"ID":"68464490-4166-4a97-a581-6983b44aa4d9","Type":"ContainerStarted","Data":"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"}
Sep 11 18:30:27.063493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063420    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:27.063493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063436    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" event={"ID":"3b624a9f-4388-491f-bec9-992c39206e76","Type":"ContainerStarted","Data":"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"}
Sep 11 18:30:27.063493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063453    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:27.063493 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.063466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" event={"ID":"3b624a9f-4388-491f-bec9-992c39206e76","Type":"ContainerStarted","Data":"ea601cf7fc5c36b621208fa346f1c5747cb81f688e6c911e1398e22b45582334"}
Sep 11 18:30:27.084002 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.083951    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" podStartSLOduration=2.388044098 podStartE2EDuration="3.083933559s" totalImagesPullingTime="695.889461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:27.081730063 +0000 UTC m=+1204.502504467" watchObservedRunningTime="2026-09-11 18:30:27.083933559 +0000 UTC m=+1204.504707963"
Sep 11 18:30:27.103022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:27.102925    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" podStartSLOduration=1.758022346 podStartE2EDuration="2.102905906s" totalImagesPullingTime="344.88356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:27.102126124 +0000 UTC m=+1204.522900541" watchObservedRunningTime="2026-09-11 18:30:27.102905906 +0000 UTC m=+1204.523680309"
Sep 11 18:30:33.076298 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:33.076265    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:30:33.076732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:33.076591    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:30:54.881373 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.881331    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:30:54.885287 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.885266    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:54.887341 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.887318    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-5faf38-serving-cert\""
Sep 11 18:30:54.895324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.895301    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:30:54.953009 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.952978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:54.953256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.953115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:54.953256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.953174    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr77z\" (UniqueName: \"kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:54.953256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:54.953201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.054067 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.054029    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.054272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.054137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.054272 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:55.054194    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-serving-cert: secret "maas-api-e2e-shared-b-w3-5faf38-serving-cert" not found
Sep 11 18:30:55.054272 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:55.054269    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls podName:dd40156b-7f44-44d1-ac0a-8971ab50934b nodeName:}" failed. No retries permitted until 2026-09-11 18:30:55.554252029 +0000 UTC m=+1232.975026410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls") pod "maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b") : secret "maas-api-e2e-shared-b-w3-5faf38-serving-cert" not found
Sep 11 18:30:55.054461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.054197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr77z\" (UniqueName: \"kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.054461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.054332    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.054987 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.054961    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.056821 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.056769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.064018 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.063996    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr77z\" (UniqueName: \"kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.558730 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:55.558691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:55.558953 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:55.558871    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-serving-cert: secret "maas-api-e2e-shared-b-w3-5faf38-serving-cert" not found
Sep 11 18:30:55.558953 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:30:55.558950    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls podName:dd40156b-7f44-44d1-ac0a-8971ab50934b nodeName:}" failed. No retries permitted until 2026-09-11 18:30:56.558930255 +0000 UTC m=+1233.979704642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls") pod "maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b") : secret "maas-api-e2e-shared-b-w3-5faf38-serving-cert" not found
Sep 11 18:30:56.568420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:56.568380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:56.571770 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:56.571737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:56.697229 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:56.697190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:56.976842 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:56.976811    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:30:56.978002 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:30:56.977969    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd40156b_7f44_44d1_ac0a_8971ab50934b.slice/crio-0e8c067e5751104fab3789db45ee724a4c4badf7c0e162f50199948f0faf872f WatchSource:0}: Error finding container 0e8c067e5751104fab3789db45ee724a4c4badf7c0e162f50199948f0faf872f: Status 404 returned error can't find the container with id 0e8c067e5751104fab3789db45ee724a4c4badf7c0e162f50199948f0faf872f
Sep 11 18:30:56.979509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:56.979490    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:30:57.259119 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:57.259029    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" event={"ID":"dd40156b-7f44-44d1-ac0a-8971ab50934b","Type":"ContainerStarted","Data":"0e8c067e5751104fab3789db45ee724a4c4badf7c0e162f50199948f0faf872f"}
Sep 11 18:30:58.271219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:58.271176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" event={"ID":"dd40156b-7f44-44d1-ac0a-8971ab50934b","Type":"ContainerStarted","Data":"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"}
Sep 11 18:30:58.272394 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:58.272370    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:30:58.293904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:30:58.293853    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" podStartSLOduration=3.964281929 podStartE2EDuration="4.293837913s" totalImagesPullingTime="329.555984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:58.291118841 +0000 UTC m=+1235.711893243" watchObservedRunningTime="2026-09-11 18:30:58.293837913 +0000 UTC m=+1235.714612316"
Sep 11 18:31:04.283217 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:31:04.283187    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:31:23.217559 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:31:23.217484    2566 scope.go:117] "RemoveContainer" containerID="8bfa23ed5996770063a51c767acccc059ab277be5041c3ff8bb70d7876968e22"
Sep 11 18:32:23.247805 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:32:23.247762    2566 scope.go:117] "RemoveContainer" containerID="8e879223c88d06c86d64abcdc6950431bade13a7664ca984df47444b543db5cd"
Sep 11 18:32:23.256823 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:32:23.256777    2566 scope.go:117] "RemoveContainer" containerID="d88a4a03a1e63e5f083d0c88ebc97d18fce9757eef1d8ed6e756e323f5031262"
Sep 11 18:33:07.489330 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.489291    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:33:07.489866 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.489531    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" podUID="68464490-4166-4a97-a581-6983b44aa4d9" containerName="maas-api" containerID="cri-o://44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533" gracePeriod=30
Sep 11 18:33:07.752973 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.752907    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:33:07.937427 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.937384    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs\") pod \"68464490-4166-4a97-a581-6983b44aa4d9\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") "
Sep 11 18:33:07.937630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.937457    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") pod \"68464490-4166-4a97-a581-6983b44aa4d9\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") "
Sep 11 18:33:07.937630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.937595    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca\") pod \"68464490-4166-4a97-a581-6983b44aa4d9\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") "
Sep 11 18:33:07.937630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.937626    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wblsc\" (UniqueName: \"kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc\") pod \"68464490-4166-4a97-a581-6983b44aa4d9\" (UID: \"68464490-4166-4a97-a581-6983b44aa4d9\") "
Sep 11 18:33:07.938021 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.937919    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68464490-4166-4a97-a581-6983b44aa4d9" (UID: "68464490-4166-4a97-a581-6983b44aa4d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:33:07.938165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.938064    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68464490-4166-4a97-a581-6983b44aa4d9-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:33:07.939812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.939771    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68464490-4166-4a97-a581-6983b44aa4d9" (UID: "68464490-4166-4a97-a581-6983b44aa4d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:33:07.939812 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.939777    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc" (OuterVolumeSpecName: "kube-api-access-wblsc") pod "68464490-4166-4a97-a581-6983b44aa4d9" (UID: "68464490-4166-4a97-a581-6983b44aa4d9"). InnerVolumeSpecName "kube-api-access-wblsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:33:07.939954 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:07.939871    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "68464490-4166-4a97-a581-6983b44aa4d9" (UID: "68464490-4166-4a97-a581-6983b44aa4d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:33:08.039654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.039568    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wblsc\" (UniqueName: \"kubernetes.io/projected/68464490-4166-4a97-a581-6983b44aa4d9-kube-api-access-wblsc\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:33:08.039654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.039598    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:33:08.039654 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.039609    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68464490-4166-4a97-a581-6983b44aa4d9-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:33:08.128881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.128838    2566 generic.go:356] "Generic (PLEG): container finished" podID="68464490-4166-4a97-a581-6983b44aa4d9" containerID="44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533" exitCode=0
Sep 11 18:33:08.129063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.128892    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"
Sep 11 18:33:08.129063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.128896    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" event={"ID":"68464490-4166-4a97-a581-6983b44aa4d9","Type":"ContainerDied","Data":"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"}
Sep 11 18:33:08.129063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.128955    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96" event={"ID":"68464490-4166-4a97-a581-6983b44aa4d9","Type":"ContainerDied","Data":"a0fb66a2c27caaf0bcf5a92f9c6bc1d10d1addc1a6037830d6887897cadfbdc3"}
Sep 11 18:33:08.129063 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.128986    2566 scope.go:117] "RemoveContainer" containerID="44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"
Sep 11 18:33:08.139659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.139638    2566 scope.go:117] "RemoveContainer" containerID="44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"
Sep 11 18:33:08.139986 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:33:08.139956    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533\": container with ID starting with 44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533 not found: ID does not exist" containerID="44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"
Sep 11 18:33:08.140104 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.139997    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533"} err="failed to get container status \"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533\": rpc error: code = NotFound desc = could not find container \"44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533\": container with ID starting with 44d18b757b36f208b22e085bc4b468f4cf0a937657ef5087044cb767ca950533 not found: ID does not exist"
Sep 11 18:33:08.154512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.154485    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:33:08.161109 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:08.161083    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3e24a782-75b6d875c5-ggq96"]
Sep 11 18:33:09.062777 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:33:09.062740    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68464490-4166-4a97-a581-6983b44aa4d9" path="/var/lib/kubelet/pods/68464490-4166-4a97-a581-6983b44aa4d9/volumes"
Sep 11 18:34:23.297962 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:34:23.297886    2566 scope.go:117] "RemoveContainer" containerID="10f598b7c50ad9583ffbeef5dd2d628f882df57676cc0b73896f0d14388affee"
Sep 11 18:35:10.361065 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.361031    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:35:10.361629 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.361500    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68464490-4166-4a97-a581-6983b44aa4d9" containerName="maas-api"
Sep 11 18:35:10.361629 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.361512    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68464490-4166-4a97-a581-6983b44aa4d9" containerName="maas-api"
Sep 11 18:35:10.361629 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.361591    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="68464490-4166-4a97-a581-6983b44aa4d9" containerName="maas-api"
Sep 11 18:35:10.365851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.365826    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.367949 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.367926    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1e370a-serving-cert\""
Sep 11 18:35:10.377603 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.377577    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:35:10.476458 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.476330    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.476458 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.476410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.476728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.476536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhkz\" (UniqueName: \"kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.476728 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.476574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.577315 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.577275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhkz\" (UniqueName: \"kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.577512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.577326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.577512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.577384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.577512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.577424    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.577745 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:35:10.577573    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-serving-cert: secret "maas-api-e2e-api-a-1e370a-serving-cert" not found
Sep 11 18:35:10.577745 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:35:10.577656    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls podName:c693f990-8df0-4d2e-a1ed-9d43d168c5b3 nodeName:}" failed. No retries permitted until 2026-09-11 18:35:11.077631963 +0000 UTC m=+1488.498406348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls") pod "maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" (UID: "c693f990-8df0-4d2e-a1ed-9d43d168c5b3") : secret "maas-api-e2e-api-a-1e370a-serving-cert" not found
Sep 11 18:35:10.578083 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.578063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.579668 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.579647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:10.588163 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:10.588141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhkz\" (UniqueName: \"kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:11.084174 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:11.084138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:11.091081 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:11.091050    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") pod \"maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:11.277446 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:11.277414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:11.552291 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:11.552258    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:35:11.554306 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:35:11.554280    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc693f990_8df0_4d2e_a1ed_9d43d168c5b3.slice/crio-b845a48c5dd5b598a69027c10b3dd1ef9ad1680ef3ef7cb10e5e9e9ebf1e6665 WatchSource:0}: Error finding container b845a48c5dd5b598a69027c10b3dd1ef9ad1680ef3ef7cb10e5e9e9ebf1e6665: Status 404 returned error can't find the container with id b845a48c5dd5b598a69027c10b3dd1ef9ad1680ef3ef7cb10e5e9e9ebf1e6665
Sep 11 18:35:11.926497 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:11.926466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" event={"ID":"c693f990-8df0-4d2e-a1ed-9d43d168c5b3","Type":"ContainerStarted","Data":"b845a48c5dd5b598a69027c10b3dd1ef9ad1680ef3ef7cb10e5e9e9ebf1e6665"}
Sep 11 18:35:12.935185 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:12.935142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" event={"ID":"c693f990-8df0-4d2e-a1ed-9d43d168c5b3","Type":"ContainerStarted","Data":"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"}
Sep 11 18:35:12.935563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:12.935211    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:12.956058 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:12.955995    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" podStartSLOduration=2.369711786 podStartE2EDuration="2.955974205s" totalImagesPullingTime="586.262419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:35:12.952547097 +0000 UTC m=+1490.373321498" watchObservedRunningTime="2026-09-11 18:35:12.955974205 +0000 UTC m=+1490.376748609"
Sep 11 18:35:18.947225 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:18.947195    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:35:23.139535 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:23.139508    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:35:23.145814 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:23.145769    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:35:23.321667 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:23.321610    2566 scope.go:117] "RemoveContainer" containerID="20942d61f57c7c586654deb2ef899f3f1416a007321a8a0bf745a3abf17c301b"
Sep 11 18:35:31.479211 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:31.479179    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:35:31.479638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:31.479390    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" containerID="cri-o://0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c" gracePeriod=30
Sep 11 18:35:36.627951 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.627911    2566 patch_prober.go:28] interesting pod/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 11 18:35:36.628392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.627979    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 11 18:35:36.731164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.731137    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:35:36.856215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856121    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856164    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856292    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856323    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856389    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w8rb\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856431    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856476    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856532    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856578    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket\") pod \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\" (UID: \"f7f13dad-54f6-4150-b14e-58e2ebab4b8d\") "
Sep 11 18:35:36.856665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856589    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:36.856665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856647    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:35:36.856997 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856977    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.857053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856996    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.857053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.856974    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:36.857157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.857051    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:36.857157 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.857144    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:36.858677 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.858651    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:36.858870 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.858847    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:35:36.858935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.858867    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:36.858977 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.858931    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb" (OuterVolumeSpecName: "kube-api-access-7w8rb") pod "f7f13dad-54f6-4150-b14e-58e2ebab4b8d" (UID: "f7f13dad-54f6-4150-b14e-58e2ebab4b8d"). InnerVolumeSpecName "kube-api-access-7w8rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:36.958583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958548    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958577    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958588    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w8rb\" (UniqueName: \"kubernetes.io/projected/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-kube-api-access-7w8rb\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958603    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958612    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958621    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:36.958829 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:36.958640    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f13dad-54f6-4150-b14e-58e2ebab4b8d-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:35:37.094500 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.094464    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerID="0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c" exitCode=0
Sep 11 18:35:37.094664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.094533    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"
Sep 11 18:35:37.094664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.094551    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerDied","Data":"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"}
Sep 11 18:35:37.094664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.094607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd" event={"ID":"f7f13dad-54f6-4150-b14e-58e2ebab4b8d","Type":"ContainerDied","Data":"e41340813463382752858a8b02ecf65d9c956903bd6837be7e4e4159b4a5a31f"}
Sep 11 18:35:37.094664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.094629    2566 scope.go:117] "RemoveContainer" containerID="0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"
Sep 11 18:35:37.104513 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.104492    2566 scope.go:117] "RemoveContainer" containerID="63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"
Sep 11 18:35:37.110542 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.110490    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:35:37.113935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.113914    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd"]
Sep 11 18:35:37.114013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.113938    2566 scope.go:117] "RemoveContainer" containerID="0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"
Sep 11 18:35:37.114242 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:35:37.114226    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c\": container with ID starting with 0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c not found: ID does not exist" containerID="0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"
Sep 11 18:35:37.114296 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.114249    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c"} err="failed to get container status \"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c\": rpc error: code = NotFound desc = could not find container \"0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c\": container with ID starting with 0a67f2e4d9be6a93b6db39b5b0735c2907e5bd6b158ee4494d541f9adc1b272c not found: ID does not exist"
Sep 11 18:35:37.114296 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.114265    2566 scope.go:117] "RemoveContainer" containerID="63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"
Sep 11 18:35:37.114503 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:35:37.114484    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff\": container with ID starting with 63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff not found: ID does not exist" containerID="63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"
Sep 11 18:35:37.114546 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:37.114516    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff"} err="failed to get container status \"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff\": rpc error: code = NotFound desc = could not find container \"63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff\": container with ID starting with 63dcdc536b0da1bc56edcb822549aefb2496ae3508923083dbec86c63079edff not found: ID does not exist"
Sep 11 18:35:39.061758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:35:39.061723    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" path="/var/lib/kubelet/pods/f7f13dad-54f6-4150-b14e-58e2ebab4b8d/volumes"
Sep 11 18:36:23.096447 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.096414    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:36:23.097257 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.097191    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" podUID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" containerName="maas-api" containerID="cri-o://6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c" gracePeriod=30
Sep 11 18:36:23.347486 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.347412    2566 scope.go:117] "RemoveContainer" containerID="11fcd73edb407c792d29ae97569ca1cbccb55375cf60de7413967ae9b8922552"
Sep 11 18:36:23.353559 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.353530    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:36:23.358258 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.358237    2566 scope.go:117] "RemoveContainer" containerID="487ea14af9b61bcffc8f16f34d6862460d02911c3525b7e442180ed0ce1879fb"
Sep 11 18:36:23.366390 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.366370    2566 scope.go:117] "RemoveContainer" containerID="9b07f12c5a68621a9a03fc29f3b5703a012545373687cd560eae0d47a588a6d3"
Sep 11 18:36:23.402303 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.402275    2566 generic.go:356] "Generic (PLEG): container finished" podID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" containerID="6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c" exitCode=0
Sep 11 18:36:23.402404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.402333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" event={"ID":"c693f990-8df0-4d2e-a1ed-9d43d168c5b3","Type":"ContainerDied","Data":"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"}
Sep 11 18:36:23.402404 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.402353    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"
Sep 11 18:36:23.402515 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.402410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc" event={"ID":"c693f990-8df0-4d2e-a1ed-9d43d168c5b3","Type":"ContainerDied","Data":"b845a48c5dd5b598a69027c10b3dd1ef9ad1680ef3ef7cb10e5e9e9ebf1e6665"}
Sep 11 18:36:23.402515 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.402435    2566 scope.go:117] "RemoveContainer" containerID="6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"
Sep 11 18:36:23.403991 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:23.403965    2566 kuberuntime_gc.go:392] "Failed to remove container log dead symlink" err="remove /var/log/containers/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc_odh-ai-gateway-infra_maas-api-6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c.log: no such file or directory" path="/var/log/containers/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc_odh-ai-gateway-infra_maas-api-6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c.log"
Sep 11 18:36:23.411430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.411413    2566 scope.go:117] "RemoveContainer" containerID="6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"
Sep 11 18:36:23.411752 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:23.411732    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c\": container with ID starting with 6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c not found: ID does not exist" containerID="6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"
Sep 11 18:36:23.411841 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.411763    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c"} err="failed to get container status \"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c\": rpc error: code = NotFound desc = could not find container \"6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c\": container with ID starting with 6db89a681ce950bd53ea0ac5a344308fd9f86bcf19b6b3778195c2194a71421c not found: ID does not exist"
Sep 11 18:36:23.438512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.438479    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmhkz\" (UniqueName: \"kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz\") pod \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") "
Sep 11 18:36:23.438512 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.438514    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") pod \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") "
Sep 11 18:36:23.438707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.438578    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca\") pod \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") "
Sep 11 18:36:23.438707 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.438618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs\") pod \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\" (UID: \"c693f990-8df0-4d2e-a1ed-9d43d168c5b3\") "
Sep 11 18:36:23.438996 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.438971    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c693f990-8df0-4d2e-a1ed-9d43d168c5b3" (UID: "c693f990-8df0-4d2e-a1ed-9d43d168c5b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:36:23.440861 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.440832    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz" (OuterVolumeSpecName: "kube-api-access-jmhkz") pod "c693f990-8df0-4d2e-a1ed-9d43d168c5b3" (UID: "c693f990-8df0-4d2e-a1ed-9d43d168c5b3"). InnerVolumeSpecName "kube-api-access-jmhkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:23.441014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.440980    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c693f990-8df0-4d2e-a1ed-9d43d168c5b3" (UID: "c693f990-8df0-4d2e-a1ed-9d43d168c5b3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:36:23.441098 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.441059    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c693f990-8df0-4d2e-a1ed-9d43d168c5b3" (UID: "c693f990-8df0-4d2e-a1ed-9d43d168c5b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:36:23.540349 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.540315    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:23.540349 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.540345    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:23.540349 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.540354    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:23.540598 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.540363    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmhkz\" (UniqueName: \"kubernetes.io/projected/c693f990-8df0-4d2e-a1ed-9d43d168c5b3-kube-api-access-jmhkz\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:23.724724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.724694    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:36:23.728002 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:23.727977    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e370a-597b5dc6dc-flghc"]
Sep 11 18:36:25.061383 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:25.061351    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" path="/var/lib/kubelet/pods/c693f990-8df0-4d2e-a1ed-9d43d168c5b3/volumes"
Sep 11 18:36:48.858594 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.858554    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7842-7cc54a"]
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859008    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859020    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859030    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" containerName="maas-api"
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859036    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" containerName="maas-api"
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859045    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:36:48.859108 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859051    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:36:48.859324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859128    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:36:48.859324 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.859137    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c693f990-8df0-4d2e-a1ed-9d43d168c5b3" containerName="maas-api"
Sep 11 18:36:48.862495 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.862478    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:48.864973 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.864946    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fz6cx\""
Sep 11 18:36:48.869074 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.869046    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7842-7cc54a"]
Sep 11 18:36:48.889878 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.889849    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv6ll\" (UniqueName: \"kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll\") pod \"test-curl-7842-7cc54a\" (UID: \"fd6c175b-5da7-4a15-be3f-72436bea6d99\") " pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:48.991218 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:48.991181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv6ll\" (UniqueName: \"kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll\") pod \"test-curl-7842-7cc54a\" (UID: \"fd6c175b-5da7-4a15-be3f-72436bea6d99\") " pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:49.000392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:49.000359    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv6ll\" (UniqueName: \"kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll\") pod \"test-curl-7842-7cc54a\" (UID: \"fd6c175b-5da7-4a15-be3f-72436bea6d99\") " pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:49.173579 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:49.173555    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:49.447998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:49.447962    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7842-7cc54a"]
Sep 11 18:36:49.450015 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:36:49.449987    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd6c175b_5da7_4a15_be3f_72436bea6d99.slice/crio-dbcda157392dc40d3cfd3be044415ba610ec67a5e9588d2261e9579161c4e1fa WatchSource:0}: Error finding container dbcda157392dc40d3cfd3be044415ba610ec67a5e9588d2261e9579161c4e1fa: Status 404 returned error can't find the container with id dbcda157392dc40d3cfd3be044415ba610ec67a5e9588d2261e9579161c4e1fa
Sep 11 18:36:49.451958 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:49.451939    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:36:49.566326 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:49.566292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7842-7cc54a" event={"ID":"fd6c175b-5da7-4a15-be3f-72436bea6d99","Type":"ContainerStarted","Data":"dbcda157392dc40d3cfd3be044415ba610ec67a5e9588d2261e9579161c4e1fa"}
Sep 11 18:36:51.581408 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:51.581374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7842-7cc54a" event={"ID":"fd6c175b-5da7-4a15-be3f-72436bea6d99","Type":"ContainerStarted","Data":"257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec"}
Sep 11 18:36:51.601179 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:51.600638    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7842-7cc54a" podStartSLOduration=1.606488567 podStartE2EDuration="3.600619196s" totalImagesPullingTime="1.994130629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:51.595621921 +0000 UTC m=+1589.016396323" watchObservedRunningTime="2026-09-11 18:36:51.600619196 +0000 UTC m=+1589.021393601"
Sep 11 18:36:52.181283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:52.181248    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7842-7cc54a"]
Sep 11 18:36:52.186022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:52.185994    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7842-7cc54a"]
Sep 11 18:36:52.590576 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:52.590493    2566 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7842-7cc54a" container="test-curl-7842-7cc54a"
Sep 11 18:36:53.266872 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.266840    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:36:53.267080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.267043    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" podUID="d48b8477-5776-4381-9f6a-b9d510ebbc24" containerName="payload-pre-processing" containerID="cri-o://235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763" gracePeriod=30
Sep 11 18:36:53.513391 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.513364    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:36:53.539534 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.539458    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcwjt\" (UniqueName: \"kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt\") pod \"d48b8477-5776-4381-9f6a-b9d510ebbc24\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") "
Sep 11 18:36:53.539534 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.539493    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume\") pod \"d48b8477-5776-4381-9f6a-b9d510ebbc24\" (UID: \"d48b8477-5776-4381-9f6a-b9d510ebbc24\") "
Sep 11 18:36:53.539978 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.539949    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d48b8477-5776-4381-9f6a-b9d510ebbc24" (UID: "d48b8477-5776-4381-9f6a-b9d510ebbc24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:36:53.541585 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.541559    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt" (OuterVolumeSpecName: "kube-api-access-fcwjt") pod "d48b8477-5776-4381-9f6a-b9d510ebbc24" (UID: "d48b8477-5776-4381-9f6a-b9d510ebbc24"). InnerVolumeSpecName "kube-api-access-fcwjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:53.602687 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.602647    2566 generic.go:356] "Generic (PLEG): container finished" podID="d48b8477-5776-4381-9f6a-b9d510ebbc24" containerID="235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763" exitCode=0
Sep 11 18:36:53.603191 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.602998    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7842-7cc54a" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" containerName="test-curl-7842-7cc54a" containerID="cri-o://257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec" gracePeriod=2
Sep 11 18:36:53.603191 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.603136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" event={"ID":"d48b8477-5776-4381-9f6a-b9d510ebbc24","Type":"ContainerDied","Data":"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"}
Sep 11 18:36:53.603337 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.603215    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn" event={"ID":"d48b8477-5776-4381-9f6a-b9d510ebbc24","Type":"ContainerDied","Data":"8652e004c90cfeb33a2a1708776ff485735a6f36a55a3e785600c0a918736390"}
Sep 11 18:36:53.603337 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.603260    2566 scope.go:117] "RemoveContainer" containerID="235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"
Sep 11 18:36:53.603537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.603518    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"
Sep 11 18:36:53.628517 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.628490    2566 scope.go:117] "RemoveContainer" containerID="235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"
Sep 11 18:36:53.628868 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:53.628845    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763\": container with ID starting with 235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763 not found: ID does not exist" containerID="235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"
Sep 11 18:36:53.628965 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.628887    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763"} err="failed to get container status \"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763\": rpc error: code = NotFound desc = could not find container \"235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763\": container with ID starting with 235c4ec38906c549ab475465f3a02aa3d10ab4ca2060c0d4177273494717c763 not found: ID does not exist"
Sep 11 18:36:53.637489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.637464    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:36:53.640722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.640700    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn"]
Sep 11 18:36:53.641164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.641148    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcwjt\" (UniqueName: \"kubernetes.io/projected/d48b8477-5776-4381-9f6a-b9d510ebbc24-kube-api-access-fcwjt\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:53.641215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:53.641167    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d48b8477-5776-4381-9f6a-b9d510ebbc24-plugins-config-volume\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:55.061309 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:55.061277    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d48b8477-5776-4381-9f6a-b9d510ebbc24" path="/var/lib/kubelet/pods/d48b8477-5776-4381-9f6a-b9d510ebbc24/volumes"
Sep 11 18:36:55.813942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:55.813913    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:55.862803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:55.862763    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv6ll\" (UniqueName: \"kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll\") pod \"fd6c175b-5da7-4a15-be3f-72436bea6d99\" (UID: \"fd6c175b-5da7-4a15-be3f-72436bea6d99\") "
Sep 11 18:36:55.864932 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:55.864903    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll" (OuterVolumeSpecName: "kube-api-access-qv6ll") pod "fd6c175b-5da7-4a15-be3f-72436bea6d99" (UID: "fd6c175b-5da7-4a15-be3f-72436bea6d99"). InnerVolumeSpecName "kube-api-access-qv6ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:55.964509 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:55.964470    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv6ll\" (UniqueName: \"kubernetes.io/projected/fd6c175b-5da7-4a15-be3f-72436bea6d99-kube-api-access-qv6ll\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:36:56.629331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:56.629292    2566 generic.go:356] "Generic (PLEG): container finished" podID="fd6c175b-5da7-4a15-be3f-72436bea6d99" containerID="257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec" exitCode=137
Sep 11 18:36:56.629761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:56.629341    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:56.629761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:56.629399    2566 scope.go:117] "RemoveContainer" containerID="257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec"
Sep 11 18:36:56.639125 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:56.639109    2566 scope.go:117] "RemoveContainer" containerID="257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec"
Sep 11 18:36:56.639224 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:56.639197    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7842-7cc54a\" is forbidden: User \"system:node:ip-10-0-131-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-186.ec2.internal' and this object" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" pod="opendatahub/test-curl-7842-7cc54a"
Sep 11 18:36:56.639397 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:36:56.639381    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec\": container with ID starting with 257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec not found: ID does not exist" containerID="257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec"
Sep 11 18:36:56.639436 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:56.639407    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec"} err="failed to get container status \"257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec\": rpc error: code = NotFound desc = could not find container \"257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec\": container with ID starting with 257dc64d67e7b7bb8cd8b304b29cb3770e813b431aedd42d6e153f35716967ec not found: ID does not exist"
Sep 11 18:36:57.061620 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:36:57.061584    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" path="/var/lib/kubelet/pods/fd6c175b-5da7-4a15-be3f-72436bea6d99/volumes"
Sep 11 18:37:01.409938 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:01.409904    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:37:01.410383 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:01.410123    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy" containerID="cri-o://8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92" gracePeriod=30
Sep 11 18:37:06.677981 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.677943    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:37:06.692835 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.692750    2566 generic.go:356] "Generic (PLEG): container finished" podID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerID="8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92" exitCode=0
Sep 11 18:37:06.692835 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.692813    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"
Sep 11 18:37:06.693015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.692829    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerDied","Data":"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"}
Sep 11 18:37:06.693015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.692891    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d" event={"ID":"1094a1f4-0f75-4ad1-a14a-9609be44ef6a","Type":"ContainerDied","Data":"b68db6da8527a0c40d3b6d0ff38f28266ca2aa41e0e71219ce4c39f1e7370ba7"}
Sep 11 18:37:06.693015 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.692914    2566 scope.go:117] "RemoveContainer" containerID="8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"
Sep 11 18:37:06.704448 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.704427    2566 scope.go:117] "RemoveContainer" containerID="541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"
Sep 11 18:37:06.713027 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.713002    2566 scope.go:117] "RemoveContainer" containerID="8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"
Sep 11 18:37:06.713298 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:06.713279    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92\": container with ID starting with 8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92 not found: ID does not exist" containerID="8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"
Sep 11 18:37:06.713370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.713314    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92"} err="failed to get container status \"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92\": rpc error: code = NotFound desc = could not find container \"8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92\": container with ID starting with 8563a4384935df114d9cbf9d25af8a9e80b5f315f0c6ce2694d3a5b42f10cc92 not found: ID does not exist"
Sep 11 18:37:06.713370 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.713354    2566 scope.go:117] "RemoveContainer" containerID="541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"
Sep 11 18:37:06.713612 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:06.713596    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c\": container with ID starting with 541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c not found: ID does not exist" containerID="541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"
Sep 11 18:37:06.713657 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.713618    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c"} err="failed to get container status \"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c\": rpc error: code = NotFound desc = could not find container \"541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c\": container with ID starting with 541bf43a3cc9764d02f2e5890c85ded5d3a9379c72be9ad5dea783b7709a459c not found: ID does not exist"
Sep 11 18:37:06.772079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772045    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772088    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7wvh\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772128    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772157    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772175    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772195    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772259 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772219    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772294    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772317    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs\") pod \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\" (UID: \"1094a1f4-0f75-4ad1-a14a-9609be44ef6a\") "
Sep 11 18:37:06.772575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772349    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:06.772575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772541    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:06.772825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772689    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:06.772825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772729    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.772825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772748    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.773008 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772893    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:06.773008 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.772917    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:06.774444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.774416    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh" (OuterVolumeSpecName: "kube-api-access-t7wvh") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "kube-api-access-t7wvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:06.774562 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.774537    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:06.774828 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.774776    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:37:06.774916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.774780    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1094a1f4-0f75-4ad1-a14a-9609be44ef6a" (UID: "1094a1f4-0f75-4ad1-a14a-9609be44ef6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:06.873380 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873344    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873380 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873374    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873380 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873384    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873392    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873400    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873409    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:06.873608 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:06.873417    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7wvh\" (UniqueName: \"kubernetes.io/projected/1094a1f4-0f75-4ad1-a14a-9609be44ef6a-kube-api-access-t7wvh\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:07.016695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:07.016632    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:37:07.023109 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:07.023077    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d"]
Sep 11 18:37:07.062114 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:07.062083    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" path="/var/lib/kubelet/pods/1094a1f4-0f75-4ad1-a14a-9609be44ef6a/volumes"
Sep 11 18:37:08.306142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.306105    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:37:08.306966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.306928    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" podUID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" containerName="maas-api" containerID="cri-o://9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e" gracePeriod=30
Sep 11 18:37:08.337566 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.337540    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"]
Sep 11 18:37:08.340639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.340613    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a761e9-29819190-9ff5x"]
Sep 11 18:37:08.367497 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:08.367457    2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39cc5d9_e9eb_4fcc_aa53_60bcdc085c0e.slice/crio-conmon-9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 18:37:08.558450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.558384    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:37:08.701880 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.701842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") pod \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") "
Sep 11 18:37:08.702096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.702017    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca\") pod \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") "
Sep 11 18:37:08.702096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.702050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs\") pod \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") "
Sep 11 18:37:08.702096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.702077    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxfp2\" (UniqueName: \"kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2\") pod \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\" (UID: \"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e\") "
Sep 11 18:37:08.703773 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.703740    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" (UID: "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:08.710230 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.710191    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2" (OuterVolumeSpecName: "kube-api-access-vxfp2") pod "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" (UID: "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e"). InnerVolumeSpecName "kube-api-access-vxfp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:08.718195 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.718139    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" (UID: "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:08.718195 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.718135    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" (UID: "e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:08.720804 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.720752    2566 generic.go:356] "Generic (PLEG): container finished" podID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" containerID="9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e" exitCode=0
Sep 11 18:37:08.720947 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.720846    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"
Sep 11 18:37:08.720947 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.720885    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" event={"ID":"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e","Type":"ContainerDied","Data":"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"}
Sep 11 18:37:08.720947 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.720941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5" event={"ID":"e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e","Type":"ContainerDied","Data":"db3c9933d8b4097778e2e561d29de21ca1c656913ee31086ac7922d8d3ea63c8"}
Sep 11 18:37:08.721134 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.720972    2566 scope.go:117] "RemoveContainer" containerID="9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"
Sep 11 18:37:08.733772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.733749    2566 scope.go:117] "RemoveContainer" containerID="9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"
Sep 11 18:37:08.734165 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:08.734140    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e\": container with ID starting with 9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e not found: ID does not exist" containerID="9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"
Sep 11 18:37:08.734237 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.734177    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e"} err="failed to get container status \"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e\": rpc error: code = NotFound desc = could not find container \"9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e\": container with ID starting with 9373b8a01a8987fc13ece781ac92f5e3f60068a1272c2d616f2d68c6a58e366e not found: ID does not exist"
Sep 11 18:37:08.746368 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.746335    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:37:08.752851 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.752815    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a761e9-99599bc8-fxkn5"]
Sep 11 18:37:08.803483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.803441    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:08.803483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.803476    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:08.803483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.803487    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxfp2\" (UniqueName: \"kubernetes.io/projected/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-kube-api-access-vxfp2\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:08.803717 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:08.803495    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:09.060834 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:09.060770    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc" path="/var/lib/kubelet/pods/b2f4edd1-92c4-49c1-a4ae-3c891e05e4cc/volumes"
Sep 11 18:37:09.061270 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:09.061250    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" path="/var/lib/kubelet/pods/e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e/volumes"
Sep 11 18:37:15.236701 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:15.236615    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:37:15.765961 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:15.765898    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" containerID="cri-o://38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff" gracePeriod=30
Sep 11 18:37:17.734593 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:17.734554    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:37:17.735009 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:17.734625    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:37:21.029191 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.029166    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:37:21.122414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122321    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122362    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122379    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122414 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122426    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122459    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122497    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvqgw\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122555    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122620    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert\") pod \"cbfebeec-787a-4d0e-952f-c1528787ffec\" (UID: \"cbfebeec-787a-4d0e-952f-c1528787ffec\") "
Sep 11 18:37:21.122723 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122656    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.123075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122827    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.123075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122895    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.123075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.122913    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.123231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.123074    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.123231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.123097    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.123231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.123112    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.123231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.123126    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.123231 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.123176    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:21.124825 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.124775    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.124968 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.124945    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw" (OuterVolumeSpecName: "kube-api-access-tvqgw") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "kube-api-access-tvqgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:21.125040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.124957    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:21.125040 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.125008    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbfebeec-787a-4d0e-952f-c1528787ffec" (UID: "cbfebeec-787a-4d0e-952f-c1528787ffec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:37:21.224643 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.224603    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.224643 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.224635    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.224643 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.224647    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.224913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.224658    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvqgw\" (UniqueName: \"kubernetes.io/projected/cbfebeec-787a-4d0e-952f-c1528787ffec-kube-api-access-tvqgw\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.224913 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.224671    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbfebeec-787a-4d0e-952f-c1528787ffec-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.804583 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.804546    2566 generic.go:356] "Generic (PLEG): container finished" podID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerID="38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff" exitCode=0
Sep 11 18:37:21.804758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.804596    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"
Sep 11 18:37:21.804758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.804628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerDied","Data":"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"}
Sep 11 18:37:21.804758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.804687    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k" event={"ID":"cbfebeec-787a-4d0e-952f-c1528787ffec","Type":"ContainerDied","Data":"f2c1414a205c41b366e1d69dc7f656e30a1db238cfc565f9188f45def1eba302"}
Sep 11 18:37:21.804758 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.804710    2566 scope.go:117] "RemoveContainer" containerID="38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"
Sep 11 18:37:21.814095 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.814074    2566 scope.go:117] "RemoveContainer" containerID="0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"
Sep 11 18:37:21.822354 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.822337    2566 scope.go:117] "RemoveContainer" containerID="38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"
Sep 11 18:37:21.822639 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:21.822620    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff\": container with ID starting with 38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff not found: ID does not exist" containerID="38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"
Sep 11 18:37:21.822698 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.822647    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff"} err="failed to get container status \"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff\": rpc error: code = NotFound desc = could not find container \"38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff\": container with ID starting with 38c5e77fbeceab07e103e5c034c3788522b4e3700d0ad07dfbf3210dd2ce80ff not found: ID does not exist"
Sep 11 18:37:21.822698 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.822662    2566 scope.go:117] "RemoveContainer" containerID="0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"
Sep 11 18:37:21.822912 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:21.822894    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1\": container with ID starting with 0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1 not found: ID does not exist" containerID="0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"
Sep 11 18:37:21.822965 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.822918    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1"} err="failed to get container status \"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1\": rpc error: code = NotFound desc = could not find container \"0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1\": container with ID starting with 0366d7a3413109f5441f06f756364ed3ac1398eb4d73b8fe6e341a9c8aeec6d1 not found: ID does not exist"
Sep 11 18:37:21.836155 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.836129    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:37:21.838565 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:21.838542    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k"]
Sep 11 18:37:23.062366 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:23.062335    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" path="/var/lib/kubelet/pods/cbfebeec-787a-4d0e-952f-c1528787ffec/volumes"
Sep 11 18:37:23.407338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:23.407256    2566 scope.go:117] "RemoveContainer" containerID="d03e7e53c5d9d9b7407101d46d42aba7fe713dc19ea81149c6539c99092db340"
Sep 11 18:37:26.232211 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.232175    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:37:26.232713 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.232378    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" podUID="969ba387-c49c-4077-9603-25e4747e5984" containerName="maas-api" containerID="cri-o://59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2" gracePeriod=30
Sep 11 18:37:26.480545 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.480517    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:37:26.578555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.578464    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls\") pod \"969ba387-c49c-4077-9603-25e4747e5984\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") "
Sep 11 18:37:26.578555 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.578523    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs\") pod \"969ba387-c49c-4077-9603-25e4747e5984\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") "
Sep 11 18:37:26.578819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.578572    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swhqf\" (UniqueName: \"kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf\") pod \"969ba387-c49c-4077-9603-25e4747e5984\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") "
Sep 11 18:37:26.578819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.578602    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca\") pod \"969ba387-c49c-4077-9603-25e4747e5984\" (UID: \"969ba387-c49c-4077-9603-25e4747e5984\") "
Sep 11 18:37:26.578992 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.578969    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "969ba387-c49c-4077-9603-25e4747e5984" (UID: "969ba387-c49c-4077-9603-25e4747e5984"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:26.580698 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.580671    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "969ba387-c49c-4077-9603-25e4747e5984" (UID: "969ba387-c49c-4077-9603-25e4747e5984"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:26.581105 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.581082    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf" (OuterVolumeSpecName: "kube-api-access-swhqf") pod "969ba387-c49c-4077-9603-25e4747e5984" (UID: "969ba387-c49c-4077-9603-25e4747e5984"). InnerVolumeSpecName "kube-api-access-swhqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:26.581167 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.581153    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "969ba387-c49c-4077-9603-25e4747e5984" (UID: "969ba387-c49c-4077-9603-25e4747e5984"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:26.679420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.679383    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:26.679420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.679415    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhqf\" (UniqueName: \"kubernetes.io/projected/969ba387-c49c-4077-9603-25e4747e5984-kube-api-access-swhqf\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:26.679420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.679426    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969ba387-c49c-4077-9603-25e4747e5984-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:26.679672 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.679435    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969ba387-c49c-4077-9603-25e4747e5984-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:26.836014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.835909    2566 generic.go:356] "Generic (PLEG): container finished" podID="969ba387-c49c-4077-9603-25e4747e5984" containerID="59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2" exitCode=0
Sep 11 18:37:26.836014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.835964    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"
Sep 11 18:37:26.836014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.835981    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" event={"ID":"969ba387-c49c-4077-9603-25e4747e5984","Type":"ContainerDied","Data":"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"}
Sep 11 18:37:26.836290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.836030    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r" event={"ID":"969ba387-c49c-4077-9603-25e4747e5984","Type":"ContainerDied","Data":"5c86a058b9f97dd87d95eea7028587396863150073c3d69eccc0306f97314ffe"}
Sep 11 18:37:26.836290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.836051    2566 scope.go:117] "RemoveContainer" containerID="59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"
Sep 11 18:37:26.849216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.849197    2566 scope.go:117] "RemoveContainer" containerID="59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"
Sep 11 18:37:26.849523 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:26.849500    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2\": container with ID starting with 59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2 not found: ID does not exist" containerID="59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"
Sep 11 18:37:26.849597 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.849536    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2"} err="failed to get container status \"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2\": rpc error: code = NotFound desc = could not find container \"59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2\": container with ID starting with 59a23d0fb851e78d78d38e22a0b3809bb18170add21217634565d8ffdb6718c2 not found: ID does not exist"
Sep 11 18:37:26.857907 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.857880    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:37:26.863237 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:26.863212    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6c3180-584c5f5b7c-qlw4r"]
Sep 11 18:37:27.061400 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:27.061364    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="969ba387-c49c-4077-9603-25e4747e5984" path="/var/lib/kubelet/pods/969ba387-c49c-4077-9603-25e4747e5984/volumes"
Sep 11 18:37:33.359406 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:33.359375    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:37:33.359884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:33.359630    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" containerID="cri-o://60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6" gracePeriod=30
Sep 11 18:37:35.383385 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:35.383348    2566 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:37:35.383746 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:35.383405    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:37:38.612774 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.612746    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:37:38.693169 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693138    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693184    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693225    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trdgg\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693242    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693404    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693501 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693465    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693511    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693550    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693539    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:38.693612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693573    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert\") pod \"5c54540a-397d-4d3c-80cf-a366568c0307\" (UID: \"5c54540a-397d-4d3c-80cf-a366568c0307\") "
Sep 11 18:37:38.693844 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693709    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:38.693844 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693828    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:38.694022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.693984    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:38.694143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.694001    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.694286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.694148    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.694286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.694161    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.694286 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.694065    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:38.695562 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.695533    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:37:38.695662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.695563    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:38.695769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.695753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg" (OuterVolumeSpecName: "kube-api-access-trdgg") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "kube-api-access-trdgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:38.695867 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.695850    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c54540a-397d-4d3c-80cf-a366568c0307" (UID: "5c54540a-397d-4d3c-80cf-a366568c0307"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:38.795165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795116    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.795165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795159    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c54540a-397d-4d3c-80cf-a366568c0307-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.795165 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795174    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c54540a-397d-4d3c-80cf-a366568c0307-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.795413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795184    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trdgg\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-kube-api-access-trdgg\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.795413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795194    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c54540a-397d-4d3c-80cf-a366568c0307-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.795413 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.795202    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c54540a-397d-4d3c-80cf-a366568c0307-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:37:38.906562 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.906524    2566 generic.go:356] "Generic (PLEG): container finished" podID="5c54540a-397d-4d3c-80cf-a366568c0307" containerID="60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6" exitCode=0
Sep 11 18:37:38.906749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.906572    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"
Sep 11 18:37:38.906749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.906600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerDied","Data":"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"}
Sep 11 18:37:38.906749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.906690    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4" event={"ID":"5c54540a-397d-4d3c-80cf-a366568c0307","Type":"ContainerDied","Data":"37453097862f20bb932de6673c7f07ca8627f6020d23e423ef073fe6f5bc4d00"}
Sep 11 18:37:38.906749 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.906714    2566 scope.go:117] "RemoveContainer" containerID="60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"
Sep 11 18:37:38.916185 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.916169    2566 scope.go:117] "RemoveContainer" containerID="176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"
Sep 11 18:37:38.924294 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.924278    2566 scope.go:117] "RemoveContainer" containerID="60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"
Sep 11 18:37:38.924556 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:38.924537    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6\": container with ID starting with 60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6 not found: ID does not exist" containerID="60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"
Sep 11 18:37:38.924612 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.924594    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6"} err="failed to get container status \"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6\": rpc error: code = NotFound desc = could not find container \"60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6\": container with ID starting with 60a3a5c65c903429bedb6d2c2bcb26fd3339f684e5bc7e0d56a544eefe474db6 not found: ID does not exist"
Sep 11 18:37:38.924665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.924614    2566 scope.go:117] "RemoveContainer" containerID="176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"
Sep 11 18:37:38.924981 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:37:38.924953    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070\": container with ID starting with 176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070 not found: ID does not exist" containerID="176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"
Sep 11 18:37:38.925097 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.924988    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070"} err="failed to get container status \"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070\": rpc error: code = NotFound desc = could not find container \"176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070\": container with ID starting with 176e9e16d36047dcbede86fba02cc9dd6448cf89ab3edab45eb35a67a4068070 not found: ID does not exist"
Sep 11 18:37:38.927862 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.927838    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:37:38.933376 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:38.933352    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4"]
Sep 11 18:37:39.064096 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:37:39.064008    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" path="/var/lib/kubelet/pods/5c54540a-397d-4d3c-80cf-a366568c0307/volumes"
Sep 11 18:40:23.181409 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:23.181381    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:40:23.190252 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:23.190229    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:40:59.626075 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626036    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626486    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626500    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626509    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626515    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626520    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626526    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626532    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626537    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626544    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" containerName="test-curl-7842-7cc54a"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626549    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" containerName="test-curl-7842-7cc54a"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626566    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d48b8477-5776-4381-9f6a-b9d510ebbc24" containerName="payload-pre-processing"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626571    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d48b8477-5776-4381-9f6a-b9d510ebbc24" containerName="payload-pre-processing"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626580    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="969ba387-c49c-4077-9603-25e4747e5984" containerName="maas-api"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626585    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="969ba387-c49c-4077-9603-25e4747e5984" containerName="maas-api"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626595    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" containerName="maas-api"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626599    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" containerName="maas-api"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626656    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626664    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6c175b-5da7-4a15-be3f-72436bea6d99" containerName="test-curl-7842-7cc54a"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626670    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626677    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626683    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d48b8477-5776-4381-9f6a-b9d510ebbc24" containerName="payload-pre-processing"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626688    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="969ba387-c49c-4077-9603-25e4747e5984" containerName="maas-api"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626693    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f13dad-54f6-4150-b14e-58e2ebab4b8d" containerName="istio-proxy"
Sep 11 18:40:59.626688 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.626700    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39cc5d9-e9eb-4fcc-aa53-60bcdc085c0e" containerName="maas-api"
Sep 11 18:40:59.629973 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.629953    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.631991 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.631969    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-765dd1-serving-cert\""
Sep 11 18:40:59.642145 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.642123    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:40:59.728575 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.728540    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxlg\" (UniqueName: \"kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.728761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.728581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.728761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.728652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.728761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.728753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.830168 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.830133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.830352 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.830185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxlg\" (UniqueName: \"kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.830352 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.830219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.830352 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.830270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.830926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.830892    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.832581 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.832564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.832724 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.832707    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.837216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.837196    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxlg\" (UniqueName: \"kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg\") pod \"maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:40:59.941357 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:40:59.941328    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:41:00.227169 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:00.227133    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:41:00.227502 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:41:00.227478    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342b96e6_6ab4_477c_844b_669ebdfac3be.slice/crio-f94c3cb18be2a15b3a7b435420b85e4baf589e1be96487501730cb389633d127 WatchSource:0}: Error finding container f94c3cb18be2a15b3a7b435420b85e4baf589e1be96487501730cb389633d127: Status 404 returned error can't find the container with id f94c3cb18be2a15b3a7b435420b85e4baf589e1be96487501730cb389633d127
Sep 11 18:41:01.036955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:01.036914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" event={"ID":"342b96e6-6ab4-477c-844b-669ebdfac3be","Type":"ContainerStarted","Data":"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"}
Sep 11 18:41:01.037367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:01.036977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" event={"ID":"342b96e6-6ab4-477c-844b-669ebdfac3be","Type":"ContainerStarted","Data":"f94c3cb18be2a15b3a7b435420b85e4baf589e1be96487501730cb389633d127"}
Sep 11 18:41:01.037367 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:01.037007    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:41:01.057499 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:01.057446    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" podStartSLOduration=1.659459927 podStartE2EDuration="2.057426421s" totalImagesPullingTime="397.966494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:41:01.054574014 +0000 UTC m=+1838.475348417" watchObservedRunningTime="2026-09-11 18:41:01.057426421 +0000 UTC m=+1838.478200824"
Sep 11 18:41:07.047149 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:07.047118    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:41:23.701337 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701304    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:41:23.701722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701710    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:41:23.701769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701724    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:41:23.701769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701731    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:41:23.701769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701737    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:41:23.701881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701824    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c54540a-397d-4d3c-80cf-a366568c0307" containerName="istio-proxy"
Sep 11 18:41:23.701881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701836    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1094a1f4-0f75-4ad1-a14a-9609be44ef6a" containerName="istio-proxy"
Sep 11 18:41:23.701881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.701842    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbfebeec-787a-4d0e-952f-c1528787ffec" containerName="istio-proxy"
Sep 11 18:41:23.705219 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.705198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.708057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.708026    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9c1a4f-openshift-default-dockercfg-5glc9\""
Sep 11 18:41:23.718901 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.718876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:41:23.756640 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756607    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.756856 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.756856 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ldqd\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.756856 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.757010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.757010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.757010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756918    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.757010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756943    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.757010 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.756970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.857977    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ldqd\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858052    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858199    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858231    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858635 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858689 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858662    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858751 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858688    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.858927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858904    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.859061 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.858966    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.860549 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.860521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.860659 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.860577    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.865816 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.865763    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:23.866283 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:23.866266    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ldqd\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd\") pod \"e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") " pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:24.018819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:24.018706    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:24.294959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:24.294932    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:41:24.296343 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:41:24.296314    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ce772b_a0f7_49d9_bc88_7bc801ddb50c.slice/crio-20c3300cfe359ee341254765436ce1a4a3b21845ded5a9a4a0d34760dfd682ea WatchSource:0}: Error finding container 20c3300cfe359ee341254765436ce1a4a3b21845ded5a9a4a0d34760dfd682ea: Status 404 returned error can't find the container with id 20c3300cfe359ee341254765436ce1a4a3b21845ded5a9a4a0d34760dfd682ea
Sep 11 18:41:24.298562 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:24.298529    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:24.298651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:24.298590    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:24.298651 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:24.298618    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:25.172869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:25.172829    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerStarted","Data":"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"}
Sep 11 18:41:25.173224 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:25.172896    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerStarted","Data":"20c3300cfe359ee341254765436ce1a4a3b21845ded5a9a4a0d34760dfd682ea"}
Sep 11 18:41:25.196306 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:25.196251    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podStartSLOduration=2.1962378559999998 podStartE2EDuration="2.196237856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:41:25.194272481 +0000 UTC m=+1862.615046898" watchObservedRunningTime="2026-09-11 18:41:25.196237856 +0000 UTC m=+1862.617012259"
Sep 11 18:41:26.019884 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:26.019837    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:26.025438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:26.025411    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:26.180066 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:26.180025    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:26.180915 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:26.180888    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:42.221987 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:42.221945    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:41:42.222434 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:42.222009    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:41:44.292942 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.292907    2566 generic.go:356] "Generic (PLEG): container finished" podID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerID="01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82" exitCode=0
Sep 11 18:41:44.293368 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.292982    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerDied","Data":"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"}
Sep 11 18:41:44.293420 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.293370    2566 scope.go:117] "RemoveContainer" containerID="01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"
Sep 11 18:41:44.294563 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.294536    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:44.294638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.294606    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:44.294675 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:44.294639    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 18:41:45.300588 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:45.300508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerStarted","Data":"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"}
Sep 11 18:41:46.019410 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:46.019373    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:46.019592 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:46.019562    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 18:41:46.019638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:46.019603    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 18:41:47.019665 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:47.019628    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 18:41:47.020080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:47.019681    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 18:41:48.020057 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:48.020019    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 18:41:48.020453 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:48.020074    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 18:41:49.020164 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:49.020118    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 18:41:49.020579 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:49.020186    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 18:41:50.019097 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:50.019054    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 18:41:50.019305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:50.019111    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 18:41:51.047088 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:51.047055    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:51.047489 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:51.047459    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:41:51.048132 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:41:51.048115    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:42:44.689670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.689634    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:42:44.692290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.692274    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.694274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.694255    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-cd2146-serving-cert\""
Sep 11 18:42:44.703237 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.703210    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:42:44.746742 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.746714    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.746941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.746819    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.746941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.746844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drnsg\" (UniqueName: \"kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.746941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.746874    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.847553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.847514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.847553 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.847551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drnsg\" (UniqueName: \"kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.847853 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.847578    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.847853 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.847619    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.848375 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.848351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.850245 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.850215    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.850340 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.850268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:44.855013 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:44.854983    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drnsg\" (UniqueName: \"kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg\") pod \"maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:45.003216 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:45.003133    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:45.285955 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:45.285917    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:42:45.287542 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:42:45.287515    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ceba9b_e15e_4547_8e32_cb855e880154.slice/crio-b27551eec34644a7e364e58dab729e381e1c8fc702bbc5b8ec3bac2054173731 WatchSource:0}: Error finding container b27551eec34644a7e364e58dab729e381e1c8fc702bbc5b8ec3bac2054173731: Status 404 returned error can't find the container with id b27551eec34644a7e364e58dab729e381e1c8fc702bbc5b8ec3bac2054173731
Sep 11 18:42:45.289494 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:45.289472    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:42:45.649476 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:45.649383    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" event={"ID":"29ceba9b-e15e-4547-8e32-cb855e880154","Type":"ContainerStarted","Data":"b27551eec34644a7e364e58dab729e381e1c8fc702bbc5b8ec3bac2054173731"}
Sep 11 18:42:46.656901 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:46.656867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" event={"ID":"29ceba9b-e15e-4547-8e32-cb855e880154","Type":"ContainerStarted","Data":"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"}
Sep 11 18:42:46.657387 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:46.656936    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:42:46.675138 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:46.675091    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" podStartSLOduration=2.243932154 podStartE2EDuration="2.675075791s" totalImagesPullingTime="431.143637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:42:46.672919718 +0000 UTC m=+1944.093694122" watchObservedRunningTime="2026-09-11 18:42:46.675075791 +0000 UTC m=+1944.095850194"
Sep 11 18:42:52.668642 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:42:52.668612    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:43:23.443656 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.443445    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:43:23.444152 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.443783    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" podUID="29ceba9b-e15e-4547-8e32-cb855e880154" containerName="maas-api" containerID="cri-o://a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982" gracePeriod=30
Sep 11 18:43:23.694358 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.694297    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:43:23.826016 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.825984    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drnsg\" (UniqueName: \"kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg\") pod \"29ceba9b-e15e-4547-8e32-cb855e880154\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") "
Sep 11 18:43:23.826304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.826078    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls\") pod \"29ceba9b-e15e-4547-8e32-cb855e880154\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") "
Sep 11 18:43:23.826304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.826110    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs\") pod \"29ceba9b-e15e-4547-8e32-cb855e880154\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") "
Sep 11 18:43:23.826304 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.826145    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca\") pod \"29ceba9b-e15e-4547-8e32-cb855e880154\" (UID: \"29ceba9b-e15e-4547-8e32-cb855e880154\") "
Sep 11 18:43:23.826872 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.826837    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29ceba9b-e15e-4547-8e32-cb855e880154" (UID: "29ceba9b-e15e-4547-8e32-cb855e880154"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:23.828411 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.828375    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg" (OuterVolumeSpecName: "kube-api-access-drnsg") pod "29ceba9b-e15e-4547-8e32-cb855e880154" (UID: "29ceba9b-e15e-4547-8e32-cb855e880154"). InnerVolumeSpecName "kube-api-access-drnsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:23.828836 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.828771    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "29ceba9b-e15e-4547-8e32-cb855e880154" (UID: "29ceba9b-e15e-4547-8e32-cb855e880154"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:43:23.828956 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.828884    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29ceba9b-e15e-4547-8e32-cb855e880154" (UID: "29ceba9b-e15e-4547-8e32-cb855e880154"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:43:23.872600 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.872565    2566 generic.go:356] "Generic (PLEG): container finished" podID="29ceba9b-e15e-4547-8e32-cb855e880154" containerID="a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982" exitCode=0
Sep 11 18:43:23.872767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.872611    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"
Sep 11 18:43:23.872767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.872651    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" event={"ID":"29ceba9b-e15e-4547-8e32-cb855e880154","Type":"ContainerDied","Data":"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"}
Sep 11 18:43:23.872767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.872702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p" event={"ID":"29ceba9b-e15e-4547-8e32-cb855e880154","Type":"ContainerDied","Data":"b27551eec34644a7e364e58dab729e381e1c8fc702bbc5b8ec3bac2054173731"}
Sep 11 18:43:23.872767 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.872724    2566 scope.go:117] "RemoveContainer" containerID="a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"
Sep 11 18:43:23.883071 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.883054    2566 scope.go:117] "RemoveContainer" containerID="a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"
Sep 11 18:43:23.883328 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:43:23.883312    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982\": container with ID starting with a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982 not found: ID does not exist" containerID="a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"
Sep 11 18:43:23.883374 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.883335    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982"} err="failed to get container status \"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982\": rpc error: code = NotFound desc = could not find container \"a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982\": container with ID starting with a19b0f1ec05563e1c83983339762489a8805d7f289dd03384f6d6dbe56b96982 not found: ID does not exist"
Sep 11 18:43:23.895430 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.895405    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:43:23.900815 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.900795    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cd2146-7848d979f4-8v24p"]
Sep 11 18:43:23.927769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.927746    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:23.927769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.927766    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ceba9b-e15e-4547-8e32-cb855e880154-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:23.927916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.927776    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ceba9b-e15e-4547-8e32-cb855e880154-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:23.927916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:23.927809    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drnsg\" (UniqueName: \"kubernetes.io/projected/29ceba9b-e15e-4547-8e32-cb855e880154-kube-api-access-drnsg\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:25.062400 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:25.062362    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ceba9b-e15e-4547-8e32-cb855e880154" path="/var/lib/kubelet/pods/29ceba9b-e15e-4547-8e32-cb855e880154/volumes"
Sep 11 18:43:49.345148 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.345112    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:43:49.345617 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.345360    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" podUID="342b96e6-6ab4-477c-844b-669ebdfac3be" containerName="maas-api" containerID="cri-o://6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730" gracePeriod=30
Sep 11 18:43:49.590325 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.590301    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:43:49.674798 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.674748    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs\") pod \"342b96e6-6ab4-477c-844b-669ebdfac3be\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") "
Sep 11 18:43:49.674994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.674858    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca\") pod \"342b96e6-6ab4-477c-844b-669ebdfac3be\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") "
Sep 11 18:43:49.674994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.674908    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fxlg\" (UniqueName: \"kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg\") pod \"342b96e6-6ab4-477c-844b-669ebdfac3be\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") "
Sep 11 18:43:49.674994 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.674947    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls\") pod \"342b96e6-6ab4-477c-844b-669ebdfac3be\" (UID: \"342b96e6-6ab4-477c-844b-669ebdfac3be\") "
Sep 11 18:43:49.675235 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.675205    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "342b96e6-6ab4-477c-844b-669ebdfac3be" (UID: "342b96e6-6ab4-477c-844b-669ebdfac3be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:49.677540 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.677506    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg" (OuterVolumeSpecName: "kube-api-access-6fxlg") pod "342b96e6-6ab4-477c-844b-669ebdfac3be" (UID: "342b96e6-6ab4-477c-844b-669ebdfac3be"). InnerVolumeSpecName "kube-api-access-6fxlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:49.677639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.677556    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "342b96e6-6ab4-477c-844b-669ebdfac3be" (UID: "342b96e6-6ab4-477c-844b-669ebdfac3be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:43:49.677639 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.677585    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "342b96e6-6ab4-477c-844b-669ebdfac3be" (UID: "342b96e6-6ab4-477c-844b-669ebdfac3be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:43:49.776192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.776158    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fxlg\" (UniqueName: \"kubernetes.io/projected/342b96e6-6ab4-477c-844b-669ebdfac3be-kube-api-access-6fxlg\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:49.776192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.776187    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:49.776192 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.776197    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342b96e6-6ab4-477c-844b-669ebdfac3be-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:49.776424 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:49.776205    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342b96e6-6ab4-477c-844b-669ebdfac3be-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:43:50.023199 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.023107    2566 generic.go:356] "Generic (PLEG): container finished" podID="342b96e6-6ab4-477c-844b-669ebdfac3be" containerID="6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730" exitCode=0
Sep 11 18:43:50.023199 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.023159    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"
Sep 11 18:43:50.023422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.023194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" event={"ID":"342b96e6-6ab4-477c-844b-669ebdfac3be","Type":"ContainerDied","Data":"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"}
Sep 11 18:43:50.023422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.023253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq" event={"ID":"342b96e6-6ab4-477c-844b-669ebdfac3be","Type":"ContainerDied","Data":"f94c3cb18be2a15b3a7b435420b85e4baf589e1be96487501730cb389633d127"}
Sep 11 18:43:50.023422 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.023276    2566 scope.go:117] "RemoveContainer" containerID="6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"
Sep 11 18:43:50.035827 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.035805    2566 scope.go:117] "RemoveContainer" containerID="6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"
Sep 11 18:43:50.036147 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:43:50.036127    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730\": container with ID starting with 6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730 not found: ID does not exist" containerID="6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"
Sep 11 18:43:50.036208 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.036157    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730"} err="failed to get container status \"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730\": rpc error: code = NotFound desc = could not find container \"6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730\": container with ID starting with 6b80c8ef897391536472b4a8b931c10f6a1584a7513be03e1e4aa464045fc730 not found: ID does not exist"
Sep 11 18:43:50.049335 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.049307    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:43:50.051902 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:50.051881    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-765dd1-55bd8d6d68-pxdnq"]
Sep 11 18:43:51.060701 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:43:51.060664    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342b96e6-6ab4-477c-844b-669ebdfac3be" path="/var/lib/kubelet/pods/342b96e6-6ab4-477c-844b-669ebdfac3be/volumes"
Sep 11 18:44:56.917331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:44:56.917238    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:44:56.917916 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:44:56.917443    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy" containerID="cri-o://5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75" gracePeriod=30
Sep 11 18:45:02.172233 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.172207    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:45:02.260497 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260497 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260485    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260676 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260534    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260676 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260604    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260676 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260642    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ldqd\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260676 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260664    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260735    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:02.260886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260781    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data" (OuterVolumeSpecName: "istio-data") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:02.260886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260816    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.260886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.260845    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs\") pod \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\" (UID: \"84ce772b-a0f7-49d9-bc88-7bc801ddb50c\") "
Sep 11 18:45:02.261239 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261029    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:02.261239 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261219    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.261338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261236    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:02.261338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261240    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-credential-socket\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.261338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261270    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:45:02.261338 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.261278    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-data\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.262904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.262878    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd" (OuterVolumeSpecName: "kube-api-access-7ldqd") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "kube-api-access-7ldqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:45:02.262904 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.262886    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:45:02.263159 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.263136    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:02.263159 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.263141    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token" (OuterVolumeSpecName: "istio-token") pod "84ce772b-a0f7-49d9-bc88-7bc801ddb50c" (UID: "84ce772b-a0f7-49d9-bc88-7bc801ddb50c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:45:02.361730 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361700    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-token\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.361730 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361725    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ldqd\" (UniqueName: \"kubernetes.io/projected/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-kube-api-access-7ldqd\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.361730 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361735    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-podinfo\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.361975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361744    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istiod-ca-cert\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.361975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361753    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-workload-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.361975 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.361761    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84ce772b-a0f7-49d9-bc88-7bc801ddb50c-istio-envoy\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:02.437710 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.437669    2566 generic.go:356] "Generic (PLEG): container finished" podID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerID="5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75" exitCode=0
Sep 11 18:45:02.437898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.437721    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"
Sep 11 18:45:02.437898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.437727    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerDied","Data":"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"}
Sep 11 18:45:02.437898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.437783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9" event={"ID":"84ce772b-a0f7-49d9-bc88-7bc801ddb50c","Type":"ContainerDied","Data":"20c3300cfe359ee341254765436ce1a4a3b21845ded5a9a4a0d34760dfd682ea"}
Sep 11 18:45:02.437898 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.437842    2566 scope.go:117] "RemoveContainer" containerID="5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"
Sep 11 18:45:02.447641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.447619    2566 scope.go:117] "RemoveContainer" containerID="01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"
Sep 11 18:45:02.456242 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.456223    2566 scope.go:117] "RemoveContainer" containerID="5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"
Sep 11 18:45:02.456487 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:45:02.456470    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75\": container with ID starting with 5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75 not found: ID does not exist" containerID="5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"
Sep 11 18:45:02.456532 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.456496    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75"} err="failed to get container status \"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75\": rpc error: code = NotFound desc = could not find container \"5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75\": container with ID starting with 5548f844a436aae08cd25451a799cc357209858bb659a72f226c4b9b0e31df75 not found: ID does not exist"
Sep 11 18:45:02.456532 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.456510    2566 scope.go:117] "RemoveContainer" containerID="01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"
Sep 11 18:45:02.456782 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:45:02.456764    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82\": container with ID starting with 01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82 not found: ID does not exist" containerID="01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"
Sep 11 18:45:02.456837 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.456805    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82"} err="failed to get container status \"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82\": rpc error: code = NotFound desc = could not find container \"01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82\": container with ID starting with 01e645785d76d69627d9d22b6168dd1f1143b17e67a49c2d2368611bc95a9d82 not found: ID does not exist"
Sep 11 18:45:02.460248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.460226    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:45:02.463280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:02.463260    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9"]
Sep 11 18:45:03.060722 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:03.060690    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" path="/var/lib/kubelet/pods/84ce772b-a0f7-49d9-bc88-7bc801ddb50c/volumes"
Sep 11 18:45:07.824035 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:07.823999    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:45:07.824892 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:07.824837    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" podUID="3b624a9f-4388-491f-bec9-992c39206e76" containerName="maas-api" containerID="cri-o://c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257" gracePeriod=30
Sep 11 18:45:08.066941 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.066916    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:45:08.223080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.223051    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") pod \"3b624a9f-4388-491f-bec9-992c39206e76\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") "
Sep 11 18:45:08.223253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.223110    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs\") pod \"3b624a9f-4388-491f-bec9-992c39206e76\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") "
Sep 11 18:45:08.223253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.223151    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnhf2\" (UniqueName: \"kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2\") pod \"3b624a9f-4388-491f-bec9-992c39206e76\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") "
Sep 11 18:45:08.223253 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.223216    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca\") pod \"3b624a9f-4388-491f-bec9-992c39206e76\" (UID: \"3b624a9f-4388-491f-bec9-992c39206e76\") "
Sep 11 18:45:08.223664 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.223626    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b624a9f-4388-491f-bec9-992c39206e76" (UID: "3b624a9f-4388-491f-bec9-992c39206e76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:45:08.225170 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.225139    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b624a9f-4388-491f-bec9-992c39206e76" (UID: "3b624a9f-4388-491f-bec9-992c39206e76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:45:08.225266 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.225253    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2" (OuterVolumeSpecName: "kube-api-access-nnhf2") pod "3b624a9f-4388-491f-bec9-992c39206e76" (UID: "3b624a9f-4388-491f-bec9-992c39206e76"). InnerVolumeSpecName "kube-api-access-nnhf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:45:08.225351 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.225329    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b624a9f-4388-491f-bec9-992c39206e76" (UID: "3b624a9f-4388-491f-bec9-992c39206e76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:45:08.324087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.324048    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnhf2\" (UniqueName: \"kubernetes.io/projected/3b624a9f-4388-491f-bec9-992c39206e76-kube-api-access-nnhf2\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:08.324087 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.324085    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b624a9f-4388-491f-bec9-992c39206e76-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:08.324307 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.324100    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:08.324307 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.324116    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b624a9f-4388-491f-bec9-992c39206e76-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:08.472953 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.472911    2566 generic.go:356] "Generic (PLEG): container finished" podID="3b624a9f-4388-491f-bec9-992c39206e76" containerID="c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257" exitCode=0
Sep 11 18:45:08.473142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.472970    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"
Sep 11 18:45:08.473142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.472991    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" event={"ID":"3b624a9f-4388-491f-bec9-992c39206e76","Type":"ContainerDied","Data":"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"}
Sep 11 18:45:08.473142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.473033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw" event={"ID":"3b624a9f-4388-491f-bec9-992c39206e76","Type":"ContainerDied","Data":"ea601cf7fc5c36b621208fa346f1c5747cb81f688e6c911e1398e22b45582334"}
Sep 11 18:45:08.473142 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.473054    2566 scope.go:117] "RemoveContainer" containerID="c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"
Sep 11 18:45:08.485384 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.485359    2566 scope.go:117] "RemoveContainer" containerID="c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"
Sep 11 18:45:08.485844 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:45:08.485822    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257\": container with ID starting with c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257 not found: ID does not exist" containerID="c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"
Sep 11 18:45:08.485936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.485854    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257"} err="failed to get container status \"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257\": rpc error: code = NotFound desc = could not find container \"c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257\": container with ID starting with c457cfab11155a741eff95ff39ab1a0edccba0ada27f842571e8c63d35339257 not found: ID does not exist"
Sep 11 18:45:08.495220 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.495193    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:45:08.499853 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:08.499835    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bf9898-77c574c496-7bxhw"]
Sep 11 18:45:09.060948 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:09.060909    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b624a9f-4388-491f-bec9-992c39206e76" path="/var/lib/kubelet/pods/3b624a9f-4388-491f-bec9-992c39206e76/volumes"
Sep 11 18:45:23.218936 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:23.218909    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:45:23.230182 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:23.230161    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:45:25.543527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.542257    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:45:25.543527 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.542500    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" podUID="dd40156b-7f44-44d1-ac0a-8971ab50934b" containerName="maas-api" containerID="cri-o://0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746" gracePeriod=30
Sep 11 18:45:25.796287 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.796234    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:45:25.874051 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874013    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca\") pod \"dd40156b-7f44-44d1-ac0a-8971ab50934b\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") "
Sep 11 18:45:25.874222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874092    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") pod \"dd40156b-7f44-44d1-ac0a-8971ab50934b\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") "
Sep 11 18:45:25.874222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874128    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs\") pod \"dd40156b-7f44-44d1-ac0a-8971ab50934b\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") "
Sep 11 18:45:25.874222 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874169    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr77z\" (UniqueName: \"kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z\") pod \"dd40156b-7f44-44d1-ac0a-8971ab50934b\" (UID: \"dd40156b-7f44-44d1-ac0a-8971ab50934b\") "
Sep 11 18:45:25.874417 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874393    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dd40156b-7f44-44d1-ac0a-8971ab50934b" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:45:25.874498 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.874485    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd40156b-7f44-44d1-ac0a-8971ab50934b-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:25.876274 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.876244    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dd40156b-7f44-44d1-ac0a-8971ab50934b" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:45:25.876398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.876269    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dd40156b-7f44-44d1-ac0a-8971ab50934b" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:45:25.876456 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.876395    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z" (OuterVolumeSpecName: "kube-api-access-qr77z") pod "dd40156b-7f44-44d1-ac0a-8971ab50934b" (UID: "dd40156b-7f44-44d1-ac0a-8971ab50934b"). InnerVolumeSpecName "kube-api-access-qr77z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:45:25.975293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.975255    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr77z\" (UniqueName: \"kubernetes.io/projected/dd40156b-7f44-44d1-ac0a-8971ab50934b-kube-api-access-qr77z\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:25.975293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.975288    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:25.975293 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:25.975298    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd40156b-7f44-44d1-ac0a-8971ab50934b-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:45:26.586959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.586926    2566 generic.go:356] "Generic (PLEG): container finished" podID="dd40156b-7f44-44d1-ac0a-8971ab50934b" containerID="0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746" exitCode=0
Sep 11 18:45:26.587432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.586981    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"
Sep 11 18:45:26.587432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.587012    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" event={"ID":"dd40156b-7f44-44d1-ac0a-8971ab50934b","Type":"ContainerDied","Data":"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"}
Sep 11 18:45:26.587432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.587082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d" event={"ID":"dd40156b-7f44-44d1-ac0a-8971ab50934b","Type":"ContainerDied","Data":"0e8c067e5751104fab3789db45ee724a4c4badf7c0e162f50199948f0faf872f"}
Sep 11 18:45:26.587432 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.587117    2566 scope.go:117] "RemoveContainer" containerID="0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"
Sep 11 18:45:26.596567 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.596544    2566 scope.go:117] "RemoveContainer" containerID="0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"
Sep 11 18:45:26.596845 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:45:26.596824    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746\": container with ID starting with 0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746 not found: ID does not exist" containerID="0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"
Sep 11 18:45:26.596908 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.596856    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746"} err="failed to get container status \"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746\": rpc error: code = NotFound desc = could not find container \"0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746\": container with ID starting with 0c175ef9bfb184e9a616358b4ac5ba657fb76a56dc6345f2b925ec0d1839d746 not found: ID does not exist"
Sep 11 18:45:26.608935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.608898    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:45:26.613560 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:26.613540    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5faf38-5f8d4bd46b-f595d"]
Sep 11 18:45:27.063415 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:45:27.063380    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd40156b-7f44-44d1-ac0a-8971ab50934b" path="/var/lib/kubelet/pods/dd40156b-7f44-44d1-ac0a-8971ab50934b/volumes"
Sep 11 18:48:00.900729 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:00.900691    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:48:00.901273 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:00.901040    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" podUID="7bd07201-2262-4463-8a65-72094f2f5d56" containerName="manager" containerID="cri-o://669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81" gracePeriod=10
Sep 11 18:48:03.254130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.254101    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:48:03.317803 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.317696    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume\") pod \"7bd07201-2262-4463-8a65-72094f2f5d56\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") "
Sep 11 18:48:03.317976 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.317840    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqg9p\" (UniqueName: \"kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p\") pod \"7bd07201-2262-4463-8a65-72094f2f5d56\" (UID: \"7bd07201-2262-4463-8a65-72094f2f5d56\") "
Sep 11 18:48:03.318138 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.318112    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7bd07201-2262-4463-8a65-72094f2f5d56" (UID: "7bd07201-2262-4463-8a65-72094f2f5d56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:48:03.319998 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.319977    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p" (OuterVolumeSpecName: "kube-api-access-rqg9p") pod "7bd07201-2262-4463-8a65-72094f2f5d56" (UID: "7bd07201-2262-4463-8a65-72094f2f5d56"). InnerVolumeSpecName "kube-api-access-rqg9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:48:03.419053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.419003    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bd07201-2262-4463-8a65-72094f2f5d56-extensions-socket-volume\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:48:03.419053 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.419046    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqg9p\" (UniqueName: \"kubernetes.io/projected/7bd07201-2262-4463-8a65-72094f2f5d56-kube-api-access-rqg9p\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:48:03.456313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.456279    2566 generic.go:356] "Generic (PLEG): container finished" podID="7bd07201-2262-4463-8a65-72094f2f5d56" containerID="669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81" exitCode=0
Sep 11 18:48:03.456496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.456319    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"
Sep 11 18:48:03.456496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.456376    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" event={"ID":"7bd07201-2262-4463-8a65-72094f2f5d56","Type":"ContainerDied","Data":"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"}
Sep 11 18:48:03.456496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.456425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h" event={"ID":"7bd07201-2262-4463-8a65-72094f2f5d56","Type":"ContainerDied","Data":"283b9da66622aa90539870e9264cdec80f73fa68853f19c36272a9c9cac87053"}
Sep 11 18:48:03.456496 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.456449    2566 scope.go:117] "RemoveContainer" containerID="669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"
Sep 11 18:48:03.465896 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.465877    2566 scope.go:117] "RemoveContainer" containerID="669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"
Sep 11 18:48:03.466160 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:48:03.466142    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81\": container with ID starting with 669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81 not found: ID does not exist" containerID="669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"
Sep 11 18:48:03.466209 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.466167    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81"} err="failed to get container status \"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81\": rpc error: code = NotFound desc = could not find container \"669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81\": container with ID starting with 669b6e88e57bd905f74f9b2f14470efae35cb5945c6a96a1369d46dda4ad9b81 not found: ID does not exist"
Sep 11 18:48:03.478682 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.478653    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:48:03.483894 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:03.483870    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wbc2h"]
Sep 11 18:48:05.061066 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:48:05.061031    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd07201-2262-4463-8a65-72094f2f5d56" path="/var/lib/kubelet/pods/7bd07201-2262-4463-8a65-72094f2f5d56/volumes"
Sep 11 18:49:01.584556 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584521    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"]
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584910    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ceba9b-e15e-4547-8e32-cb855e880154" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584922    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ceba9b-e15e-4547-8e32-cb855e880154" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584936    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b624a9f-4388-491f-bec9-992c39206e76" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584942    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b624a9f-4388-491f-bec9-992c39206e76" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584954    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584960    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584966    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd40156b-7f44-44d1-ac0a-8971ab50934b" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584972    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd40156b-7f44-44d1-ac0a-8971ab50934b" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584978    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342b96e6-6ab4-477c-844b-669ebdfac3be" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584983    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="342b96e6-6ab4-477c-844b-669ebdfac3be" containerName="maas-api"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584989    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.584994    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585002    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd07201-2262-4463-8a65-72094f2f5d56" containerName="manager"
Sep 11 18:49:01.585046 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585007    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd07201-2262-4463-8a65-72094f2f5d56" containerName="manager"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585062    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="342b96e6-6ab4-477c-844b-669ebdfac3be" containerName="maas-api"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585072    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585078    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ce772b-a0f7-49d9-bc88-7bc801ddb50c" containerName="istio-proxy"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585083    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd07201-2262-4463-8a65-72094f2f5d56" containerName="manager"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585088    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd40156b-7f44-44d1-ac0a-8971ab50934b" containerName="maas-api"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585094    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b624a9f-4388-491f-bec9-992c39206e76" containerName="maas-api"
Sep 11 18:49:01.585518 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.585099    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="29ceba9b-e15e-4547-8e32-cb855e880154" containerName="maas-api"
Sep 11 18:49:01.588038 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.588022    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.590777 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.590755    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zwkz4\""
Sep 11 18:49:01.601248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.601222    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"]
Sep 11 18:49:01.741747 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.741710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffa07aa-f687-4323-9805-823d9dbec68f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.741960 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.741781    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zkw\" (UniqueName: \"kubernetes.io/projected/fffa07aa-f687-4323-9805-823d9dbec68f-kube-api-access-55zkw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.843080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.842989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffa07aa-f687-4323-9805-823d9dbec68f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.843080 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.843051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55zkw\" (UniqueName: \"kubernetes.io/projected/fffa07aa-f687-4323-9805-823d9dbec68f-kube-api-access-55zkw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.843369 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.843348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffa07aa-f687-4323-9805-823d9dbec68f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.853574 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.853545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zkw\" (UniqueName: \"kubernetes.io/projected/fffa07aa-f687-4323-9805-823d9dbec68f-kube-api-access-55zkw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6l7mm\" (UID: \"fffa07aa-f687-4323-9805-823d9dbec68f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:01.898302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:01.898266    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:02.179550 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:02.179524    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"]
Sep 11 18:49:02.181498 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:49:02.181470    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffa07aa_f687_4323_9805_823d9dbec68f.slice/crio-5c6267200e605bcf321daace8ed6e6ab6e2cbc17d58b2a7c432cc947d1ff0e29 WatchSource:0}: Error finding container 5c6267200e605bcf321daace8ed6e6ab6e2cbc17d58b2a7c432cc947d1ff0e29: Status 404 returned error can't find the container with id 5c6267200e605bcf321daace8ed6e6ab6e2cbc17d58b2a7c432cc947d1ff0e29
Sep 11 18:49:02.772876 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:02.772829    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm" event={"ID":"fffa07aa-f687-4323-9805-823d9dbec68f","Type":"ContainerStarted","Data":"abbabe41f68a65e347fcab2331f97e07ab467145e5d4fe6bc20152d9bffe8a20"}
Sep 11 18:49:02.773275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:02.772906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:49:02.773275 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:02.772927    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm" event={"ID":"fffa07aa-f687-4323-9805-823d9dbec68f","Type":"ContainerStarted","Data":"5c6267200e605bcf321daace8ed6e6ab6e2cbc17d58b2a7c432cc947d1ff0e29"}
Sep 11 18:49:02.797671 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:02.797623    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm" podStartSLOduration=1.797608533 podStartE2EDuration="1.797608533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:02.79586144 +0000 UTC m=+2320.216635855" watchObservedRunningTime="2026-09-11 18:49:02.797608533 +0000 UTC m=+2320.218382935"
Sep 11 18:49:13.787130 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:49:13.787099    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6l7mm"
Sep 11 18:50:23.256334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:23.256306    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:50:23.269177 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:23.269151    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:50:50.281581 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.281502    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:50.284805 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.284774    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.287139 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.287115    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:50:50.287921 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.287899    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bqwkv\""
Sep 11 18:50:50.288419 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.288394    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 18:50:50.296721 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.296696    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:50.327966 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.327926    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.328143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.328076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhnws\" (UniqueName: \"kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.328143 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.328121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.328262 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.328156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.428702 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.428671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.428702 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.428708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.428959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.428831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.429022 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.428989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhnws\" (UniqueName: \"kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.429461 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.429434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.431121 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.431103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.431243 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.431222    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.438926 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.438906    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhnws\" (UniqueName: \"kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws\") pod \"maas-api-56d545b69f-8xp6t\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") " pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.595394 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.595304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:50.876194 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.876164    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:50.878276 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:50:50.878248    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163b595e_23f5_4be5_b1a3_cd2fd15e55a1.slice/crio-54bc210364b30ebe81096f8c493e8166aaff76d0b56580807b663c63f4a102c5 WatchSource:0}: Error finding container 54bc210364b30ebe81096f8c493e8166aaff76d0b56580807b663c63f4a102c5: Status 404 returned error can't find the container with id 54bc210364b30ebe81096f8c493e8166aaff76d0b56580807b663c63f4a102c5
Sep 11 18:50:50.879567 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:50.879545    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:50:51.371833 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:51.371798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" event={"ID":"163b595e-23f5-4be5-b1a3-cd2fd15e55a1","Type":"ContainerStarted","Data":"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"}
Sep 11 18:50:51.372204 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:51.371859    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" event={"ID":"163b595e-23f5-4be5-b1a3-cd2fd15e55a1","Type":"ContainerStarted","Data":"54bc210364b30ebe81096f8c493e8166aaff76d0b56580807b663c63f4a102c5"}
Sep 11 18:50:51.372204 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:51.371938    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:51.394369 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:51.394311    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" podStartSLOduration=0.989895079 podStartE2EDuration="1.394295243s" totalImagesPullingTime="404.400164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:51.392884805 +0000 UTC m=+2428.813659209" watchObservedRunningTime="2026-09-11 18:50:51.394295243 +0000 UTC m=+2428.815069646"
Sep 11 18:50:57.382392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.382364    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:57.489886 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.489852    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:57.490072 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.490031    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" podUID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" containerName="maas-api" containerID="cri-o://37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b" gracePeriod=30
Sep 11 18:50:57.521305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.521272    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"]
Sep 11 18:50:57.524586 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.524569    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.535883 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.535857    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"]
Sep 11 18:50:57.585696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.585665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-metrics-certs\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.585696 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.585699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-maas-api-tls\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.585919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.585718    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-286tl\" (UniqueName: \"kubernetes.io/projected/00a066ff-2d67-4a26-b2d1-1bec630c1407-kube-api-access-286tl\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.585919 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.585766    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00a066ff-2d67-4a26-b2d1-1bec630c1407-openshift-service-ca\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.687123 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.687092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-metrics-certs\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.687299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.687133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-maas-api-tls\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.687299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.687166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-286tl\" (UniqueName: \"kubernetes.io/projected/00a066ff-2d67-4a26-b2d1-1bec630c1407-kube-api-access-286tl\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.687299 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.687201    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00a066ff-2d67-4a26-b2d1-1bec630c1407-openshift-service-ca\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.687978 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.687927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00a066ff-2d67-4a26-b2d1-1bec630c1407-openshift-service-ca\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.690132 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.690106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-metrics-certs\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.690569 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.690548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00a066ff-2d67-4a26-b2d1-1bec630c1407-maas-api-tls\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.695302 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.695259    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-286tl\" (UniqueName: \"kubernetes.io/projected/00a066ff-2d67-4a26-b2d1-1bec630c1407-kube-api-access-286tl\") pod \"maas-api-dc4fd4b7f-xl85b\" (UID: \"00a066ff-2d67-4a26-b2d1-1bec630c1407\") " pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.740592 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.740572    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:57.788113 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.788073    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls\") pod \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") "
Sep 11 18:50:57.788280 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.788193    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhnws\" (UniqueName: \"kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws\") pod \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") "
Sep 11 18:50:57.788331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.788285    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca\") pod \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") "
Sep 11 18:50:57.788331 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.788311    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs\") pod \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\" (UID: \"163b595e-23f5-4be5-b1a3-cd2fd15e55a1\") "
Sep 11 18:50:57.788649 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.788625    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "163b595e-23f5-4be5-b1a3-cd2fd15e55a1" (UID: "163b595e-23f5-4be5-b1a3-cd2fd15e55a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:57.790264 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.790233    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws" (OuterVolumeSpecName: "kube-api-access-vhnws") pod "163b595e-23f5-4be5-b1a3-cd2fd15e55a1" (UID: "163b595e-23f5-4be5-b1a3-cd2fd15e55a1"). InnerVolumeSpecName "kube-api-access-vhnws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:57.790364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.790262    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "163b595e-23f5-4be5-b1a3-cd2fd15e55a1" (UID: "163b595e-23f5-4be5-b1a3-cd2fd15e55a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:57.790364 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.790292    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "163b595e-23f5-4be5-b1a3-cd2fd15e55a1" (UID: "163b595e-23f5-4be5-b1a3-cd2fd15e55a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:57.862537 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.862495    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:57.889147 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.889116    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-maas-api-tls\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:50:57.889147 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.889147    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhnws\" (UniqueName: \"kubernetes.io/projected/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-kube-api-access-vhnws\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:50:57.889313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.889162    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-openshift-service-ca\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:50:57.889313 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:57.889175    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/163b595e-23f5-4be5-b1a3-cd2fd15e55a1-metrics-certs\") on node \"ip-10-0-131-186.ec2.internal\" DevicePath \"\""
Sep 11 18:50:58.134845 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.134817    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"]
Sep 11 18:50:58.136680 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:50:58.136653    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a066ff_2d67_4a26_b2d1_1bec630c1407.slice/crio-ab5bb8be3589ac37bc2df97d3406e6c0e1903af23c32dbaab6ad2e7711d4965e WatchSource:0}: Error finding container ab5bb8be3589ac37bc2df97d3406e6c0e1903af23c32dbaab6ad2e7711d4965e: Status 404 returned error can't find the container with id ab5bb8be3589ac37bc2df97d3406e6c0e1903af23c32dbaab6ad2e7711d4965e
Sep 11 18:50:58.411769 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.411732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b" event={"ID":"00a066ff-2d67-4a26-b2d1-1bec630c1407","Type":"ContainerStarted","Data":"ab5bb8be3589ac37bc2df97d3406e6c0e1903af23c32dbaab6ad2e7711d4965e"}
Sep 11 18:50:58.412991 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.412958    2566 generic.go:356] "Generic (PLEG): container finished" podID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" containerID="37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b" exitCode=0
Sep 11 18:50:58.413115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.413003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" event={"ID":"163b595e-23f5-4be5-b1a3-cd2fd15e55a1","Type":"ContainerDied","Data":"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"}
Sep 11 18:50:58.413115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.413041    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t" event={"ID":"163b595e-23f5-4be5-b1a3-cd2fd15e55a1","Type":"ContainerDied","Data":"54bc210364b30ebe81096f8c493e8166aaff76d0b56580807b663c63f4a102c5"}
Sep 11 18:50:58.413115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.413070    2566 scope.go:117] "RemoveContainer" containerID="37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"
Sep 11 18:50:58.413115 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.413005    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"
Sep 11 18:50:58.422618 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.422602    2566 scope.go:117] "RemoveContainer" containerID="37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"
Sep 11 18:50:58.423007 ip-10-0-131-186 kubenswrapper[2566]: E0911 18:50:58.422988    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b\": container with ID starting with 37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b not found: ID does not exist" containerID="37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"
Sep 11 18:50:58.423071 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.423015    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b"} err="failed to get container status \"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b\": rpc error: code = NotFound desc = could not find container \"37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b\": container with ID starting with 37208486f35dc36ce8bf48b0322a66982895814f216ab22cf6b554690cd4523b not found: ID does not exist"
Sep 11 18:50:58.433965 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.433942    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:58.441638 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:58.441617    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d545b69f-8xp6t"]
Sep 11 18:50:59.061218 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:59.061186    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" path="/var/lib/kubelet/pods/163b595e-23f5-4be5-b1a3-cd2fd15e55a1/volumes"
Sep 11 18:50:59.421271 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:59.421239    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b" event={"ID":"00a066ff-2d67-4a26-b2d1-1bec630c1407","Type":"ContainerStarted","Data":"18eced5c9992cf3c3c0caadc5b6af2095f71f82a6e1753fd68fc7da69f3b61f1"}
Sep 11 18:50:59.421711 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:59.421375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:50:59.441354 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:50:59.441307    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b" podStartSLOduration=2.037706394 podStartE2EDuration="2.441292276s" totalImagesPullingTime="403.585882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:59.438520049 +0000 UTC m=+2436.859294452" watchObservedRunningTime="2026-09-11 18:50:59.441292276 +0000 UTC m=+2436.862066672"
Sep 11 18:51:05.438695 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:05.438667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dc4fd4b7f-xl85b"
Sep 11 18:51:25.252885 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:25.252848    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-l4pxm_87bd9c00-842d-4074-a12b-0561a3ad88cb/manager/0.log"
Sep 11 18:51:25.844927 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:25.844897    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-657fcdcb9c-4ldmz_e7ffce3e-9f5c-4f48-9940-36347658e031/copy-manifests/0.log"
Sep 11 18:51:25.856778 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:25.856751    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-657fcdcb9c-4ldmz_e7ffce3e-9f5c-4f48-9940-36347658e031/manager/0.log"
Sep 11 18:51:26.527078 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:26.527049    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dc4fd4b7f-xl85b_00a066ff-2d67-4a26-b2d1-1bec630c1407/maas-api/0.log"
Sep 11 18:51:26.849042 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:26.848966    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-swmbj_d63494c8-a964-4447-99d5-2281452a4c16/postgres/0.log"
Sep 11 18:51:27.853438 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:27.853393    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-smssk_63221dd1-0a26-464d-ac9f-0dec7e26dacd/manager/0.log"
Sep 11 18:51:28.090127 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:28.090073    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6l7mm_fffa07aa-f687-4323-9805-823d9dbec68f/manager/0.log"
Sep 11 18:51:28.309440 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:28.309398    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-scr78_da42e5cd-97fa-4d8b-9e2e-8c5441294bd4/manager/0.log"
Sep 11 18:51:28.642079 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:28.641989    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t_10416f8c-aa48-4441-a5e3-09be19421c9d/istio-proxy/0.log"
Sep 11 18:51:28.757035 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:28.757009    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hrqmq_604ab746-436f-4c83-b54b-de12b3e9691b/discovery/0.log"
Sep 11 18:51:28.868028 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:28.867998    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b485767cb-hczf6_b9b7dc50-ab41-42aa-8d2d-404c6449c511/kube-auth-proxy/0.log"
Sep 11 18:51:29.201398 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:29.201368    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-h866m_a271417a-8a33-4956-b0c7-7f4bb821f0f1/payload-pre-processing/0.log"
Sep 11 18:51:29.426256 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:29.426229    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b84465d6d-lbgjn_d22f2142-ad4d-49f3-aa6e-17bd4788f50a/router/0.log"
Sep 11 18:51:29.744719 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:29.744690    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pxzrz_d1f959a5-3166-4c52-a9c8-d87943a79c5f/main/0.log"
Sep 11 18:51:30.070743 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:30.070671    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qjwrf_f8df2ee0-56e3-4b10-996a-72a5048d1e7a/main/0.log"
Sep 11 18:51:38.778305 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:38.778276    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k2nk7_d1eb9695-39ad-4a0a-b15d-b0ff8283af6c/global-pull-secret-syncer/0.log"
Sep 11 18:51:38.873005 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:38.872976    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-glzd4_ee6e557e-06e1-4070-9103-d3f635df8d2f/konnectivity-agent/0.log"
Sep 11 18:51:38.935170 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:38.935143    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-186.ec2.internal_44737a15fc3a4f6f2edf4c5240f6b8ab/haproxy/0.log"
Sep 11 18:51:43.298772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:43.298740    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-smssk_63221dd1-0a26-464d-ac9f-0dec7e26dacd/manager/0.log"
Sep 11 18:51:43.366737 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:43.366702    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6l7mm_fffa07aa-f687-4323-9805-823d9dbec68f/manager/0.log"
Sep 11 18:51:43.442319 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:43.442281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-scr78_da42e5cd-97fa-4d8b-9e2e-8c5441294bd4/manager/0.log"
Sep 11 18:51:44.968810 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:44.968760    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/alertmanager/0.log"
Sep 11 18:51:44.992932 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:44.992907    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/config-reloader/0.log"
Sep 11 18:51:45.014895 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.014867    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/kube-rbac-proxy-web/0.log"
Sep 11 18:51:45.038450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.038419    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/kube-rbac-proxy/0.log"
Sep 11 18:51:45.065881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.065848    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/kube-rbac-proxy-metric/0.log"
Sep 11 18:51:45.089450 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.089426    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/prom-label-proxy/0.log"
Sep 11 18:51:45.117269 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.117246    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba24df90-04bb-4ed9-ab27-11e816ba5b2c/init-config-reloader/0.log"
Sep 11 18:51:45.276001 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.275916    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bf678549f-l62qs_a48f6674-31fe-4699-a4cb-68fe0b401285/metrics-server/0.log"
Sep 11 18:51:45.308135 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.308109    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-gjmqp_6d25f6a7-69b9-45a6-b4e8-b69546d7c644/monitoring-plugin/0.log"
Sep 11 18:51:45.433334 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.433305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xk4fl_0df16cc1-41f4-432e-b11e-cb991e4d2281/node-exporter/0.log"
Sep 11 18:51:45.457126 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.457099    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xk4fl_0df16cc1-41f4-432e-b11e-cb991e4d2281/kube-rbac-proxy/0.log"
Sep 11 18:51:45.480772 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.480749    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xk4fl_0df16cc1-41f4-432e-b11e-cb991e4d2281/init-textfile/0.log"
Sep 11 18:51:45.914732 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.914701    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rqctp_ca13b8e6-e9fd-4407-a4e6-43d23fa5f128/prometheus-operator/0.log"
Sep 11 18:51:45.952648 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.952619    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rqctp_ca13b8e6-e9fd-4407-a4e6-43d23fa5f128/kube-rbac-proxy/0.log"
Sep 11 18:51:45.980857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:45.980834    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-rzxnx_8dbbcdcc-bc64-4f5f-8ec8-789d8f33bd94/prometheus-operator-admission-webhook/0.log"
Sep 11 18:51:47.851076 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:47.851048    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-xpkhl_5dcf4200-df6a-4eb0-9e80-b41e1bdc983b/networking-console-plugin/0.log"
Sep 11 18:51:48.535849 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.535822    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/1.log"
Sep 11 18:51:48.540536 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.540513    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-gg2k4_6913903e-bea1-4103-9780-0b879b4a004d/console-operator/2.log"
Sep 11 18:51:48.876959 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.876871    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"]
Sep 11 18:51:48.877392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.877288    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" containerName="maas-api"
Sep 11 18:51:48.877392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.877301    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" containerName="maas-api"
Sep 11 18:51:48.877392 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.877377    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="163b595e-23f5-4be5-b1a3-cd2fd15e55a1" containerName="maas-api"
Sep 11 18:51:48.880662 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.880643    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:48.883037 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.882959    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rt2b\"/\"kube-root-ca.crt\""
Sep 11 18:51:48.883149 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.883077    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rt2b\"/\"openshift-service-ca.crt\""
Sep 11 18:51:48.883149 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.883091    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8rt2b\"/\"default-dockercfg-65ww9\""
Sep 11 18:51:48.895444 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.895420    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"]
Sep 11 18:51:48.957483 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.957449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-lib-modules\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:48.957641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.957495    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-podres\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:48.957641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.957520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-proc\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:48.957641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.957576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-sys\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:48.957761 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:48.957677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckvf\" (UniqueName: \"kubernetes.io/projected/0007023d-630c-4dfa-8785-edd06cca2edf-kube-api-access-bckvf\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058099 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058066    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bckvf\" (UniqueName: \"kubernetes.io/projected/0007023d-630c-4dfa-8785-edd06cca2edf-kube-api-access-bckvf\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-lib-modules\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058155    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-podres\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-proc\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058272 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-sys\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058472 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-lib-modules\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058472 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-sys\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058472 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058302    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-proc\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.058472 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.058310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0007023d-630c-4dfa-8785-edd06cca2edf-podres\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.068014 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.067987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckvf\" (UniqueName: \"kubernetes.io/projected/0007023d-630c-4dfa-8785-edd06cca2edf-kube-api-access-bckvf\") pod \"perf-node-gather-daemonset-g5wgl\" (UID: \"0007023d-630c-4dfa-8785-edd06cca2edf\") " pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.162260 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.162189    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-669cb74fb8-m2q7v_3d0ea0e4-fd97-4729-85f5-fec09a6a27ec/console/0.log"
Sep 11 18:51:49.190055 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.190029    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.205315 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.205292    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-7qqqh_03eb6d06-5c71-468d-a646-4a4b6eb18e54/download-server/0.log"
Sep 11 18:51:49.470271 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.470243    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"]
Sep 11 18:51:49.472028 ip-10-0-131-186 kubenswrapper[2566]: W0911 18:51:49.471998    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0007023d_630c_4dfa_8785_edd06cca2edf.slice/crio-a389e96d3a1b96f2255cbc60cdb335ae5fbaf286f128a96a3c7a0e08545abf3b WatchSource:0}: Error finding container a389e96d3a1b96f2255cbc60cdb335ae5fbaf286f128a96a3c7a0e08545abf3b: Status 404 returned error can't find the container with id a389e96d3a1b96f2255cbc60cdb335ae5fbaf286f128a96a3c7a0e08545abf3b
Sep 11 18:51:49.703671 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.703631    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl" event={"ID":"0007023d-630c-4dfa-8785-edd06cca2edf","Type":"ContainerStarted","Data":"956f60497a00553d520848bd87fbca205b08ec33febbc84adfed4eccef4540ef"}
Sep 11 18:51:49.703869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.703696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl" event={"ID":"0007023d-630c-4dfa-8785-edd06cca2edf","Type":"ContainerStarted","Data":"a389e96d3a1b96f2255cbc60cdb335ae5fbaf286f128a96a3c7a0e08545abf3b"}
Sep 11 18:51:49.703869 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.703826    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:49.721205 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:49.721127    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl" podStartSLOduration=1.721113364 podStartE2EDuration="1.721113364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:51:49.718559225 +0000 UTC m=+2487.139333650" watchObservedRunningTime="2026-09-11 18:51:49.721113364 +0000 UTC m=+2487.141887814"
Sep 11 18:51:51.152290 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:51.152260    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxq2x_f1e30d6f-b96e-4ca3-966e-a320f5155356/dns/0.log"
Sep 11 18:51:51.175511 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:51.175483    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxq2x_f1e30d6f-b96e-4ca3-966e-a320f5155356/kube-rbac-proxy/0.log"
Sep 11 18:51:51.228239 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:51.228207    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmrk8_bb61546a-127f-4a22-b9de-e233a1307427/dns-node-resolver/0.log"
Sep 11 18:51:51.836490 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:51.836462    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8svnl_2dd093e6-fb9a-4a65-a98d-901dc9654778/node-ca/0.log"
Sep 11 18:51:52.829857 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:52.829802    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t_10416f8c-aa48-4441-a5e3-09be19421c9d/istio-proxy/0.log"
Sep 11 18:51:53.219199 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:53.219170    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hrqmq_604ab746-436f-4c83-b54b-de12b3e9691b/discovery/0.log"
Sep 11 18:51:53.243617 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:53.243591    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b485767cb-hczf6_b9b7dc50-ab41-42aa-8d2d-404c6449c511/kube-auth-proxy/0.log"
Sep 11 18:51:53.343641 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:53.343613    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-h866m_a271417a-8a33-4956-b0c7-7f4bb821f0f1/payload-pre-processing/0.log"
Sep 11 18:51:53.410897 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:53.410865    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b84465d6d-lbgjn_d22f2142-ad4d-49f3-aa6e-17bd4788f50a/router/0.log"
Sep 11 18:51:54.361049 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:54.361015    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6llzx_f27b1187-c3bf-4233-8b02-7342ed2a138b/serve-healthcheck-canary/0.log"
Sep 11 18:51:55.095881 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:55.095825    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9cpq_21223870-c5d7-4bfa-b015-c94211e0abdc/kube-rbac-proxy/0.log"
Sep 11 18:51:55.118358 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:55.118333    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9cpq_21223870-c5d7-4bfa-b015-c94211e0abdc/exporter/0.log"
Sep 11 18:51:55.143062 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:55.143036    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9cpq_21223870-c5d7-4bfa-b015-c94211e0abdc/extractor/0.log"
Sep 11 18:51:55.718766 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:55.718738    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8rt2b/perf-node-gather-daemonset-g5wgl"
Sep 11 18:51:57.445630 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:57.445607    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-l4pxm_87bd9c00-842d-4074-a12b-0561a3ad88cb/manager/0.log"
Sep 11 18:51:58.250502 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:58.250472    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-657fcdcb9c-4ldmz_e7ffce3e-9f5c-4f48-9940-36347658e031/manager/0.log"
Sep 11 18:51:58.270819 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:58.270777    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-657fcdcb9c-4ldmz_e7ffce3e-9f5c-4f48-9940-36347658e031/copy-manifests/0.log"
Sep 11 18:51:58.962935 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:58.962898    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t_10416f8c-aa48-4441-a5e3-09be19421c9d/istio-proxy/0.log"
Sep 11 18:51:59.348658 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:59.348620    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hrqmq_604ab746-436f-4c83-b54b-de12b3e9691b/discovery/0.log"
Sep 11 18:51:59.360365 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:59.360339    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b485767cb-hczf6_b9b7dc50-ab41-42aa-8d2d-404c6449c511/kube-auth-proxy/0.log"
Sep 11 18:51:59.423503 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:59.423455    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-h866m_a271417a-8a33-4956-b0c7-7f4bb821f0f1/payload-pre-processing/0.log"
Sep 11 18:51:59.473148 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:51:59.473122    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b84465d6d-lbgjn_d22f2142-ad4d-49f3-aa6e-17bd4788f50a/router/0.log"
Sep 11 18:52:00.988248 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:00.988215    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t_10416f8c-aa48-4441-a5e3-09be19421c9d/istio-proxy/0.log"
Sep 11 18:52:01.392683 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:01.392651    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hrqmq_604ab746-436f-4c83-b54b-de12b3e9691b/discovery/0.log"
Sep 11 18:52:01.414670 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:01.414642    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b485767cb-hczf6_b9b7dc50-ab41-42aa-8d2d-404c6449c511/kube-auth-proxy/0.log"
Sep 11 18:52:01.475882 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:01.475858    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-h866m_a271417a-8a33-4956-b0c7-7f4bb821f0f1/payload-pre-processing/0.log"
Sep 11 18:52:01.522008 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:01.521977    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b84465d6d-lbgjn_d22f2142-ad4d-49f3-aa6e-17bd4788f50a/router/0.log"
Sep 11 18:52:04.858614 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:04.858587    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t4cdd_c8058597-eb60-4ca4-a601-f3fca5984491/migrator/0.log"
Sep 11 18:52:04.883771 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:04.883702    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-t4cdd_c8058597-eb60-4ca4-a601-f3fca5984491/graceful-termination/0.log"
Sep 11 18:52:06.658215 ip-10-0-131-186 kubenswrapper[2566]: I0911 18:52:06.658182    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q5f4t_a51e2dc1-3280-48a0-91c3-e8827fdbc3e0/kube-multus-additional-cni-plugins/0.log"