Jul 12 15:07:56.111150 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 12 15:07:56.111159 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 12 15:07:56.111167 ip-10-0-138-45 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 12 15:07:56.111452 ip-10-0-138-45 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 12 15:08:06.168232 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 12 15:08:06.168254 ip-10-0-138-45 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 96409dbe358e4ca2a85aa39bfef4ffb6 --
Jul 12 15:09:57.126431 ip-10-0-138-45 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.471880    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477102    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477122    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477125    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477129    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477132    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477137    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477142    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:58.729868 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477145    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:58.720255 ip-10-0-138-45 systemd[1]: Started Kubernetes Kubelet.
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477149    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477152    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477155    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477158    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477160    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477163    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477165    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477168    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477171    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477174    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477176    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477179    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477181    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477184    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477187    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477189    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477192    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477194    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477196    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:58.731467 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477200    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477203    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477205    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477211    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477214    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477217    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477219    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477222    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477225    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477227    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477230    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477233    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477235    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477239    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477241    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477243    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477246    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477248    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477252    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477257    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:58.733985 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477260    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477263    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477266    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477274    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477277    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477280    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477283    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477286    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477289    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477291    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477294    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477296    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477299    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477302    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477304    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477307    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477309    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477312    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477314    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:58.735154 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477317    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477319    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477321    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477324    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477327    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477330    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477333    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477335    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477339    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477341    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477344    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477346    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477350    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477353    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477355    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477358    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477361    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477370    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477373    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477376    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:58.736726 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477378    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477381    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477384    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477389    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477392    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477394    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477397    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477400    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477402    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477405    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477407    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477411    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.477417    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478227    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478235    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478237    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478240    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478244    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478247    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:58.737743 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478249    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478252    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478255    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478257    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478260    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478262    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478265    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478271    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478275    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478278    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478281    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478291    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478293    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478296    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478299    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478302    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478304    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478307    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478310    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:58.886845 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478312    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478315    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478318    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478320    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478323    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478325    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478328    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478331    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478334    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478336    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478339    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478341    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478344    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478346    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478349    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478351    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478353    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478356    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478359    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478362    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:58.904359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478365    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478368    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478371    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478373    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478377    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478386    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478389    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478391    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478394    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478397    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478399    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478402    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478404    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478406    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478409    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478412    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478414    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478417    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478419    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:58.905354 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478422    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478424    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478427    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478429    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478432    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478434    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478437    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478439    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478442    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478444    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478447    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478450    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478453    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478455    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478458    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478460    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478464    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478466    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478469    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478479    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:58.906164 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478545    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478549    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478553    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478555    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478558    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478577    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478580    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478583    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478585    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478588    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478783    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478786    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478789    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478791    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.478989    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481002    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481011    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481015    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481018    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:58.906775 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481021    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481024    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481027    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481031    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481034    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481038    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481041    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481062    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481066    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481069    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481071    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481074    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481085    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481088    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481093    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481097    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481100    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481104    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481106    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:58.907415 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481110    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481113    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481115    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481118    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481121    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481123    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481126    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481128    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481131    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481133    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481136    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481138    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481141    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481143    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481146    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481149    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481152    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481155    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481157    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:58.908077 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481160    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481163    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481167    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481171    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481174    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481177    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481179    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481188    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481193    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481195    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481198    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481201    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481204    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481206    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481208    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481211    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481214    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481217    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481220    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:58.908721 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481222    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481225    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481227    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481230    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481233    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481236    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481238    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481241    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481244    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481246    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481249    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481252    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481254    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481257    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481260    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481262    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481264    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481267    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481269    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481272    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:58.909258 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481274    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481282    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481285    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481287    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481290    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481293    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481295    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481298    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481302    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481305    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481307    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481310    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481313    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481315    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481318    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481321    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481323    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.481326    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481404    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481413    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481426    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 15:09:58.909834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481431    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481436    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481439    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481444    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481448    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481451    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481455    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481458    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481462    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481465    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481468    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481471    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481476    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481479    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481483    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481488    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481491    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481494    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481497    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481502    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481506    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481509    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481512    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 15:09:58.910421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481516    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481519    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481522    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481525    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481528    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481531    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481535    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481538    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481541    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481544    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481547    2566 flags.go:64] FLAG: --enable-server="true"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481550    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481554    2566 flags.go:64] FLAG: --event-burst="100"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481557    2566 flags.go:64] FLAG: --event-qps="50"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481560    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481563    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481566    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481571    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481574    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481576    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481579    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481583    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481586    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481590    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481593    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 15:09:58.911089 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481596    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481599    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481602    2566 flags.go:64] FLAG: --feature-gates=""
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481607    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481610    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481613    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481616    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481619    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481622    2566 flags.go:64] FLAG: --help="false"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481625    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481628    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481631    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481634    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481637    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481641    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481643    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481646    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481649    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481652    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481655    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481659    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481661    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481665    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481667    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 15:09:58.911777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481671    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481673    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481676    2566 flags.go:64] FLAG: --lock-file=""
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481679    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481683    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481687    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481692    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481696    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481699    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481701    2566 flags.go:64] FLAG: --logging-format="text"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481705    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481709    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481712    2566 flags.go:64] FLAG: --manifest-url=""
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481714    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481719    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481722    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481726    2566 flags.go:64] FLAG: --max-pods="110"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481729    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481732    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481735    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481738    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481741    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481744    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481747    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481755    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 15:09:58.912535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481758    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481761    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481764    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481767    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481773    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481776    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481779    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481782    2566 flags.go:64] FLAG: --port="10250"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481785    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481788    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a75507bf3ad20439"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481792    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481795    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481801    2566 flags.go:64] FLAG: --register-node="true"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481804    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481808    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481811    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481814    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481817    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481829    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481832    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481835    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481839    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481841    2566 flags.go:64] FLAG: --runonce="false"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481844    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481847    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 15:09:58.913319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481850    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481853    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481856    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481859    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481862    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481865    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481868    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481871    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481874    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481878    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481880    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481883    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481886    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481891    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481894    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481897    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481902    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481905    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481908    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481912    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481915    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481918    2566 flags.go:64] FLAG: --v="2"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481922    2566 flags.go:64] FLAG: --version="false"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481927    2566 flags.go:64] FLAG: --vmodule=""
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481931    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 15:09:58.914077 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.481935    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482091    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482097    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482100    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482103    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482105    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482108    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482111    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482114    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482116    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482119    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482121    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482124    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482126    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482129    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482132    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482134    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482137    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482140    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482142    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:58.914981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482144    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482147    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482150    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482152    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482155    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482157    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482161    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482164    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482167    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482170    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482173    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482176    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482181    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482183    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482186    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482189    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482193    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482196    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482199    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:58.918191 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482202    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482205    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482209    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482212    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482215    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482218    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482220    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482223    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482226    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482228    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482231    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482235    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482239    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482243    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482246    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482249    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482252    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482255    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482257    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:58.921497 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482261    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482264    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482267    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482269    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482272    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482275    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482280    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482283    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482286    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482288    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482291    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482293    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482296    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482299    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482301    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482304    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482306    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482309    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482312    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482315    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:58.922193 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482317    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482319    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482322    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482325    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482327    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482330    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482333    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482335    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482338    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482341    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482343    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482346    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482351    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482353    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482356    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482359    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482362    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482364    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482368    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482371    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:59.085071 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482374    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.482376    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.482386    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.489870    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.489894    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.490537    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.490549    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490622    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490628    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490632    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490635    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490639    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490642    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490646    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490649    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:59.085804 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490652    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490655    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490659    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490662    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490665    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490668    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490671    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490674    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490676    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490679    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490682    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490685    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490688    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490690    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490693    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490697    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490701    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490703    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490706    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490708    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:59.086301 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490711    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490714    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490716    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490719    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490722    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490724    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490727    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490730    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490733    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490735    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490738    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490740    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490743    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490746    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490752    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490754    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490757    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490760    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490763    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:59.086882 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490767    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490771    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490775    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490778    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490781    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490784    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490786    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490789    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490792    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490795    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490799    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490802    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490804    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490807    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490809    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490812    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490814    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490817    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490819    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:59.087475 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490822    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490825    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490827    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490829    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490832    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490835    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490838    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490840    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490844    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490847    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490850    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490854    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490857    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490860    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490863    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490867    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490870    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490873    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490875    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:59.088045 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490880    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490884    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490887    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490889    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490892    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490896    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490898    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490901    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490903    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490906    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490909    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490911    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490914    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.490916    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.490922    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:09:59.088560 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491059    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491065    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491068    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491071    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491073    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491076    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491081    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491086    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491089    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491092    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491095    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491099    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491102    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491105    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491111    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491114    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491117    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491120    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491123    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:09:59.089036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491126    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491128    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491131    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491134    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491146    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491149    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491152    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491154    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491157    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491160    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491162    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491165    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491168    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491170    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491173    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491176    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491178    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491181    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491183    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491187    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:09:59.089544 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491190    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491192    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491196    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491199    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491202    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491205    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491208    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491212    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491215    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491219    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491222    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491225    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491228    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491230    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491233    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491235    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491238    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491241    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491244    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:09:59.090124 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491246    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491249    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491252    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491255    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491257    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491260    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491263    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491266    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491268    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491271    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491274    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491276    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491280    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491283    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491285    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491288    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491291    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491294    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491296    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491299    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:09:59.090633 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491303    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491306    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491308    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491311    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491313    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491316    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491319    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491321    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491324    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491326    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491329    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491332    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491335    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491338    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491341    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491343    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491346    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491349    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491352    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:09:59.091212 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491354    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:57.491356    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.491362    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.491500    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.493808    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.495139    2566 server.go:1019] "Starting client certificate rotation"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.495258    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.495304    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.497454    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.499622    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.507161    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.510452    2566 log.go:25] "Validated CRI v1 image API"
Jul 12 15:09:59.091717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.511207    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 15:09:59.092111 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.513462    2566 fs.go:135] Filesystem UUIDs: map[242470d5-f398-4c25-930c-be9fed28ccbd:/dev/nvme0n1p4 6ffd1661-0fab-40ca-9cbc-1b21dd0fd56d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 12 15:09:59.092111 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.513479    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.519443    2566 manager.go:216] Machine: {Timestamp:2026-07-12 15:09:57.518256977 +0000 UTC m=+0.287422361 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099486 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c75fb3a9bdd1b06d62311a830cf01 SystemUUID:ec2c75fb-3a9b-dd1b-06d6-2311a830cf01 BootID:96409dbe-358e-4ca2-a85a-a39bfef4ffb6 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:3f:d3:e5:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:3f:d3:e5:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:bb:e0:fe:ae:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.519563    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:57.519671    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.703145    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.703354    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.703388    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.704079    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.704090    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.704098    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.705257    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.706194    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710237    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710396    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710428    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710441    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710457    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 15:09:59.092281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710467    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710478    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710815    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.710829    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.712857    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.714337    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.714366    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715021    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715035    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715042    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715047    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715056    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715062    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715070    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715075    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715082    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715087    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715102    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715107    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715923    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.715931    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.719174    2566 server.go:1268] "Started kubelet"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.719274    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.719403    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.719470    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.721615    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.722469    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.722583    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.723871    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.724045    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.725998    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.725886    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-45.ec2.internal.18c193672a7c71ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-45.ec2.internal,UID:ip-10-0-138-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-45.ec2.internal,},FirstTimestamp:2026-07-12 15:09:58.719140298 +0000 UTC m=+0.307442958,LastTimestamp:2026-07-12 15:09:58.719140298 +0000 UTC m=+0.307442958,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-45.ec2.internal,}"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.728682    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.728685    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.728773    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729276    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729279    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729303    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729388    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729400    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729596    2566 factory.go:55] Registering systemd factory
Jul 12 15:09:59.092761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729613    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729900    2566 factory.go:153] Registering CRI-O factory
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729927    2566 factory.go:223] Registration of the crio container factory successfully
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.729982    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.730015    2566 factory.go:103] Registering Raw factory
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.730029    2566 manager.go:1196] Started watching for new ooms in manager
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.731310    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.731628    2566 manager.go:349] Starting recovery of all containers
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.734659    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmbxq"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.734686    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmbxq"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.744516    2566 manager.go:354] Recovery completed
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.749267    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753133    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753165    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753176    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753737    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753747    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753766    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.753797    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.754418    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.754748    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.754779    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.754794    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.756144    2566 policy_none.go:49] "None policy: Start"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.756163    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.756178    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.761073    2566 policy_none.go:47] "Start"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.802671    2566 manager.go:337] "Starting Device Plugin manager"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.802709    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.802719    2566 server.go:87] "Starting device plugin registration server"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.803030    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.803042    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.803127    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.803225    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.803236    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.803850    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.803896    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.865235    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.866550    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.866595    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.866621    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.866664    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.871806    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.903929    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.905229    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.905269    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.905296    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.093928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.905333    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.910951    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.910979    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-45.ec2.internal\": node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:58.936259    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.967313    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"]
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.968055    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.969098    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.969125    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.969135    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.971432    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.971541    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.971569    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972265    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972281    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972290    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972301    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972302    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.972384    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.974606    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.974635    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.975514    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.975536    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:58.975548    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.000940    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.005643    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.031401    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/924e98b1f4b0eb6dc6bf4bc5f8376614-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"924e98b1f4b0eb6dc6bf4bc5f8376614\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.031431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.031461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.095223 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.037073    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132584    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/924e98b1f4b0eb6dc6bf4bc5f8376614-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"924e98b1f4b0eb6dc6bf4bc5f8376614\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132538    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/924e98b1f4b0eb6dc6bf4bc5f8376614-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"924e98b1f4b0eb6dc6bf4bc5f8376614\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132707    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.132732    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ccb2a77486a97d03d0373fe291e6d0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"0ccb2a77486a97d03d0373fe291e6d0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.139329    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.265505 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.240244    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.414556 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.304441    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.414556 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.309441    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:09:59.414556 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.340793    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.587895 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.441336    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.587895 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.541843    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.735366 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.619769    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:09:59.735366 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.642284    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.735366 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.675453    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 15:09:59.735366 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.675621    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 15:09:59.735366 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.675629    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 15:09:59.877568 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.741391    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 15:04:58 +0000 UTC" deadline="2028-04-01 02:45:22.789894794 +0000 UTC"
Jul 12 15:09:59.877568 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.741420    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15083h35m23.048478258s"
Jul 12 15:09:59.877568 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.742485    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:09:59.877568 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.843135    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:10:00.028156 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:09:59.944097    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:10:00.028156 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:59.982491    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924e98b1f4b0eb6dc6bf4bc5f8376614.slice/crio-2d92d93e17b09b429ff7b967b72a2eda0769d0ecbe47a9ab38ca8ca435871ee7 WatchSource:0}: Error finding container 2d92d93e17b09b429ff7b967b72a2eda0769d0ecbe47a9ab38ca8ca435871ee7: Status 404 returned error can't find the container with id 2d92d93e17b09b429ff7b967b72a2eda0769d0ecbe47a9ab38ca8ca435871ee7
Jul 12 15:10:00.028156 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:09:59.988578    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:10:00.028156 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:09:59.996469    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccb2a77486a97d03d0373fe291e6d0f.slice/crio-b2e3495efd30cd3d1199d4121d69576d7bde5f46bc867cddae85cc304301999b WatchSource:0}: Error finding container b2e3495efd30cd3d1199d4121d69576d7bde5f46bc867cddae85cc304301999b: Status 404 returned error can't find the container with id b2e3495efd30cd3d1199d4121d69576d7bde5f46bc867cddae85cc304301999b
Jul 12 15:10:00.195762 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.045057    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:10:00.195762 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.102372    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:10:00.195762 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.145467    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 12 15:10:00.195762 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.186807    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:10:00.379608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.229712    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 12 15:10:00.379608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.239994    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 15:10:00.379608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.240848    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 12 15:10:00.379608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.249290    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 15:10:00.711721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.711449    2566 apiserver.go:52] "Watching apiserver"
Jul 12 15:10:00.719319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.718891    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 15:10:00.720395 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.720361    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-66nfc","openshift-network-diagnostics/network-check-target-wx52h","openshift-network-operator/iptables-alerter-zl7r6","kube-system/konnectivity-agent-jtkbp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx","openshift-dns/node-resolver-j6tc7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal","openshift-multus/multus-8qnrn","openshift-multus/multus-additional-cni-plugins-tmtm7","openshift-ovn-kubernetes/ovnkube-node-bw7v4","kube-system/global-pull-secret-syncer-sf9rb","kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal","openshift-cluster-node-tuning-operator/tuned-76hfb","openshift-image-registry/node-ca-jhlnq"]
Jul 12 15:10:00.723013 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.722987    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.723156 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.723078    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:00.725408 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.725279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:00.725408 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.725361    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:00.728754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.728718    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.729841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.729523    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 15:10:00.731093 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.731068    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 15:10:00.731254 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.731234    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-676vg\""
Jul 12 15:10:00.731360 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.731335    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.731450 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.731430    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.731987 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.731616    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.733698 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.733645    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.734292 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.733832    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 15:10:00.734292 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.733946    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.734292 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.733992    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.734292 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.734161    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nlmgc\""
Jul 12 15:10:00.735836 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.735815    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.736450 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.736229    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xns4x\""
Jul 12 15:10:00.736450 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.736382    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.736610 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.736557    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.737054 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.736931    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 15:10:00.739730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.739100    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pcrpg\""
Jul 12 15:10:00.739730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.739118    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.739730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.739291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.739730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.739316    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.741999 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.740967    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 15:10:00.741999 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.741131    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 15:10:00.741999 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.741634    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.742586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-host\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.742586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-serviceca\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.742586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742543    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmncc\" (UniqueName: \"kubernetes.io/projected/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-kube-api-access-jmncc\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.742586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.742586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql4tk\" (UniqueName: \"kubernetes.io/projected/072e7fce-1980-4b06-bac5-d74a9c1ff062-kube-api-access-ql4tk\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742635    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-iptables-alerter-script\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-host-slash\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742693    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsnww\" (UniqueName: \"kubernetes.io/projected/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-kube-api-access-jsnww\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742787    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.742866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.742852    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.743570 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.743340    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 15:10:00.743664 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.743603    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5scgv\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.743928    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.744210    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.744543    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.744687    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.744811    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.745053    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 15:10:00.745286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.745063    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dl49k\""
Jul 12 15:10:00.745727 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.745326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.748943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.747465    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jv554\""
Jul 12 15:10:00.748943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.747693    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 15:10:00.748943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.747884    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 15:10:00.749987 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.749770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.749987 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.749849    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:00.752176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.751412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.753581 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.753560    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 15:10:00.754095 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.753897    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bdkd\""
Jul 12 15:10:00.754222 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.754207    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.754675 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.754649    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 15:10:00.756546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.756525    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 15:10:00.756743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.756726    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g9t68\""
Jul 12 15:10:00.757693 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.757678    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 15:10:00.764287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.764260    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c54sv"
Jul 12 15:10:00.771166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.771123    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c54sv"
Jul 12 15:10:00.831020 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.830970    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 15:10:00.843070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.842955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-k8s-cni-cncf-io\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.843070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.842987    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-os-release\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.843070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843014    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-netns\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.843070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-kubelet\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843096    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-etc-kubernetes\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843139    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-system-cni-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-kubelet-config\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cc54b52-fc61-4de7-a089-9b9937e543a7-hosts-file\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-kubelet\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843265    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843332    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-agent-certs\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-registration-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.843382 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.843380    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5rr\" (UniqueName: \"kubernetes.io/projected/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kube-api-access-qf5rr\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-kubernetes\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-bin\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.843484    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:01.343457676 +0000 UTC m=+2.931760326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-netd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843551    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-socket-dir-parent\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843600    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql4tk\" (UniqueName: \"kubernetes.io/projected/072e7fce-1980-4b06-bac5-d74a9c1ff062-kube-api-access-ql4tk\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.843754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843650    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-systemd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-cnibin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-netns\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-conf-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-cnibin\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843873    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-sys-fs\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.843981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844003    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-run\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-node-log\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.844092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844111    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gqv\" (UniqueName: \"kubernetes.io/projected/9cc54b52-fc61-4de7-a089-9b9937e543a7-kube-api-access-w7gqv\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsnww\" (UniqueName: \"kubernetes.io/projected/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-kube-api-access-jsnww\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844206    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-serviceca\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-host\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-tmp\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-dbus\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-log-socket\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-iptables-alerter-script\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysconfig\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-var-lib-kubelet\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-script-lib\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-hostroot\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-multus-certs\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-lib-modules\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.844559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844554    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-tuned\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-os-release\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-daemon-config\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844629    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-slash\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-env-overrides\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844690    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdgc\" (UniqueName: \"kubernetes.io/projected/d5ec9889-71dd-4db1-b58b-a13af72f5505-kube-api-access-7bdgc\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844714    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-bin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75kc\" (UniqueName: \"kubernetes.io/projected/bfe1207e-5c58-4dba-be20-84a62d4ac136-kube-api-access-g75kc\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-modprobe-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-systemd-units\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-etc-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844846    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-system-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-host-slash\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmncc\" (UniqueName: \"kubernetes.io/projected/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-kube-api-access-jmncc\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-serviceca\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-systemd\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.845324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.844987    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-var-lib-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845015    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845042    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-ovn\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845094    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845145    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-socket-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845192    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-conf\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-config\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845232    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovn-node-metrics-cert\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845265    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-multus\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-konnectivity-ca\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-host\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845345    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-device-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhx6\" (UniqueName: \"kubernetes.io/projected/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-kube-api-access-5lhx6\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.845933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-cni-binary-copy\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845398    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwnjg\" (UniqueName: \"kubernetes.io/projected/baea5b3f-7f02-4c1c-912d-428842eaabae-kube-api-access-vwnjg\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845425    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc54b52-fc61-4de7-a089-9b9937e543a7-tmp-dir\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-sys\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-iptables-alerter-script\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-host-slash\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.846668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.845861    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-host\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.852002 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.851971    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 15:10:00.852512 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.852489    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:00.852614 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.852519    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:00.852614 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.852535    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:00.852694 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.852616    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:01.352594662 +0000 UTC m=+2.940897333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:00.855874 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.855841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmncc\" (UniqueName: \"kubernetes.io/projected/3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2-kube-api-access-jmncc\") pod \"node-ca-jhlnq\" (UID: \"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2\") " pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:00.856034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.855841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsnww\" (UniqueName: \"kubernetes.io/projected/d3cc6573-6bf2-4447-8e9b-fb1db7175d8a-kube-api-access-jsnww\") pod \"iptables-alerter-zl7r6\" (UID: \"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a\") " pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:00.856034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.855854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql4tk\" (UniqueName: \"kubernetes.io/projected/072e7fce-1980-4b06-bac5-d74a9c1ff062-kube-api-access-ql4tk\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:00.871062 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.870938    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:10:00.876395 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.876308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"0ccb2a77486a97d03d0373fe291e6d0f","Type":"ContainerStarted","Data":"b2e3495efd30cd3d1199d4121d69576d7bde5f46bc867cddae85cc304301999b"}
Jul 12 15:10:00.877721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.877693    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" event={"ID":"924e98b1f4b0eb6dc6bf4bc5f8376614","Type":"ContainerStarted","Data":"2d92d93e17b09b429ff7b967b72a2eda0769d0ecbe47a9ab38ca8ca435871ee7"}
Jul 12 15:10:00.946328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-agent-certs\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.946328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-registration-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.946328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5rr\" (UniqueName: \"kubernetes.io/projected/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kube-api-access-qf5rr\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.946328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946327    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-kubernetes\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946395    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-kubernetes\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946409    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-registration-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-bin\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-netd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-socket-dir-parent\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-systemd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-bin\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-cnibin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-cni-netd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-netns\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946587    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-conf-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-systemd\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946607    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-socket-dir-parent\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.946634 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946623    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-cnibin\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-cnibin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-conf-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-cnibin\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946656    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-netns\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-sys-fs\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-sys-fs\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-run\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-node-log\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946827    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gqv\" (UniqueName: \"kubernetes.io/projected/9cc54b52-fc61-4de7-a089-9b9937e543a7-kube-api-access-w7gqv\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946865    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-run\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.946986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-host\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-tmp\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-dbus\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.947341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947066    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-log-socket\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947089    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysconfig\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-node-log\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-var-lib-kubelet\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947198    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-log-socket\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-var-lib-kubelet\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-script-lib\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947246    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-dbus\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-hostroot\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947265    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysconfig\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-multus-certs\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-host\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947341    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-hostroot\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947390    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-multus-certs\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947419    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-lib-modules\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947467    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-tuned\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.948217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-os-release\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-daemon-config\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-slash\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-env-overrides\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947585    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdgc\" (UniqueName: \"kubernetes.io/projected/d5ec9889-71dd-4db1-b58b-a13af72f5505-kube-api-access-7bdgc\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947609    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-bin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947636    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75kc\" (UniqueName: \"kubernetes.io/projected/bfe1207e-5c58-4dba-be20-84a62d4ac136-kube-api-access-g75kc\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947659    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-modprobe-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-systemd-units\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-etc-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-system-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947776    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-systemd\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947820    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-var-lib-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-ovn\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947899    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947960    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-socket-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-script-lib\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.947983    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948007    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-conf\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-config\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovn-node-metrics-cert\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948086    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-modprobe-d\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948119    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-multus\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-systemd-units\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948181    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-ovn\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-socket-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-sysctl-conf\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.949828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948690    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-lib-modules\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-konnectivity-ca\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-etc-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948819    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-system-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948861    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-systemd\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948899    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-var-lib-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-konnectivity-ca\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948934    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovnkube-config\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-device-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948988    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhx6\" (UniqueName: \"kubernetes.io/projected/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-kube-api-access-5lhx6\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949011    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-cni-binary-copy\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnjg\" (UniqueName: \"kubernetes.io/projected/baea5b3f-7f02-4c1c-912d-428842eaabae-kube-api-access-vwnjg\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949090    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc54b52-fc61-4de7-a089-9b9937e543a7-tmp-dir\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-sys\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-k8s-cni-cncf-io\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-os-release\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.950619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-netns\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-kubelet\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-etc-kubernetes\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-system-cni-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949283    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-kubelet-config\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-bin\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cc54b52-fc61-4de7-a089-9b9937e543a7-hosts-file\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5ec9889-71dd-4db1-b58b-a13af72f5505-env-overrides\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949347    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-kubelet\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949373    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949397    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-cni-dir\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.948072    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-run-openvswitch\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949550    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-device-dir\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-cni-multus\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-run-netns\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.951487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949798    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-var-lib-kubelet\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-etc-kubernetes\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949876    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-system-cni-dir\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949941    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-kubelet-config\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-multus-daemon-config\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.949987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cc54b52-fc61-4de7-a089-9b9937e543a7-hosts-file\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-slash\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950056    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-os-release\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950097    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ec9889-71dd-4db1-b58b-a13af72f5505-host-kubelet\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950126    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfe1207e-5c58-4dba-be20-84a62d4ac136-cni-binary-copy\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-tmp\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-sys\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfe1207e-5c58-4dba-be20-84a62d4ac136-host-run-k8s-cni-cncf-io\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.950369    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:00.950426    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:01.450406893 +0000 UTC m=+3.038709551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baea5b3f-7f02-4c1c-912d-428842eaabae-os-release\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.952272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950525    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/baea5b3f-7f02-4c1c-912d-428842eaabae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:00.953091 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.950646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc54b52-fc61-4de7-a089-9b9937e543a7-tmp-dir\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.953091 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.952002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-etc-tuned\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.953091 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.952233    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/493d9fa1-5dc3-4efe-ac4f-f622004dd01d-agent-certs\") pod \"konnectivity-agent-jtkbp\" (UID: \"493d9fa1-5dc3-4efe-ac4f-f622004dd01d\") " pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:00.953091 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.953056    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5ec9889-71dd-4db1-b58b-a13af72f5505-ovn-node-metrics-cert\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.954889 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.954846    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gqv\" (UniqueName: \"kubernetes.io/projected/9cc54b52-fc61-4de7-a089-9b9937e543a7-kube-api-access-w7gqv\") pod \"node-resolver-j6tc7\" (UID: \"9cc54b52-fc61-4de7-a089-9b9937e543a7\") " pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:00.956735 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.956686    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5rr\" (UniqueName: \"kubernetes.io/projected/acc4aa7c-f629-4d4a-9c43-2f22c3975bdc-kube-api-access-qf5rr\") pod \"aws-ebs-csi-driver-node-shphx\" (UID: \"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:00.957668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.957645    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdgc\" (UniqueName: \"kubernetes.io/projected/d5ec9889-71dd-4db1-b58b-a13af72f5505-kube-api-access-7bdgc\") pod \"ovnkube-node-bw7v4\" (UID: \"d5ec9889-71dd-4db1-b58b-a13af72f5505\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:00.958157 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.958135    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhx6\" (UniqueName: \"kubernetes.io/projected/3ac06e75-c2a1-41f2-8a7a-0331b36eca2d-kube-api-access-5lhx6\") pod \"tuned-76hfb\" (UID: \"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d\") " pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:00.959121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.959101    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75kc\" (UniqueName: \"kubernetes.io/projected/bfe1207e-5c58-4dba-be20-84a62d4ac136-kube-api-access-g75kc\") pod \"multus-8qnrn\" (UID: \"bfe1207e-5c58-4dba-be20-84a62d4ac136\") " pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:00.959480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:00.959458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwnjg\" (UniqueName: \"kubernetes.io/projected/baea5b3f-7f02-4c1c-912d-428842eaabae-kube-api-access-vwnjg\") pod \"multus-additional-cni-plugins-tmtm7\" (UID: \"baea5b3f-7f02-4c1c-912d-428842eaabae\") " pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:01.045133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.045094    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl7r6"
Jul 12 15:10:01.055414 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.055380    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx"
Jul 12 15:10:01.065466 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.065428    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhlnq"
Jul 12 15:10:01.081476 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.081437    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76hfb"
Jul 12 15:10:01.090778 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.090746    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:01.098882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.098851    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qnrn"
Jul 12 15:10:01.106443 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.106416    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmtm7"
Jul 12 15:10:01.114402 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.114374    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6tc7"
Jul 12 15:10:01.119304 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.119282    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:01.352536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.352456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:01.352676 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.352606    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:01.352676 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.352674    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:02.352657058 +0000 UTC m=+3.940959706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:01.453333 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.453295    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:01.453498 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.453355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:01.453498 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453468    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:01.453498 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453495    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:01.453634 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453507    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:01.453634 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453471    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:01.453634 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453579    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:02.453560786 +0000 UTC m=+4.041863447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:01.453634 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.453623    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:02.453605078 +0000 UTC m=+4.041907733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:01.621476 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.621388    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:10:01.775222 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.775146    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 15:05:00 +0000 UTC" deadline="2028-03-17 03:49:18.641373707 +0000 UTC"
Jul 12 15:10:01.775632 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.775230    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14724h39m16.866155686s"
Jul 12 15:10:01.867092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.867053    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:01.867092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:01.867076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:01.867398 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.867201    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:01.867398 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:01.867326    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:02.054688 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.054639    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc4aa7c_f629_4d4a_9c43_2f22c3975bdc.slice/crio-3853af6723b0051f05571d1bca8507ada53e947d5b0fbabc023b722dc1d49572 WatchSource:0}: Error finding container 3853af6723b0051f05571d1bca8507ada53e947d5b0fbabc023b722dc1d49572: Status 404 returned error can't find the container with id 3853af6723b0051f05571d1bca8507ada53e947d5b0fbabc023b722dc1d49572
Jul 12 15:10:02.059577 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.056110    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cc6573_6bf2_4447_8e9b_fb1db7175d8a.slice/crio-13fd9eec6b22c11f472aa1c753afd482a877395cd756051a7b85d9eba52a8bae WatchSource:0}: Error finding container 13fd9eec6b22c11f472aa1c753afd482a877395cd756051a7b85d9eba52a8bae: Status 404 returned error can't find the container with id 13fd9eec6b22c11f472aa1c753afd482a877395cd756051a7b85d9eba52a8bae
Jul 12 15:10:02.060977 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.060704    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493d9fa1_5dc3_4efe_ac4f_f622004dd01d.slice/crio-0cc63c9f74e621974351f9bcdfa78f4d2c90eb78816ec085daab6bf60e6fe6cc WatchSource:0}: Error finding container 0cc63c9f74e621974351f9bcdfa78f4d2c90eb78816ec085daab6bf60e6fe6cc: Status 404 returned error can't find the container with id 0cc63c9f74e621974351f9bcdfa78f4d2c90eb78816ec085daab6bf60e6fe6cc
Jul 12 15:10:02.062434 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.062405    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe1207e_5c58_4dba_be20_84a62d4ac136.slice/crio-9597b52d3cdeee504ed3c5360346931f6a1b6b7c26b917851b4696ea428576d6 WatchSource:0}: Error finding container 9597b52d3cdeee504ed3c5360346931f6a1b6b7c26b917851b4696ea428576d6: Status 404 returned error can't find the container with id 9597b52d3cdeee504ed3c5360346931f6a1b6b7c26b917851b4696ea428576d6
Jul 12 15:10:02.062717 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.062672    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdd46fa_6c30_49f5_97fb_259a7f7cc2e2.slice/crio-82cb38900dec647911aa7daa21f195364a9a1f1f13ba3309791f648c49dfe408 WatchSource:0}: Error finding container 82cb38900dec647911aa7daa21f195364a9a1f1f13ba3309791f648c49dfe408: Status 404 returned error can't find the container with id 82cb38900dec647911aa7daa21f195364a9a1f1f13ba3309791f648c49dfe408
Jul 12 15:10:02.063990 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.063902    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ec9889_71dd_4db1_b58b_a13af72f5505.slice/crio-8b0f4ff4ba8ebafeff7a9fcb76b9e2aab5a345ec6bc2e809e79cfe4ae4116b0e WatchSource:0}: Error finding container 8b0f4ff4ba8ebafeff7a9fcb76b9e2aab5a345ec6bc2e809e79cfe4ae4116b0e: Status 404 returned error can't find the container with id 8b0f4ff4ba8ebafeff7a9fcb76b9e2aab5a345ec6bc2e809e79cfe4ae4116b0e
Jul 12 15:10:02.076516 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.075991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaea5b3f_7f02_4c1c_912d_428842eaabae.slice/crio-3a1119184147f3d94d4d7a369b5f828382a9b7d79826bcc60ba04e16f8797ee4 WatchSource:0}: Error finding container 3a1119184147f3d94d4d7a369b5f828382a9b7d79826bcc60ba04e16f8797ee4: Status 404 returned error can't find the container with id 3a1119184147f3d94d4d7a369b5f828382a9b7d79826bcc60ba04e16f8797ee4
Jul 12 15:10:02.077008 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.076784    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc54b52_fc61_4de7_a089_9b9937e543a7.slice/crio-8539ec1f65a505ea5e0eaae02b43ca98166cc69ddc108f3a5e52a6a2ddb566ec WatchSource:0}: Error finding container 8539ec1f65a505ea5e0eaae02b43ca98166cc69ddc108f3a5e52a6a2ddb566ec: Status 404 returned error can't find the container with id 8539ec1f65a505ea5e0eaae02b43ca98166cc69ddc108f3a5e52a6a2ddb566ec
Jul 12 15:10:02.077599 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:02.077566    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac06e75_c2a1_41f2_8a7a_0331b36eca2d.slice/crio-7275614d19d7fc0f5caa3800dc8d9eca7c81f49e5f1864889ef4306494ddd4b0 WatchSource:0}: Error finding container 7275614d19d7fc0f5caa3800dc8d9eca7c81f49e5f1864889ef4306494ddd4b0: Status 404 returned error can't find the container with id 7275614d19d7fc0f5caa3800dc8d9eca7c81f49e5f1864889ef4306494ddd4b0
Jul 12 15:10:02.361621 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.361579    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:02.361794 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.361733    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:02.361841 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.361817    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:04.361795523 +0000 UTC m=+5.950098175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:02.462438 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.462402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:02.462438 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.462443    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:02.462643 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462592    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:02.462643 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462625    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:02.462643 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462636    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:02.462740 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462594    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:02.462740 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462685    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:04.462667908 +0000 UTC m=+6.050970576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:02.462821 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.462749    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:04.462728542 +0000 UTC m=+6.051031193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:02.775709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.775611    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 15:05:00 +0000 UTC" deadline="2028-04-02 22:36:46.97567975 +0000 UTC"
Jul 12 15:10:02.775709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.775677    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15127h26m44.200007218s"
Jul 12 15:10:02.869763 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.869058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:02.869763 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:02.869312    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:02.886327 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.886202    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"8b0f4ff4ba8ebafeff7a9fcb76b9e2aab5a345ec6bc2e809e79cfe4ae4116b0e"}
Jul 12 15:10:02.890396 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.890359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerStarted","Data":"3a1119184147f3d94d4d7a369b5f828382a9b7d79826bcc60ba04e16f8797ee4"}
Jul 12 15:10:02.892688 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.892653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtkbp" event={"ID":"493d9fa1-5dc3-4efe-ac4f-f622004dd01d","Type":"ContainerStarted","Data":"0cc63c9f74e621974351f9bcdfa78f4d2c90eb78816ec085daab6bf60e6fe6cc"}
Jul 12 15:10:02.895811 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.895524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" event={"ID":"924e98b1f4b0eb6dc6bf4bc5f8376614","Type":"ContainerStarted","Data":"9426e2ab40b17c2819a729c2e9bcdf641a8c295318ab97a01522e9906cf70fbf"}
Jul 12 15:10:02.897854 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.897810    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhlnq" event={"ID":"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2","Type":"ContainerStarted","Data":"82cb38900dec647911aa7daa21f195364a9a1f1f13ba3309791f648c49dfe408"}
Jul 12 15:10:02.909016 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.908715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qnrn" event={"ID":"bfe1207e-5c58-4dba-be20-84a62d4ac136","Type":"ContainerStarted","Data":"9597b52d3cdeee504ed3c5360346931f6a1b6b7c26b917851b4696ea428576d6"}
Jul 12 15:10:02.912446 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.912406    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl7r6" event={"ID":"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a","Type":"ContainerStarted","Data":"13fd9eec6b22c11f472aa1c753afd482a877395cd756051a7b85d9eba52a8bae"}
Jul 12 15:10:02.916520 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.916482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx" event={"ID":"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc","Type":"ContainerStarted","Data":"3853af6723b0051f05571d1bca8507ada53e947d5b0fbabc023b722dc1d49572"}
Jul 12 15:10:02.920975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.920352    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ccb2a77486a97d03d0373fe291e6d0f" containerID="7873a16be88e45da050eff2fbe8dac8c99962c728e5ac791687fa54a5ca008bc" exitCode=0
Jul 12 15:10:02.920975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.920450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"0ccb2a77486a97d03d0373fe291e6d0f","Type":"ContainerDied","Data":"7873a16be88e45da050eff2fbe8dac8c99962c728e5ac791687fa54a5ca008bc"}
Jul 12 15:10:02.924343 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.924243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6tc7" event={"ID":"9cc54b52-fc61-4de7-a089-9b9937e543a7","Type":"ContainerStarted","Data":"8539ec1f65a505ea5e0eaae02b43ca98166cc69ddc108f3a5e52a6a2ddb566ec"}
Jul 12 15:10:02.927139 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.926948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76hfb" event={"ID":"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d","Type":"ContainerStarted","Data":"7275614d19d7fc0f5caa3800dc8d9eca7c81f49e5f1864889ef4306494ddd4b0"}
Jul 12 15:10:02.936976 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:02.936899    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" podStartSLOduration=2.936877155 podStartE2EDuration="2.936877155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:02.908904541 +0000 UTC m=+4.497207212" watchObservedRunningTime="2026-07-12 15:10:02.936877155 +0000 UTC m=+4.525179827"
Jul 12 15:10:03.867368 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:03.867238    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:03.867368 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:03.867275    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:03.868076 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:03.867390    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:03.868076 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:03.867861    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:03.937639 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:03.937603    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"0ccb2a77486a97d03d0373fe291e6d0f","Type":"ContainerStarted","Data":"9908d1f9eb924c986c923866d2a814424c54df6db129bd7332d5bb71512f2942"}
Jul 12 15:10:04.379726 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:04.379683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:04.379930 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.379901    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:04.379991 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.379983    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:08.379963299 +0000 UTC m=+9.968265959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:04.480675 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:04.480635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:04.480861 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:04.480703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:04.480977 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.480876    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:04.480977 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.480957    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:08.480936561 +0000 UTC m=+10.069239212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:04.481377 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.481358    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:04.481451 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.481386    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:04.481451 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.481399    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:04.481451 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.481442    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:08.481427321 +0000 UTC m=+10.069729972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:04.870184 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:04.870094    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:04.870713 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:04.870247    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:05.867854 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:05.867084    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:05.867854 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:05.867221    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:05.867854 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:05.867615    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:05.867854 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:05.867711    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:06.869126 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:06.869089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:06.869592 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:06.869242    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:07.868012 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:07.867928    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:07.868012 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:07.867965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:07.868275 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:07.868074    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:07.868275 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:07.868242    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:08.413355 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:08.412746    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:08.413355 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.412932    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:08.413355 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.413004    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:16.41298402 +0000 UTC m=+18.001286668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:08.513481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:08.513437    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:08.513653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:08.513501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:08.513653 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513609    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:08.513779 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513672    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:16.513654378 +0000 UTC m=+18.101957031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:08.513779 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513611    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:08.513779 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513710    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:08.513779 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513723    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:08.513779 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.513767    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:16.513754384 +0000 UTC m=+18.102057047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:08.871063 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:08.870528    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:08.871063 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:08.870666    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:09.866882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:09.866837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:09.866882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:09.866875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:09.867419 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:09.867013    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:09.867419 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:09.867128    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:10.867447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:10.867345    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:10.867936 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:10.867489    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:11.867817 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:11.867776    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:11.868352 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:11.867789    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:11.868352 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:11.867936    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:11.868352 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:11.868023    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:12.867792 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:12.867755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:12.867979 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:12.867937    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:13.866840 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:13.866790    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:13.867031 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:13.866793    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:13.867031 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:13.866905    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:13.867031 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:13.867012    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:14.867072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:14.867038    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:14.867550 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:14.867200    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:15.867351 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:15.867310    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:15.867351 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:15.867345    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:15.867842 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:15.867432    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:15.867842 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:15.867582    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:16.474482 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:16.474442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:16.474672 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.474560    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:16.474672 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.474626    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:32.474605772 +0000 UTC m=+34.062908438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:16.575464 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:16.575423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:16.575659 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:16.575475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:16.575659 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575625    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:16.575659 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575651    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:16.575811 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575663    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:16.575811 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575733    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:32.575717203 +0000 UTC m=+34.164019857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:16.575811 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575665    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:16.575941 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.575831    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:32.575812502 +0000 UTC m=+34.164115168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:16.867174 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:16.867136    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:16.867340 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:16.867299    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:17.866985 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:17.866945    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:17.866985 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:17.866968    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:17.867527 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:17.867077    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:17.867527 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:17.867214    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:18.868144 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:18.868111    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:18.868636 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:18.868238    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:19.867778 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:19.867740    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:19.867984 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:19.867750    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:19.867984 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:19.867875    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:19.867984 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:19.867976    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:20.867078 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:20.867049    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:20.867447 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:20.867170    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:21.867497 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.867130    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:21.868314 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.867190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:21.868314 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:21.867548    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:21.868314 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:21.867626    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:21.977706 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.977642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qnrn" event={"ID":"bfe1207e-5c58-4dba-be20-84a62d4ac136","Type":"ContainerStarted","Data":"cea3ad5351dd70dc780e65cc98b14d294ac52b6f1451260d4835f59cf619a1a6"}
Jul 12 15:10:21.979574 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.979540    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx" event={"ID":"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc","Type":"ContainerStarted","Data":"e2d78f0bc0ec63110afdd0e7d4af9aa6fb3c10818628ee1cc1026367e49e4b18"}
Jul 12 15:10:21.981305 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.981264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6tc7" event={"ID":"9cc54b52-fc61-4de7-a089-9b9937e543a7","Type":"ContainerStarted","Data":"9163d72857553be04149f3382f517c6148e2694356db6258c3d7d10638adaa8e"}
Jul 12 15:10:21.983095 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.983060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76hfb" event={"ID":"3ac06e75-c2a1-41f2-8a7a-0331b36eca2d","Type":"ContainerStarted","Data":"40d15a82a891ad425a181ebc794d290280b7651a637b0831749d0e771e07b9be"}
Jul 12 15:10:21.986378 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986347    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:10:21.986749 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986718    2566 generic.go:356] "Generic (PLEG): container finished" podID="d5ec9889-71dd-4db1-b58b-a13af72f5505" containerID="f60c9447bc415dc592dd7266d4626f053e029fd66f3830f79826592bc03b634c" exitCode=1
Jul 12 15:10:21.986852 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986801    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"ec423a6db61b83b2fd4e34aa2c3cfb9a27c2ac5f6c5047dbd4eab131d64e04ab"}
Jul 12 15:10:21.986925 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"3c1437fa5de8a41bc89526772f1f871436fa4a70480969f67f9ea79d90d304f6"}
Jul 12 15:10:21.986984 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986945    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"12284662241b6fd762db2689ab1cb6d6d2fe2152e8e6b1b19fb03e21253f88e2"}
Jul 12 15:10:21.987043 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.986992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"36e4b2316a6dee88fe05a4b298e39431064d5e7d7200821e582199c9ae0a3475"}
Jul 12 15:10:21.987043 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.987039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerDied","Data":"f60c9447bc415dc592dd7266d4626f053e029fd66f3830f79826592bc03b634c"}
Jul 12 15:10:21.987121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.987085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"5fcf002686f424f99ec0a727bf56f36ea8038a83492edd5172fc66517299dba6"}
Jul 12 15:10:21.988551 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.988527    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="6927bbe1a8c0c6b3a6f4c3fc846a78342b72aedffa542bb3109b20cc7020a429" exitCode=0
Jul 12 15:10:21.988664 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.988610    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"6927bbe1a8c0c6b3a6f4c3fc846a78342b72aedffa542bb3109b20cc7020a429"}
Jul 12 15:10:21.990434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.990408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtkbp" event={"ID":"493d9fa1-5dc3-4efe-ac4f-f622004dd01d","Type":"ContainerStarted","Data":"47dc57ecfc7f01f70463703cf7ec0973ff12b1dba2f018d02e79fe5c607fd7e7"}
Jul 12 15:10:21.992624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.992305    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhlnq" event={"ID":"3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2","Type":"ContainerStarted","Data":"6f83f5c4d8e624a0564e4671523bad416990654ccdcfbd38fb58e46644919b6f"}
Jul 12 15:10:21.995252 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.995198    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" podStartSLOduration=21.99518121 podStartE2EDuration="21.99518121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:03.95211823 +0000 UTC m=+5.540420901" watchObservedRunningTime="2026-07-12 15:10:21.99518121 +0000 UTC m=+23.583483881"
Jul 12 15:10:21.995391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:21.995312    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8qnrn" podStartSLOduration=4.061641552 podStartE2EDuration="22.995304628s" totalImagesPullingTime="18.933663076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:21.994595483 +0000 UTC m=+23.582898145" watchObservedRunningTime="2026-07-12 15:10:21.995304628 +0000 UTC m=+23.583607299"
Jul 12 15:10:22.007876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.007824    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jhlnq" podStartSLOduration=5.113535865 podStartE2EDuration="24.007807316s" totalImagesPullingTime="18.894271451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:22.00739978 +0000 UTC m=+23.595702450" watchObservedRunningTime="2026-07-12 15:10:22.007807316 +0000 UTC m=+23.596110037"
Jul 12 15:10:22.041324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.041272    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jtkbp" podStartSLOduration=4.146522039 podStartE2EDuration="23.041255708s" totalImagesPullingTime="18.894733669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:22.041040328 +0000 UTC m=+23.629342997" watchObservedRunningTime="2026-07-12 15:10:22.041255708 +0000 UTC m=+23.629558377"
Jul 12 15:10:22.057269 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.057211    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-76hfb" podStartSLOduration=5.176086852 podStartE2EDuration="24.057193692s" totalImagesPullingTime="18.88110684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:22.056882651 +0000 UTC m=+23.645185320" watchObservedRunningTime="2026-07-12 15:10:22.057193692 +0000 UTC m=+23.645496361"
Jul 12 15:10:22.070640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.070578    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j6tc7" podStartSLOduration=4.190090945 podStartE2EDuration="23.070563111s" totalImagesPullingTime="18.880472166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:22.070503865 +0000 UTC m=+23.658806546" watchObservedRunningTime="2026-07-12 15:10:22.070563111 +0000 UTC m=+23.658865780"
Jul 12 15:10:22.374699 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.374668    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 15:10:22.817927 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.817612    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T15:10:22.374689656Z","UUID":"648ff656-d831-4fac-b980-ee59fec3dd1d","Handler":null,"Name":"","Endpoint":""}
Jul 12 15:10:22.820458 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.820427    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 15:10:22.820614 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.820482    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 15:10:22.866968 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.866941    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:22.867161 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:22.867060    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:22.996486 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.996446    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl7r6" event={"ID":"d3cc6573-6bf2-4447-8e9b-fb1db7175d8a","Type":"ContainerStarted","Data":"80b09c911f2818d4d3adbb71dec9fc4e692ea99dc63550afb172f521a10a7aa0"}
Jul 12 15:10:22.999267 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:22.998688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx" event={"ID":"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc","Type":"ContainerStarted","Data":"b6db7383ed69384710726c570f61d3c7f7af7979da670cc183964eae43094a96"}
Jul 12 15:10:23.010338 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:23.010232    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zl7r6" podStartSLOduration=6.112823706 podStartE2EDuration="25.01016656s" totalImagesPullingTime="18.897342854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:23.010080486 +0000 UTC m=+24.598383157" watchObservedRunningTime="2026-07-12 15:10:23.01016656 +0000 UTC m=+24.598469234"
Jul 12 15:10:23.867195 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:23.867157    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:23.867419 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:23.867288    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:23.867419 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:23.867342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:23.867533 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:23.867467    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:24.005188 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:24.005149    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx" event={"ID":"acc4aa7c-f629-4d4a-9c43-2f22c3975bdc","Type":"ContainerStarted","Data":"281c2c90134e52d269ef55405d5dcb88cb2a8a35f1408204ac55cdc06d0a1478"}
Jul 12 15:10:24.009841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:24.009788    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:10:24.010259 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:24.010232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"f6d13432c3051ee08f17009fe5a30fec33727499eaa928d1d8e1fd78cc1b64d8"}
Jul 12 15:10:24.021533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:24.021481    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shphx" podStartSLOduration=8.796630655 podStartE2EDuration="26.021457395s" totalImagesPullingTime="17.22482674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:24.021422787 +0000 UTC m=+25.609725457" watchObservedRunningTime="2026-07-12 15:10:24.021457395 +0000 UTC m=+25.609760061"
Jul 12 15:10:24.867321 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:24.867285    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:24.867514 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:24.867417    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:25.867417 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:25.867379    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:25.867417 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:25.867411    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:25.868070 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:25.867507    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:25.868070 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:25.867616    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:26.480379 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:26.480358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:26.481166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:26.481143    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:26.867777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:26.867607    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:26.868285 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:26.867870    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:27.020257 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.020163    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:10:27.020575 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.020548    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"2d860e43a5bbc98ec4907304862ce7875a4aff5171a12aacff8fd54c5e6cdf0f"}
Jul 12 15:10:27.020991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.020836    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:27.020991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.020935    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:27.021153 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.021045    2566 scope.go:117] "RemoveContainer" containerID="f60c9447bc415dc592dd7266d4626f053e029fd66f3830f79826592bc03b634c"
Jul 12 15:10:27.022793 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.022768    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="8c3f5422697af7f7782e3cd5cd49f9e3dad40b46a6f3e08a5826fe1d095cf5f4" exitCode=0
Jul 12 15:10:27.022883 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.022846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"8c3f5422697af7f7782e3cd5cd49f9e3dad40b46a6f3e08a5826fe1d095cf5f4"}
Jul 12 15:10:27.023211 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.023190    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:27.023709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.023681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jtkbp"
Jul 12 15:10:27.038577 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.038545    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:27.868049 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.867409    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:27.868049 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:27.867544    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:27.868049 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:27.867927    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:27.868049 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:27.868009    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:28.030873 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.030833    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:10:28.032118 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.032081    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" event={"ID":"d5ec9889-71dd-4db1-b58b-a13af72f5505","Type":"ContainerStarted","Data":"6a75f1c788e0f2632481a82acf31be407f7a17412604f6e2fcc5f46e770e97da"}
Jul 12 15:10:28.032461 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.032441    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:28.048291 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.048266    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:10:28.058104 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.058027    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4" podStartSLOduration=9.964715428 podStartE2EDuration="29.058011693s" totalImagesPullingTime="19.093296265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:28.056518424 +0000 UTC m=+29.644821095" watchObservedRunningTime="2026-07-12 15:10:28.058011693 +0000 UTC m=+29.646314362"
Jul 12 15:10:28.539545 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.539331    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66nfc"]
Jul 12 15:10:28.539738 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.539652    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:28.539783 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:28.539753    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:28.542327 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.542296    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wx52h"]
Jul 12 15:10:28.542482 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.542422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:28.542550 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:28.542527    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:28.542836 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.542805    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf9rb"]
Jul 12 15:10:28.542983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:28.542930    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:28.543055 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:28.543034    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:29.036565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:29.036533    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="1dfcde74d6459ccb601bba5fa3283d40837444a6bef60b6b7a075999657e017e" exitCode=0
Jul 12 15:10:29.037177 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:29.036625    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"1dfcde74d6459ccb601bba5fa3283d40837444a6bef60b6b7a075999657e017e"}
Jul 12 15:10:29.867123 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:29.867084    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:29.867283 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:29.867084    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:29.867283 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:29.867212    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:29.867358 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:29.867328    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:30.867273 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:30.867194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:30.867809 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:30.867313    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:31.044182 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:31.044141    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="ba194bd7768e6177267f1ef970783c51e57c95daa88d435afda5b67561e09ab6" exitCode=0
Jul 12 15:10:31.044335 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:31.044189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"ba194bd7768e6177267f1ef970783c51e57c95daa88d435afda5b67561e09ab6"}
Jul 12 15:10:31.867185 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:31.867153    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:31.867375 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:31.867190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:31.867375 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:31.867278    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:31.867765 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:31.867426    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:32.491034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:32.490990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:32.491215 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.491139    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:32.491215 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.491209    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:11:04.491188395 +0000 UTC m=+66.079491060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:10:32.591659 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:32.591624    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:32.591826 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:32.591676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:32.591826 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591774    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:32.591826 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591792    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:10:32.591826 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591811    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:10:32.591826 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591823    2566 projected.go:196] Error preparing data for projected volume kube-api-access-xtq92 for pod openshift-network-diagnostics/network-check-target-wx52h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:32.592051 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591841    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret podName:8b7bcb8e-c765-4d7b-88fd-a0b74f1be294 nodeName:}" failed. No retries permitted until 2026-07-12 15:11:04.591824255 +0000 UTC m=+66.180126909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret") pod "global-pull-secret-syncer-sf9rb" (UID: "8b7bcb8e-c765-4d7b-88fd-a0b74f1be294") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:10:32.592051 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.591858    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92 podName:e8c1c748-494d-4e25-a667-7e498917fe10 nodeName:}" failed. No retries permitted until 2026-07-12 15:11:04.59184868 +0000 UTC m=+66.180151328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtq92" (UniqueName: "kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92") pod "network-check-target-wx52h" (UID: "e8c1c748-494d-4e25-a667-7e498917fe10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:10:32.868007 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:32.867818    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:32.868470 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:32.868097    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx52h" podUID="e8c1c748-494d-4e25-a667-7e498917fe10"
Jul 12 15:10:33.867225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:33.867187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:33.867434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:33.867190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:33.867434 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:33.867335    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9rb" podUID="8b7bcb8e-c765-4d7b-88fd-a0b74f1be294"
Jul 12 15:10:33.867565 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:33.867440    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:10:34.552743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.552706    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeReady"
Jul 12 15:10:34.553184 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.552871    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 15:10:34.593560 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.593527    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lvpkx"]
Jul 12 15:10:34.597986 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.597959    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-njj2d"]
Jul 12 15:10:34.598165 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.598099    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.600335 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.600308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 15:10:34.600466 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.600358    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 15:10:34.600466 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.600371    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72hfp\""
Jul 12 15:10:34.601502 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.601477    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.603476 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.603459    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 15:10:34.603670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.603641    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 15:10:34.603754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.603686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9q7ts\""
Jul 12 15:10:34.603754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.603699    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 15:10:34.605392 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.605371    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lvpkx"]
Jul 12 15:10:34.617374 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.617350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njj2d"]
Jul 12 15:10:34.706505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706471    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf0c703-efa6-40f1-b941-658bb39adb7d-cert\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.706703 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706517    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2wf\" (UniqueName: \"kubernetes.io/projected/d8c61357-21b2-4fd2-8ebc-a65c9711d147-kube-api-access-6n2wf\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.706703 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c61357-21b2-4fd2-8ebc-a65c9711d147-tmp-dir\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.706703 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7wf\" (UniqueName: \"kubernetes.io/projected/acf0c703-efa6-40f1-b941-658bb39adb7d-kube-api-access-ln7wf\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.706703 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.706703 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.706697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8c61357-21b2-4fd2-8ebc-a65c9711d147-config-volume\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807079 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.806986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2wf\" (UniqueName: \"kubernetes.io/projected/d8c61357-21b2-4fd2-8ebc-a65c9711d147-kube-api-access-6n2wf\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807079 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c61357-21b2-4fd2-8ebc-a65c9711d147-tmp-dir\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7wf\" (UniqueName: \"kubernetes.io/projected/acf0c703-efa6-40f1-b941-658bb39adb7d-kube-api-access-ln7wf\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.807297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8c61357-21b2-4fd2-8ebc-a65c9711d147-config-volume\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf0c703-efa6-40f1-b941-658bb39adb7d-cert\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.807537 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:34.807304    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:34.807537 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:34.807372    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:35.307351201 +0000 UTC m=+36.895653852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:10:34.807537 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807413    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c61357-21b2-4fd2-8ebc-a65c9711d147-tmp-dir\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.807824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.807796    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8c61357-21b2-4fd2-8ebc-a65c9711d147-config-volume\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.812055 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.812026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf0c703-efa6-40f1-b941-658bb39adb7d-cert\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.820180 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.820142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7wf\" (UniqueName: \"kubernetes.io/projected/acf0c703-efa6-40f1-b941-658bb39adb7d-kube-api-access-ln7wf\") pod \"ingress-canary-njj2d\" (UID: \"acf0c703-efa6-40f1-b941-658bb39adb7d\") " pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:34.821258 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.821236    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2wf\" (UniqueName: \"kubernetes.io/projected/d8c61357-21b2-4fd2-8ebc-a65c9711d147-kube-api-access-6n2wf\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:34.867547 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.867509    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:10:34.870477 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.870444    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 15:10:34.870640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.870505    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 15:10:34.870640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.870608    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sv5b2\""
Jul 12 15:10:34.917794 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:34.917758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njj2d"
Jul 12 15:10:35.317113 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.316450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:35.317113 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:35.316621    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:35.317113 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:35.316689    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:36.316665266 +0000 UTC m=+37.904967926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:10:35.402347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.402317    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njj2d"]
Jul 12 15:10:35.407355 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:10:35.407324    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf0c703_efa6_40f1_b941_658bb39adb7d.slice/crio-e0eb0dcb87164795c33f76a5b8f547882fe664cfc338410237d5a419e0b03716 WatchSource:0}: Error finding container e0eb0dcb87164795c33f76a5b8f547882fe664cfc338410237d5a419e0b03716: Status 404 returned error can't find the container with id e0eb0dcb87164795c33f76a5b8f547882fe664cfc338410237d5a419e0b03716
Jul 12 15:10:35.867538 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.867351    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:10:35.868000 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.867415    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:10:35.870397 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.870375    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 15:10:35.870550 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.870423    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn9r4\""
Jul 12 15:10:35.871280 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:35.871264    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 15:10:36.058399 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:36.058358    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njj2d" event={"ID":"acf0c703-efa6-40f1-b941-658bb39adb7d","Type":"ContainerStarted","Data":"e0eb0dcb87164795c33f76a5b8f547882fe664cfc338410237d5a419e0b03716"}
Jul 12 15:10:36.061618 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:36.061576    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="862469c5f3e0093f129d9c01552da550952f80f249b551dc768944d7148dc79d" exitCode=0
Jul 12 15:10:36.061784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:36.061626    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"862469c5f3e0093f129d9c01552da550952f80f249b551dc768944d7148dc79d"}
Jul 12 15:10:36.324417 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:36.324379    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:36.324610 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:36.324572    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:36.324677 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:36.324649    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:38.324629937 +0000 UTC m=+39.912932585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:10:37.068081 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:37.068047    2566 generic.go:356] "Generic (PLEG): container finished" podID="baea5b3f-7f02-4c1c-912d-428842eaabae" containerID="2ced4e7d47be9f7939b622fa6e595011ea71b30741613ed8f3a85d4178a163cd" exitCode=0
Jul 12 15:10:37.068635 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:37.068102    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerDied","Data":"2ced4e7d47be9f7939b622fa6e595011ea71b30741613ed8f3a85d4178a163cd"}
Jul 12 15:10:38.072813 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:38.072771    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njj2d" event={"ID":"acf0c703-efa6-40f1-b941-658bb39adb7d","Type":"ContainerStarted","Data":"41a729c464eec6c82d39fe3287e166b5f83d1a8f0e7da9e47e11eec0278c2476"}
Jul 12 15:10:38.076487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:38.076444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" event={"ID":"baea5b3f-7f02-4c1c-912d-428842eaabae","Type":"ContainerStarted","Data":"8ec9d79254750be64bdabd23146daf11ddbbf0c7902450a0e194d255e1310f89"}
Jul 12 15:10:38.088687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:38.088632    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-njj2d" podStartSLOduration=1.617840183 podStartE2EDuration="4.08861684s" totalImagesPullingTime="2.470776657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:38.088102187 +0000 UTC m=+39.676404859" watchObservedRunningTime="2026-07-12 15:10:38.08861684 +0000 UTC m=+39.676919488"
Jul 12 15:10:38.111753 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:38.111689    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tmtm7" podStartSLOduration=9.132629128 podStartE2EDuration="39.111663255s" totalImagesPullingTime="29.979034127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:10:38.1100621 +0000 UTC m=+39.698364771" watchObservedRunningTime="2026-07-12 15:10:38.111663255 +0000 UTC m=+39.699965929"
Jul 12 15:10:38.340112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:38.340024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:38.340254 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:38.340179    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:38.340290 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:38.340256    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:42.340236515 +0000 UTC m=+43.928539169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:10:42.369009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:42.368963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:42.369440 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:42.369082    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:42.369440 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:42.369158    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:10:50.369141112 +0000 UTC m=+51.957443765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:10:50.426507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:10:50.426464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:10:50.427002 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:50.426586    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:10:50.427002 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:10:50.426658    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:11:06.426630334 +0000 UTC m=+68.014932983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:11:00.053648 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:00.053608    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw7v4"
Jul 12 15:11:04.528796 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.528750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:11:04.531239 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.531214    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 15:11:04.539237 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:04.539203    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:11:04.539373 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:04.539302    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:12:08.539279583 +0000 UTC m=+130.127582231 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : secret "metrics-daemon-secret" not found
Jul 12 15:11:04.629878 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.629829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:11:04.630052 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.629887    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:11:04.632548 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.632527    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 15:11:04.632621 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.632528    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 15:11:04.643196 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.643169    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 15:11:04.643924 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.643885    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b7bcb8e-c765-4d7b-88fd-a0b74f1be294-original-pull-secret\") pod \"global-pull-secret-syncer-sf9rb\" (UID: \"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294\") " pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:11:04.653524 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.653492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtq92\" (UniqueName: \"kubernetes.io/projected/e8c1c748-494d-4e25-a667-7e498917fe10-kube-api-access-xtq92\") pod \"network-check-target-wx52h\" (UID: \"e8c1c748-494d-4e25-a667-7e498917fe10\") " pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:11:04.679485 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.679434    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9rb"
Jul 12 15:11:04.808788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.808702    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf9rb"]
Jul 12 15:11:04.812020 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:11:04.811985    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7bcb8e_c765_4d7b_88fd_a0b74f1be294.slice/crio-390cedbd28132e2ce804c967be9d474070c447c5748ceb4b341c93bc57364dab WatchSource:0}: Error finding container 390cedbd28132e2ce804c967be9d474070c447c5748ceb4b341c93bc57364dab: Status 404 returned error can't find the container with id 390cedbd28132e2ce804c967be9d474070c447c5748ceb4b341c93bc57364dab
Jul 12 15:11:04.880817 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.880781    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sv5b2\""
Jul 12 15:11:04.889643 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:04.889615    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:11:05.018522 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:05.018486    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wx52h"]
Jul 12 15:11:05.022230 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:11:05.022202    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c1c748_494d_4e25_a667_7e498917fe10.slice/crio-6c53fc80b43d9860f362e77cdd835b2a200159e1eb0984200a2f79c800f33207 WatchSource:0}: Error finding container 6c53fc80b43d9860f362e77cdd835b2a200159e1eb0984200a2f79c800f33207: Status 404 returned error can't find the container with id 6c53fc80b43d9860f362e77cdd835b2a200159e1eb0984200a2f79c800f33207
Jul 12 15:11:05.140297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:05.140266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wx52h" event={"ID":"e8c1c748-494d-4e25-a667-7e498917fe10","Type":"ContainerStarted","Data":"6c53fc80b43d9860f362e77cdd835b2a200159e1eb0984200a2f79c800f33207"}
Jul 12 15:11:05.141276 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:05.141249    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sf9rb" event={"ID":"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294","Type":"ContainerStarted","Data":"390cedbd28132e2ce804c967be9d474070c447c5748ceb4b341c93bc57364dab"}
Jul 12 15:11:06.446217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:06.446176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:11:06.446747 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:06.446301    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:11:06.446747 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:06.446363    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:11:38.446344881 +0000 UTC m=+100.034647529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:11:08.831961 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.831920    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"]
Jul 12 15:11:08.852997 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.852959    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"]
Jul 12 15:11:08.853175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.853093    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.855948 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.855896    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 12 15:11:08.856109 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856056    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 12 15:11:08.856166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856100    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 12 15:11:08.856529 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856471    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 12 15:11:08.856529 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856489    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 12 15:11:08.856830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856817    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 12 15:11:08.856978 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.856881    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 12 15:11:08.967558 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b028f1-d61a-4013-92fc-b05a53e84847-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.967558 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.967801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.967801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdqn\" (UniqueName: \"kubernetes.io/projected/c1b028f1-d61a-4013-92fc-b05a53e84847-kube-api-access-zfdqn\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.967801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:08.967801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:08.967718    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.068737 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.068686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b028f1-d61a-4013-92fc-b05a53e84847-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.068976 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.068752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.068976 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.068801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.068976 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.068955    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdqn\" (UniqueName: \"kubernetes.io/projected/c1b028f1-d61a-4013-92fc-b05a53e84847-kube-api-access-zfdqn\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.069147 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.069043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.069147 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.069073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.069602 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.069560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b028f1-d61a-4013-92fc-b05a53e84847-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.071983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.071953    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-ca\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.072110 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.071961    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.072110 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.072037    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.072110 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.072049    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1b028f1-d61a-4013-92fc-b05a53e84847-hub\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.076875 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.076846    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdqn\" (UniqueName: \"kubernetes.io/projected/c1b028f1-d61a-4013-92fc-b05a53e84847-kube-api-access-zfdqn\") pod \"cluster-proxy-proxy-agent-8679d55575-45ppg\" (UID: \"c1b028f1-d61a-4013-92fc-b05a53e84847\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.178668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.178622    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:11:09.787434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:09.787019    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"]
Jul 12 15:11:09.791373 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:11:09.791330    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1b028f1_d61a_4013_92fc_b05a53e84847.slice/crio-091f8f92c5585f14659c90dbe94bf59ec07712b006481da49bf3be0527696ddc WatchSource:0}: Error finding container 091f8f92c5585f14659c90dbe94bf59ec07712b006481da49bf3be0527696ddc: Status 404 returned error can't find the container with id 091f8f92c5585f14659c90dbe94bf59ec07712b006481da49bf3be0527696ddc
Jul 12 15:11:10.155666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.155626    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sf9rb" event={"ID":"8b7bcb8e-c765-4d7b-88fd-a0b74f1be294","Type":"ContainerStarted","Data":"991f87b735d8a5c591c7191501b3db7b2f4d77feb71d34a8ecf6f3108c72af66"}
Jul 12 15:11:10.156929 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.156887    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerStarted","Data":"091f8f92c5585f14659c90dbe94bf59ec07712b006481da49bf3be0527696ddc"}
Jul 12 15:11:10.158318 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.158299    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wx52h" event={"ID":"e8c1c748-494d-4e25-a667-7e498917fe10","Type":"ContainerStarted","Data":"0f1182e087f4f111e6045aaaaa493924ea94fca45fe5a48970c80ec0a807ec09"}
Jul 12 15:11:10.158449 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.158438    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:11:10.169791 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.169742    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sf9rb" podStartSLOduration=66.323360436 podStartE2EDuration="1m11.169727259s" totalImagesPullingTime="4.846366823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:11:10.169217217 +0000 UTC m=+71.757519890" watchObservedRunningTime="2026-07-12 15:11:10.169727259 +0000 UTC m=+71.758029929"
Jul 12 15:11:10.182720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:10.182646    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wx52h" podStartSLOduration=67.558339293 podStartE2EDuration="1m12.182623571s" totalImagesPullingTime="4.624284278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:11:10.182190344 +0000 UTC m=+71.770493014" watchObservedRunningTime="2026-07-12 15:11:10.182623571 +0000 UTC m=+71.770926220"
Jul 12 15:11:14.171390 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:14.171350    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerStarted","Data":"b9ba7af06d491820153c8394fb8650f27a5a35a4e5f7268e1fcc256b68517934"}
Jul 12 15:11:14.171390 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:14.171398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerStarted","Data":"6d9b6206ed085f5714f13874bc3a7428cd73437d9d7d3805b16824e67fcf1451"}
Jul 12 15:11:14.171837 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:14.171410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerStarted","Data":"a355747edd78eab7163191d1d9aeb27dee1277f57d15db539e7e05827d8b2143"}
Jul 12 15:11:14.188309 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:14.188257    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" podStartSLOduration=2.517378547 podStartE2EDuration="6.188239161s" totalImagesPullingTime="3.670860614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:11:14.18781529 +0000 UTC m=+75.776117960" watchObservedRunningTime="2026-07-12 15:11:14.188239161 +0000 UTC m=+75.776541831"
Jul 12 15:11:38.476653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:38.476591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:11:38.477150 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:38.476779    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:11:38.477150 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:11:38.476854    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:12:42.476834782 +0000 UTC m=+164.065137430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:11:41.164691 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:11:41.164663    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wx52h"
Jul 12 15:12:08.600837 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:12:08.600796    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:12:08.601371 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:08.600941    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:12:08.601371 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:08.601013    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:10.600994737 +0000 UTC m=+252.189297403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : secret "metrics-daemon-secret" not found
Jul 12 15:12:37.611167 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:37.611118    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lvpkx" podUID="d8c61357-21b2-4fd2-8ebc-a65c9711d147"
Jul 12 15:12:38.418879 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:12:38.418847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:12:38.885899 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:38.885847    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:12:42.535545 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:12:42.535487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:12:42.535973 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:42.535636    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:12:42.535973 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:12:42.535712    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls podName:d8c61357-21b2-4fd2-8ebc-a65c9711d147 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:44.535696509 +0000 UTC m=+286.123999160 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls") pod "dns-default-lvpkx" (UID: "d8c61357-21b2-4fd2-8ebc-a65c9711d147") : secret "dns-default-metrics-tls" not found
Jul 12 15:12:54.867956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:12:54.867840    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:14:04.416878 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.416847    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"]
Jul 12 15:14:04.419730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.419708    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.422216 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.422195    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 12 15:14:04.422340 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.422256    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k24lp\""
Jul 12 15:14:04.423064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.423044    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:14:04.423146 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.423132    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 12 15:14:04.423222 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.423205    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 12 15:14:04.429152 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.429111    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"]
Jul 12 15:14:04.514396 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.514360    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd5f1bc-3548-480c-b22e-89e73fef89d1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.514396 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.514397    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5f1bc-3548-480c-b22e-89e73fef89d1-config\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.514622 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.514524    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhn5\" (UniqueName: \"kubernetes.io/projected/0dd5f1bc-3548-480c-b22e-89e73fef89d1-kube-api-access-dvhn5\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.614842 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.614797    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd5f1bc-3548-480c-b22e-89e73fef89d1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.614842 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.614841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5f1bc-3548-480c-b22e-89e73fef89d1-config\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.615124 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.614936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhn5\" (UniqueName: \"kubernetes.io/projected/0dd5f1bc-3548-480c-b22e-89e73fef89d1-kube-api-access-dvhn5\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.615484 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.615455    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5f1bc-3548-480c-b22e-89e73fef89d1-config\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.617030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.617009    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd5f1bc-3548-480c-b22e-89e73fef89d1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.621965 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.621936    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhn5\" (UniqueName: \"kubernetes.io/projected/0dd5f1bc-3548-480c-b22e-89e73fef89d1-kube-api-access-dvhn5\") pod \"service-ca-operator-7695fc6c8c-zvkps\" (UID: \"0dd5f1bc-3548-480c-b22e-89e73fef89d1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.729115 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.729027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"
Jul 12 15:14:04.848892 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:04.848859    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps"]
Jul 12 15:14:04.852496 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:04.852471    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd5f1bc_3548_480c_b22e_89e73fef89d1.slice/crio-9222668b836c4d6a9056a3f1308c088bbd73d33fc7abda48167501d76d98aef4 WatchSource:0}: Error finding container 9222668b836c4d6a9056a3f1308c088bbd73d33fc7abda48167501d76d98aef4: Status 404 returned error can't find the container with id 9222668b836c4d6a9056a3f1308c088bbd73d33fc7abda48167501d76d98aef4
Jul 12 15:14:05.657183 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:05.657139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps" event={"ID":"0dd5f1bc-3548-480c-b22e-89e73fef89d1","Type":"ContainerStarted","Data":"9222668b836c4d6a9056a3f1308c088bbd73d33fc7abda48167501d76d98aef4"}
Jul 12 15:14:07.664054 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:07.664015    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps" event={"ID":"0dd5f1bc-3548-480c-b22e-89e73fef89d1","Type":"ContainerStarted","Data":"53be18ac10a17e8717bae57304f85247aa389c5fdbdfcf2f2069f28c86ba45ba"}
Jul 12 15:14:07.679672 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:07.679621    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps" podStartSLOduration=1.639520708 podStartE2EDuration="3.679605104s" totalImagesPullingTime="2.040084396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:07.678152453 +0000 UTC m=+249.266455122" watchObservedRunningTime="2026-07-12 15:14:07.679605104 +0000 UTC m=+249.267907774"
Jul 12 15:14:09.195564 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.195532    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nsg7b"]
Jul 12 15:14:09.198822 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.198797    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.200949 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.200928    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gr22b\""
Jul 12 15:14:09.201714 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.201691    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 15:14:09.201714 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.201711    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 15:14:09.201841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.201702    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 15:14:09.201841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.201763    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 15:14:09.207920 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.207887    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsg7b"]
Jul 12 15:14:09.249768 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.249732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f1853d8-5758-4aae-8f64-f190e1e149e2-data-volume\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.249768 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.249773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.250023 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.249794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f1853d8-5758-4aae-8f64-f190e1e149e2-crio-socket\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.250023 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.249884    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psgpt\" (UniqueName: \"kubernetes.io/projected/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-api-access-psgpt\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.250023 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.249958    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350409 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psgpt\" (UniqueName: \"kubernetes.io/projected/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-api-access-psgpt\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350605 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350605 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350482    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f1853d8-5758-4aae-8f64-f190e1e149e2-data-volume\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350605 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350605 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350530    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f1853d8-5758-4aae-8f64-f190e1e149e2-crio-socket\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350605 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.350579    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:14:09.350975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350615    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f1853d8-5758-4aae-8f64-f190e1e149e2-crio-socket\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.350975 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.350647    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:09.850627613 +0000 UTC m=+251.438930281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : configmap "kube-rbac-proxy" not found
Jul 12 15:14:09.350975 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.350698    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:09.350975 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.350735    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:09.850723162 +0000 UTC m=+251.439025818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:09.350975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.350896    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f1853d8-5758-4aae-8f64-f190e1e149e2-data-volume\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.358451 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.358422    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psgpt\" (UniqueName: \"kubernetes.io/projected/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-api-access-psgpt\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.855332 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.855292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.855518 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:09.855354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:09.855518 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.855439    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:14:09.855518 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.855461    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:09.855518 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.855501    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:10.855487375 +0000 UTC m=+252.443790023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : configmap "kube-rbac-proxy" not found
Jul 12 15:14:09.855518 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:09.855520    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:10.855506569 +0000 UTC m=+252.443809218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:10.198213 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.198129    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-sz8t4"]
Jul 12 15:14:10.201316 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.201291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.203771 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.203750    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 12 15:14:10.204778 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.204757    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 12 15:14:10.204933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.204796    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 12 15:14:10.204933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.204820    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 12 15:14:10.204933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.204822    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xzpl5\""
Jul 12 15:14:10.211924 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.209761    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-sz8t4"]
Jul 12 15:14:10.258191 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.258157    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhf9\" (UniqueName: \"kubernetes.io/projected/5cd763bd-7f50-4b28-80af-a92cad11f467-kube-api-access-fqhf9\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.258384 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.258279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-key\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.258384 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.258356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-cabundle\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.359192 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.359156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-cabundle\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.359192 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.359194    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhf9\" (UniqueName: \"kubernetes.io/projected/5cd763bd-7f50-4b28-80af-a92cad11f467-kube-api-access-fqhf9\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.359390 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.359238    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-key\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.359870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.359848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-cabundle\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.361584 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.361563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd763bd-7f50-4b28-80af-a92cad11f467-signing-key\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.367070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.367026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhf9\" (UniqueName: \"kubernetes.io/projected/5cd763bd-7f50-4b28-80af-a92cad11f467-kube-api-access-fqhf9\") pod \"service-ca-79f68b9f4f-sz8t4\" (UID: \"5cd763bd-7f50-4b28-80af-a92cad11f467\") " pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.513884 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.513795    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4"
Jul 12 15:14:10.638234 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.638196    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-sz8t4"]
Jul 12 15:14:10.641066 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:10.641037    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd763bd_7f50_4b28_80af_a92cad11f467.slice/crio-491f7be35f304337684e85bd8e56f81618af1495cdaa0afeed5c0bac262445fa WatchSource:0}: Error finding container 491f7be35f304337684e85bd8e56f81618af1495cdaa0afeed5c0bac262445fa: Status 404 returned error can't find the container with id 491f7be35f304337684e85bd8e56f81618af1495cdaa0afeed5c0bac262445fa
Jul 12 15:14:10.661579 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.661550    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:14:10.661766 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.661733    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:14:10.661927 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.661818    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs podName:072e7fce-1980-4b06-bac5-d74a9c1ff062 nodeName:}" failed. No retries permitted until 2026-07-12 15:16:12.661796525 +0000 UTC m=+374.250099179 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs") pod "network-metrics-daemon-66nfc" (UID: "072e7fce-1980-4b06-bac5-d74a9c1ff062") : secret "metrics-daemon-secret" not found
Jul 12 15:14:10.674359 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.674333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4" event={"ID":"5cd763bd-7f50-4b28-80af-a92cad11f467","Type":"ContainerStarted","Data":"491f7be35f304337684e85bd8e56f81618af1495cdaa0afeed5c0bac262445fa"}
Jul 12 15:14:10.863318 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.863279    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:10.863678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:10.863341    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:10.863678 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.863422    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:14:10.863678 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.863461    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:10.863678 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.863475    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:12.863461974 +0000 UTC m=+254.451764622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : configmap "kube-rbac-proxy" not found
Jul 12 15:14:10.863678 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:10.863538    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:12.86352026 +0000 UTC m=+254.451822908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:11.186499 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:11.186428    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6tc7_9cc54b52-fc61-4de7-a089-9b9937e543a7/dns-node-resolver/0.log"
Jul 12 15:14:11.679447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:11.679401    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4" event={"ID":"5cd763bd-7f50-4b28-80af-a92cad11f467","Type":"ContainerStarted","Data":"8c13729f0912135e4d0b7a149ebea17599114540b549b137a96c4dbc4e58009c"}
Jul 12 15:14:11.697083 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:11.697034    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-sz8t4" podStartSLOduration=1.697018039 podStartE2EDuration="1.697018039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:11.696007465 +0000 UTC m=+253.284310139" watchObservedRunningTime="2026-07-12 15:14:11.697018039 +0000 UTC m=+253.285320709"
Jul 12 15:14:12.385891 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:12.385835    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhlnq_3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2/node-ca/0.log"
Jul 12 15:14:12.880203 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:12.880172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:12.880653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:12.880241    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:12.880653 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:12.880295    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:14:12.880653 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:12.880354    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:16.880336672 +0000 UTC m=+258.468639342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : configmap "kube-rbac-proxy" not found
Jul 12 15:14:12.880653 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:12.880358    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:12.880653 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:12.880436    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:16.88041916 +0000 UTC m=+258.468721814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:13.185653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:13.185567    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njj2d_acf0c703-efa6-40f1-b941-658bb39adb7d/serve-healthcheck-canary/0.log"
Jul 12 15:14:16.911755 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:16.911717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:16.912182 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:16.911778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:16.912182 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:16.911846    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:14:16.912182 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:16.911861    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:16.912182 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:16.911928    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:24.911894485 +0000 UTC m=+266.500197133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:14:16.912182 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:16.911941    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm podName:7f1853d8-5758-4aae-8f64-f190e1e149e2 nodeName:}" failed. No retries permitted until 2026-07-12 15:14:24.911934357 +0000 UTC m=+266.500237006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsg7b" (UID: "7f1853d8-5758-4aae-8f64-f190e1e149e2") : configmap "kube-rbac-proxy" not found
Jul 12 15:14:24.976207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:24.976097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:24.976207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:24.976183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:24.976777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:24.976648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f1853d8-5758-4aae-8f64-f190e1e149e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:24.978482 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:24.978459    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f1853d8-5758-4aae-8f64-f190e1e149e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsg7b\" (UID: \"7f1853d8-5758-4aae-8f64-f190e1e149e2\") " pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:25.108081 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:25.108043    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsg7b"
Jul 12 15:14:25.230520 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:25.230440    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsg7b"]
Jul 12 15:14:25.233534 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:25.233509    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1853d8_5758_4aae_8f64_f190e1e149e2.slice/crio-66ec2e922ce8ec37df4ece723d607c8d9af7b392b9723aa65c526c2be62ab055 WatchSource:0}: Error finding container 66ec2e922ce8ec37df4ece723d607c8d9af7b392b9723aa65c526c2be62ab055: Status 404 returned error can't find the container with id 66ec2e922ce8ec37df4ece723d607c8d9af7b392b9723aa65c526c2be62ab055
Jul 12 15:14:25.726793 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:25.726700    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsg7b" event={"ID":"7f1853d8-5758-4aae-8f64-f190e1e149e2","Type":"ContainerStarted","Data":"66ec2e922ce8ec37df4ece723d607c8d9af7b392b9723aa65c526c2be62ab055"}
Jul 12 15:14:29.740348 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:29.740250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsg7b" event={"ID":"7f1853d8-5758-4aae-8f64-f190e1e149e2","Type":"ContainerStarted","Data":"0a79c8c722624c8d3ebfcd8ddc9c70854494038577b1889d692aa3309a856265"}
Jul 12 15:14:29.740348 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:29.740318    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsg7b" event={"ID":"7f1853d8-5758-4aae-8f64-f190e1e149e2","Type":"ContainerStarted","Data":"25d3a5a5b41fe4639aa0041f227bec905dd27b19a10879e96308ce6b6a0f4a46"}
Jul 12 15:14:31.976257 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.976226    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-mrk45"]
Jul 12 15:14:31.981215 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.981183    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:31.983448 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.983426    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 15:14:31.983639 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.983623    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 15:14:31.984083 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.984070    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-shphp\""
Jul 12 15:14:31.992632 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:31.992605    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-mrk45"]
Jul 12 15:14:32.019944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.019896    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6648cd57f9-jbvqz"]
Jul 12 15:14:32.022955 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.022930    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.025322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.025296    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 15:14:32.025471 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.025297    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 15:14:32.025471 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.025384    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hsr44\""
Jul 12 15:14:32.025471 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.025368    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 15:14:32.030518 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.030499    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 15:14:32.039287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.039263    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6648cd57f9-jbvqz"]
Jul 12 15:14:32.132820 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.132787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-tls\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.132820 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.132821    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-certificates\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.132845    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7ng\" (UniqueName: \"kubernetes.io/projected/de5d418d-f154-4197-ab71-39ac528f66d2-kube-api-access-2h7ng\") pod \"downloads-68c9cbb497-mrk45\" (UID: \"de5d418d-f154-4197-ab71-39ac528f66d2\") " pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:32.133071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.132872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-installation-pull-secrets\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.132994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e6e6304-79ed-499b-ae7d-66785fa8837e-ca-trust-extracted\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.133026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-image-registry-private-configuration\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.133059    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfch4\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-kube-api-access-bfch4\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133237 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.133090    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-trusted-ca\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.133237 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.133158    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-bound-sa-token\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234482 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-tls\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234482 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234485    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-certificates\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234513    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7ng\" (UniqueName: \"kubernetes.io/projected/de5d418d-f154-4197-ab71-39ac528f66d2-kube-api-access-2h7ng\") pod \"downloads-68c9cbb497-mrk45\" (UID: \"de5d418d-f154-4197-ab71-39ac528f66d2\") " pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-installation-pull-secrets\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e6e6304-79ed-499b-ae7d-66785fa8837e-ca-trust-extracted\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-image-registry-private-configuration\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234621    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfch4\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-kube-api-access-bfch4\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-trusted-ca\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.234743 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.234715    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-bound-sa-token\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.235176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.235148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e6e6304-79ed-499b-ae7d-66785fa8837e-ca-trust-extracted\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.235928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.235887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-certificates\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.236034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.235993    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e6e6304-79ed-499b-ae7d-66785fa8837e-trusted-ca\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.237204 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.237183    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-installation-pull-secrets\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.237309 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.237253    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-registry-tls\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.237399 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.237383    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e6e6304-79ed-499b-ae7d-66785fa8837e-image-registry-private-configuration\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.242056 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.242033    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-bound-sa-token\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.242167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.242067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfch4\" (UniqueName: \"kubernetes.io/projected/1e6e6304-79ed-499b-ae7d-66785fa8837e-kube-api-access-bfch4\") pod \"image-registry-6648cd57f9-jbvqz\" (UID: \"1e6e6304-79ed-499b-ae7d-66785fa8837e\") " pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.242209 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.242163    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7ng\" (UniqueName: \"kubernetes.io/projected/de5d418d-f154-4197-ab71-39ac528f66d2-kube-api-access-2h7ng\") pod \"downloads-68c9cbb497-mrk45\" (UID: \"de5d418d-f154-4197-ab71-39ac528f66d2\") " pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:32.290182 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.290140    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:32.333157 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.333116    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.426408 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.426152    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-mrk45"]
Jul 12 15:14:32.428841 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:32.428813    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5d418d_f154_4197_ab71_39ac528f66d2.slice/crio-4a5909436c93364474317cfc3c3348de5ade801c2d78ad4c73ac62373315c433 WatchSource:0}: Error finding container 4a5909436c93364474317cfc3c3348de5ade801c2d78ad4c73ac62373315c433: Status 404 returned error can't find the container with id 4a5909436c93364474317cfc3c3348de5ade801c2d78ad4c73ac62373315c433
Jul 12 15:14:32.474045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.474014    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6648cd57f9-jbvqz"]
Jul 12 15:14:32.476946 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:32.476894    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6e6304_79ed_499b_ae7d_66785fa8837e.slice/crio-9ee46f152bc1044c22099eedcb3c4d9bdb42d724053ffd52e1bcef83928c8a6b WatchSource:0}: Error finding container 9ee46f152bc1044c22099eedcb3c4d9bdb42d724053ffd52e1bcef83928c8a6b: Status 404 returned error can't find the container with id 9ee46f152bc1044c22099eedcb3c4d9bdb42d724053ffd52e1bcef83928c8a6b
Jul 12 15:14:32.753698 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.753587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz" event={"ID":"1e6e6304-79ed-499b-ae7d-66785fa8837e","Type":"ContainerStarted","Data":"126d912005e2ba949bc23b286004fc66e80eabe7e640c54363b0d3b7646c8821"}
Jul 12 15:14:32.753698 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.753659    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:32.753698 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.753683    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz" event={"ID":"1e6e6304-79ed-499b-ae7d-66785fa8837e","Type":"ContainerStarted","Data":"9ee46f152bc1044c22099eedcb3c4d9bdb42d724053ffd52e1bcef83928c8a6b"}
Jul 12 15:14:32.755670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.755638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsg7b" event={"ID":"7f1853d8-5758-4aae-8f64-f190e1e149e2","Type":"ContainerStarted","Data":"ad3df9a3dcacab41d990633f6c295068833e7eef005cefd4d437db90befddcaa"}
Jul 12 15:14:32.756801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.756769    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-mrk45" event={"ID":"de5d418d-f154-4197-ab71-39ac528f66d2","Type":"ContainerStarted","Data":"4a5909436c93364474317cfc3c3348de5ade801c2d78ad4c73ac62373315c433"}
Jul 12 15:14:32.770611 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.770561    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz" podStartSLOduration=1.770545363 podStartE2EDuration="1.770545363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:32.770124477 +0000 UTC m=+274.358427144" watchObservedRunningTime="2026-07-12 15:14:32.770545363 +0000 UTC m=+274.358848077"
Jul 12 15:14:32.787959 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:32.787884    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nsg7b" podStartSLOduration=17.308549798 podStartE2EDuration="23.787862508s" totalImagesPullingTime="6.47931271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:14:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:32.787663202 +0000 UTC m=+274.375965871" watchObservedRunningTime="2026-07-12 15:14:32.787862508 +0000 UTC m=+274.376165180"
Jul 12 15:14:39.076395 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.076356    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jrbn6"]
Jul 12 15:14:39.081071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.081045    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.083530 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.083506    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 15:14:39.083786 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.083770    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 15:14:39.083979 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.083964    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 15:14:39.084227 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.084212    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 15:14:39.084541 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.084525    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cxgsr\""
Jul 12 15:14:39.084794 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.084735    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 15:14:39.085002 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.084983    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-metrics-client-ca\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-sys\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198684    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6r4p\" (UniqueName: \"kubernetes.io/projected/52884b6e-b27d-484f-bdc0-d0054391ab0d-kube-api-access-s6r4p\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-root\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198742    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-textfile\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-wtmp\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.198989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.198816    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-tls\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.299782 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.299747    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6r4p\" (UniqueName: \"kubernetes.io/projected/52884b6e-b27d-484f-bdc0-d0054391ab0d-kube-api-access-s6r4p\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.299782 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.299794    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-root\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.299857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-root\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.299920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-textfile\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.299968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-wtmp\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300005    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-tls\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300081    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300123    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-metrics-client-ca\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300148    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-sys\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300432 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300250    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-sys\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300432 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300251    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-wtmp\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300626 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-textfile\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.300843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.300819    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.301128 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.301088    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52884b6e-b27d-484f-bdc0-d0054391ab0d-metrics-client-ca\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.302892 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.302867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.303497 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.303416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52884b6e-b27d-484f-bdc0-d0054391ab0d-node-exporter-tls\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.308581 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.308556    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6r4p\" (UniqueName: \"kubernetes.io/projected/52884b6e-b27d-484f-bdc0-d0054391ab0d-kube-api-access-s6r4p\") pod \"node-exporter-jrbn6\" (UID: \"52884b6e-b27d-484f-bdc0-d0054391ab0d\") " pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.393559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.393477    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrbn6"
Jul 12 15:14:39.410261 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:39.410224    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52884b6e_b27d_484f_bdc0_d0054391ab0d.slice/crio-2ca761bbf3b8d1895b31a1a9fd3bef563a10cc4115c7030128c5cb3d1ebfe887 WatchSource:0}: Error finding container 2ca761bbf3b8d1895b31a1a9fd3bef563a10cc4115c7030128c5cb3d1ebfe887: Status 404 returned error can't find the container with id 2ca761bbf3b8d1895b31a1a9fd3bef563a10cc4115c7030128c5cb3d1ebfe887
Jul 12 15:14:39.785757 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:39.785677    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrbn6" event={"ID":"52884b6e-b27d-484f-bdc0-d0054391ab0d","Type":"ContainerStarted","Data":"2ca761bbf3b8d1895b31a1a9fd3bef563a10cc4115c7030128c5cb3d1ebfe887"}
Jul 12 15:14:40.791539 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:40.791454    2566 generic.go:356] "Generic (PLEG): container finished" podID="52884b6e-b27d-484f-bdc0-d0054391ab0d" containerID="1ef64a17438941b21f3caec24bd6fc83fc05483fde69518a7f28886fd3e96909" exitCode=0
Jul 12 15:14:40.791983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:40.791541    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrbn6" event={"ID":"52884b6e-b27d-484f-bdc0-d0054391ab0d","Type":"ContainerDied","Data":"1ef64a17438941b21f3caec24bd6fc83fc05483fde69518a7f28886fd3e96909"}
Jul 12 15:14:41.419348 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:41.419306    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lvpkx" podUID="d8c61357-21b2-4fd2-8ebc-a65c9711d147"
Jul 12 15:14:41.798225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:41.798184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrbn6" event={"ID":"52884b6e-b27d-484f-bdc0-d0054391ab0d","Type":"ContainerStarted","Data":"9daecd39b522453f26b352954a1508772307dcb047eab67a62d9463f3993e0d6"}
Jul 12 15:14:41.798225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:41.798224    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:14:41.798756 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:41.798249    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrbn6" event={"ID":"52884b6e-b27d-484f-bdc0-d0054391ab0d","Type":"ContainerStarted","Data":"4a32e0fd67a721d4462ea42e763bd78c47cb25fe0dc61cf5e2cddc7b428688aa"}
Jul 12 15:14:41.816408 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:41.816345    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jrbn6" podStartSLOduration=1.6725557869999998 podStartE2EDuration="2.816323373s" totalImagesPullingTime="1.072117836s" totalInitContainerRuntime="71.64975ms" isStatefulPod=true podCreationTimestamp="2026-07-12 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:41.814649039 +0000 UTC m=+283.402951708" watchObservedRunningTime="2026-07-12 15:14:41.816323373 +0000 UTC m=+283.404626042"
Jul 12 15:14:43.355859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.355820    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67fb5f8449-nlr9t"]
Jul 12 15:14:43.360046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.360019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.362132 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.362107    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 12 15:14:43.362275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.362253    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 15:14:43.363118 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.363068    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pl7s7\""
Jul 12 15:14:43.363212 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.363119    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 12 15:14:43.363212 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.363144    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 12 15:14:43.363212 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.363172    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4rlpldrvqu5nd\""
Jul 12 15:14:43.368589 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.368568    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67fb5f8449-nlr9t"]
Jul 12 15:14:43.537641 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-tls\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.537818 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.537818 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537687    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-metrics-server-audit-profiles\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.537818 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537759    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-client-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.537818 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-audit-log\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.538103 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-925b5\" (UniqueName: \"kubernetes.io/projected/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-kube-api-access-925b5\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.538103 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.537996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-client-certs\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-client-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-audit-log\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-925b5\" (UniqueName: \"kubernetes.io/projected/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-kube-api-access-925b5\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-client-certs\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-tls\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.638973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.638879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-metrics-server-audit-profiles\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.639219 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.639168    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-audit-log\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.639644 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.639614    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.640001 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.639974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-metrics-server-audit-profiles\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.641629 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.641599    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-client-certs\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.641777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.641753    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-secret-metrics-server-tls\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.641777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.641763    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-client-ca-bundle\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.646212 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.646183    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-925b5\" (UniqueName: \"kubernetes.io/projected/d98fedbd-2fdd-4ca5-895e-bb96020a89d5-kube-api-access-925b5\") pod \"metrics-server-67fb5f8449-nlr9t\" (UID: \"d98fedbd-2fdd-4ca5-895e-bb96020a89d5\") " pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:43.671083 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:43.671048    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:14:44.547325 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:44.547290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:14:44.549925 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:44.549887    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8c61357-21b2-4fd2-8ebc-a65c9711d147-metrics-tls\") pod \"dns-default-lvpkx\" (UID: \"d8c61357-21b2-4fd2-8ebc-a65c9711d147\") " pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:14:44.801421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:44.801339    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72hfp\""
Jul 12 15:14:44.810713 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:44.810511    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:14:48.683809 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.683777    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67fb5f8449-nlr9t"]
Jul 12 15:14:48.687076 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:48.687053    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98fedbd_2fdd_4ca5_895e_bb96020a89d5.slice/crio-6574e2160a1003dad1adcb850353a9534373b78d46dc72065dd0384ae9799424 WatchSource:0}: Error finding container 6574e2160a1003dad1adcb850353a9534373b78d46dc72065dd0384ae9799424: Status 404 returned error can't find the container with id 6574e2160a1003dad1adcb850353a9534373b78d46dc72065dd0384ae9799424
Jul 12 15:14:48.696203 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.696179    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lvpkx"]
Jul 12 15:14:48.705289 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:14:48.705260    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c61357_21b2_4fd2_8ebc_a65c9711d147.slice/crio-64f68bc95c44ed0fc700c421fe3527b6a9a65cf8fe5343f84e936d6af1ed04f7 WatchSource:0}: Error finding container 64f68bc95c44ed0fc700c421fe3527b6a9a65cf8fe5343f84e936d6af1ed04f7: Status 404 returned error can't find the container with id 64f68bc95c44ed0fc700c421fe3527b6a9a65cf8fe5343f84e936d6af1ed04f7
Jul 12 15:14:48.830448 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.830365    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-mrk45" event={"ID":"de5d418d-f154-4197-ab71-39ac528f66d2","Type":"ContainerStarted","Data":"fe82c337232f36702aeb1bc816831aaf396d4c7b9e79aee62e338e1ebf43f76c"}
Jul 12 15:14:48.830606 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.830541    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:48.831892 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.831860    2566 patch_prober.go:28] interesting pod/downloads-68c9cbb497-mrk45 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.12:8080/\": dial tcp 10.134.0.12:8080: connect: connection refused" start-of-body=
Jul 12 15:14:48.832021 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.831940    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-mrk45" podUID="de5d418d-f154-4197-ab71-39ac528f66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.12:8080/\": dial tcp 10.134.0.12:8080: connect: connection refused"
Jul 12 15:14:48.832080 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.832023    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t" event={"ID":"d98fedbd-2fdd-4ca5-895e-bb96020a89d5","Type":"ContainerStarted","Data":"6574e2160a1003dad1adcb850353a9534373b78d46dc72065dd0384ae9799424"}
Jul 12 15:14:48.833188 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.833163    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvpkx" event={"ID":"d8c61357-21b2-4fd2-8ebc-a65c9711d147","Type":"ContainerStarted","Data":"64f68bc95c44ed0fc700c421fe3527b6a9a65cf8fe5343f84e936d6af1ed04f7"}
Jul 12 15:14:48.847707 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:48.847649    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-mrk45" podStartSLOduration=1.633112093 podStartE2EDuration="17.847633823s" totalImagesPullingTime="16.21452173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:48.846382585 +0000 UTC m=+290.434685255" watchObservedRunningTime="2026-07-12 15:14:48.847633823 +0000 UTC m=+290.435936470"
Jul 12 15:14:49.858274 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:49.858239    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-mrk45"
Jul 12 15:14:51.849198 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.849109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t" event={"ID":"d98fedbd-2fdd-4ca5-895e-bb96020a89d5","Type":"ContainerStarted","Data":"a327dc19723858b3c9f39cedc1c2e2091bb0e0dffde434ea93182ce91c4d240e"}
Jul 12 15:14:51.851307 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.851272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvpkx" event={"ID":"d8c61357-21b2-4fd2-8ebc-a65c9711d147","Type":"ContainerStarted","Data":"2a9d32f688092b5f731b11b54f1b8bf83e91e4f2b2846313ca41d7f3668a845f"}
Jul 12 15:14:51.851455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.851329    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvpkx" event={"ID":"d8c61357-21b2-4fd2-8ebc-a65c9711d147","Type":"ContainerStarted","Data":"0d3044fb0cc21707b0eeeaf30ec039e6ef86c2d034dfe00db4e8391259c196e0"}
Jul 12 15:14:51.851455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.851378    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:14:51.864801 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.864747    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t" podStartSLOduration=6.298845029 podStartE2EDuration="8.864727066s" totalImagesPullingTime="2.565882037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:51.863638497 +0000 UTC m=+293.451941166" watchObservedRunningTime="2026-07-12 15:14:51.864727066 +0000 UTC m=+293.453029735"
Jul 12 15:14:51.878451 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:51.878373    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lvpkx" podStartSLOduration=255.325905759 podStartE2EDuration="4m17.878353854s" totalImagesPullingTime="2.552448095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:14:51.877801589 +0000 UTC m=+293.466104260" watchObservedRunningTime="2026-07-12 15:14:51.878353854 +0000 UTC m=+293.466656537"
Jul 12 15:14:53.766403 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:53.766367    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6648cd57f9-jbvqz"
Jul 12 15:14:57.868838 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:14:57.868790    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-66nfc" podUID="072e7fce-1980-4b06-bac5-d74a9c1ff062"
Jul 12 15:14:58.747760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:58.747721    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:14:58.748192 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:58.748174    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:14:58.754447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:14:58.754424    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 15:15:01.857731 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:01.857697    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lvpkx"
Jul 12 15:15:03.671355 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:03.671321    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:15:03.671753 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:03.671379    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:15:09.180433 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:09.180391    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" podUID="c1b028f1-d61a-4013-92fc-b05a53e84847" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 15:15:12.871355 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:12.871329    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:15:19.180370 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:19.180319    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" podUID="c1b028f1-d61a-4013-92fc-b05a53e84847" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 15:15:23.678270 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:23.677714    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:15:23.682209 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:23.682190    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67fb5f8449-nlr9t"
Jul 12 15:15:29.180543 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.180501    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" podUID="c1b028f1-d61a-4013-92fc-b05a53e84847" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 12 15:15:29.181027 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.180586    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg"
Jul 12 15:15:29.181082 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.181051    2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b9ba7af06d491820153c8394fb8650f27a5a35a4e5f7268e1fcc256b68517934"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 12 15:15:29.181144 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.181101    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" podUID="c1b028f1-d61a-4013-92fc-b05a53e84847" containerName="service-proxy" containerID="cri-o://b9ba7af06d491820153c8394fb8650f27a5a35a4e5f7268e1fcc256b68517934" gracePeriod=30
Jul 12 15:15:29.980758 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.980723    2566 generic.go:356] "Generic (PLEG): container finished" podID="c1b028f1-d61a-4013-92fc-b05a53e84847" containerID="b9ba7af06d491820153c8394fb8650f27a5a35a4e5f7268e1fcc256b68517934" exitCode=2
Jul 12 15:15:29.980974 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.980766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerDied","Data":"b9ba7af06d491820153c8394fb8650f27a5a35a4e5f7268e1fcc256b68517934"}
Jul 12 15:15:29.980974 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:29.980806    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8679d55575-45ppg" event={"ID":"c1b028f1-d61a-4013-92fc-b05a53e84847","Type":"ContainerStarted","Data":"8b375571fa4fd5d44a70edcf9aaf462126f476157765e651c284425b067c6e6b"}
Jul 12 15:15:38.009609 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:38.009577    2566 generic.go:356] "Generic (PLEG): container finished" podID="0dd5f1bc-3548-480c-b22e-89e73fef89d1" containerID="53be18ac10a17e8717bae57304f85247aa389c5fdbdfcf2f2069f28c86ba45ba" exitCode=0
Jul 12 15:15:38.010180 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:38.009649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps" event={"ID":"0dd5f1bc-3548-480c-b22e-89e73fef89d1","Type":"ContainerDied","Data":"53be18ac10a17e8717bae57304f85247aa389c5fdbdfcf2f2069f28c86ba45ba"}
Jul 12 15:15:38.010180 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:38.010050    2566 scope.go:117] "RemoveContainer" containerID="53be18ac10a17e8717bae57304f85247aa389c5fdbdfcf2f2069f28c86ba45ba"
Jul 12 15:15:39.019205 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:15:39.019171    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zvkps" event={"ID":"0dd5f1bc-3548-480c-b22e-89e73fef89d1","Type":"ContainerStarted","Data":"5b36f229f0cea550809ec534035fd997a6c476d568312ed1ea285bf400f1ea10"}
Jul 12 15:16:12.667979 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:12.667856    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:16:12.670200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:12.670176    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072e7fce-1980-4b06-bac5-d74a9c1ff062-metrics-certs\") pod \"network-metrics-daemon-66nfc\" (UID: \"072e7fce-1980-4b06-bac5-d74a9c1ff062\") " pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:16:12.873992 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:12.873961    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn9r4\""
Jul 12 15:16:12.882824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:12.882798    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nfc"
Jul 12 15:16:13.016166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:13.016013    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66nfc"]
Jul 12 15:16:13.019250 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:16:13.019216    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072e7fce_1980_4b06_bac5_d74a9c1ff062.slice/crio-6789bd0497aaf2aac9df0cc968f2b9aff70a3ce2eef443a9029a2bab04d4c658 WatchSource:0}: Error finding container 6789bd0497aaf2aac9df0cc968f2b9aff70a3ce2eef443a9029a2bab04d4c658: Status 404 returned error can't find the container with id 6789bd0497aaf2aac9df0cc968f2b9aff70a3ce2eef443a9029a2bab04d4c658
Jul 12 15:16:13.021194 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:13.021177    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:16:13.133315 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:13.133277    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nfc" event={"ID":"072e7fce-1980-4b06-bac5-d74a9c1ff062","Type":"ContainerStarted","Data":"6789bd0497aaf2aac9df0cc968f2b9aff70a3ce2eef443a9029a2bab04d4c658"}
Jul 12 15:16:14.138414 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:14.138378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nfc" event={"ID":"072e7fce-1980-4b06-bac5-d74a9c1ff062","Type":"ContainerStarted","Data":"592d6ee8022238c2c5a50e04e848ffbfd98fb015fa15435470faed5f24ca92fa"}
Jul 12 15:16:14.138796 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:14.138437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nfc" event={"ID":"072e7fce-1980-4b06-bac5-d74a9c1ff062","Type":"ContainerStarted","Data":"882a3af3d6a67e340beff0f885303097617caede1678af87ebe245f8d94f48ac"}
Jul 12 15:16:14.153159 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:16:14.153112    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-66nfc" podStartSLOduration=375.26820645 podStartE2EDuration="6m16.15309503s" totalImagesPullingTime="884.88858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:16:14.152840437 +0000 UTC m=+375.741143108" watchObservedRunningTime="2026-07-12 15:16:14.15309503 +0000 UTC m=+375.741397696"
Jul 12 15:18:32.437837 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.437803    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"]
Jul 12 15:18:32.440871 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.440850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.443213 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.443193    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hf7dr\""
Jul 12 15:18:32.443297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.443235    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 12 15:18:32.443346 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.443302    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:18:32.454775 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.454742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"]
Jul 12 15:18:32.516112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.516078    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.516112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.516127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjn2\" (UniqueName: \"kubernetes.io/projected/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-kube-api-access-2zjn2\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.616833 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.616795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.617045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.616855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjn2\" (UniqueName: \"kubernetes.io/projected/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-kube-api-access-2zjn2\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.617214 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.617195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.625301 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.625260    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjn2\" (UniqueName: \"kubernetes.io/projected/9cd36f1f-1294-44fa-8a4d-3b2d704344ff-kube-api-access-2zjn2\") pod \"cert-manager-operator-controller-manager-55c444bf86-bnkq7\" (UID: \"9cd36f1f-1294-44fa-8a4d-3b2d704344ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.750289 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.750195    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"
Jul 12 15:18:32.887344 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:32.887308    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7"]
Jul 12 15:18:32.891152 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:18:32.891122    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd36f1f_1294_44fa_8a4d_3b2d704344ff.slice/crio-6cb03d58f2653ef8371644f93d23a91a4bed192c36f2c2b12d09ce216410c7e9 WatchSource:0}: Error finding container 6cb03d58f2653ef8371644f93d23a91a4bed192c36f2c2b12d09ce216410c7e9: Status 404 returned error can't find the container with id 6cb03d58f2653ef8371644f93d23a91a4bed192c36f2c2b12d09ce216410c7e9
Jul 12 15:18:33.612953 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:33.612893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7" event={"ID":"9cd36f1f-1294-44fa-8a4d-3b2d704344ff","Type":"ContainerStarted","Data":"6cb03d58f2653ef8371644f93d23a91a4bed192c36f2c2b12d09ce216410c7e9"}
Jul 12 15:18:50.674241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:50.674203    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7" event={"ID":"9cd36f1f-1294-44fa-8a4d-3b2d704344ff","Type":"ContainerStarted","Data":"38c0879a4f8a32d0b11883b29c6ded3e59519454c744637ea55c506eb2f0896a"}
Jul 12 15:18:50.692473 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:50.692381    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bnkq7" podStartSLOduration=1.515344585 podStartE2EDuration="18.692364651s" totalImagesPullingTime="17.177020066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:18:50.690875693 +0000 UTC m=+532.279178361" watchObservedRunningTime="2026-07-12 15:18:50.692364651 +0000 UTC m=+532.280667322"
Jul 12 15:18:52.029719 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.029683    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"]
Jul 12 15:18:52.032874 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.032854    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.035140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.035107    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 15:18:52.035273 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.035228    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 15:18:52.036065 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.036041    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n9lk2\""
Jul 12 15:18:52.040780 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.040755    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"]
Jul 12 15:18:52.170395 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.170343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.170559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.170409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v66s\" (UniqueName: \"kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.170559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.170446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.271544 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.271505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.271732 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.271552    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v66s\" (UniqueName: \"kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.271732 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.271685    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.271971 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.271951    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.272025 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.272009    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.278732 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.278706    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v66s\" (UniqueName: \"kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.343258 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.343177    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:18:52.468885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.468853    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"]
Jul 12 15:18:52.472002 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:18:52.471976    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473a8f6f_f67b_4a63_9ad8_07e6ac69cf9d.slice/crio-dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7 WatchSource:0}: Error finding container dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7: Status 404 returned error can't find the container with id dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7
Jul 12 15:18:52.682452 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:52.682418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k" event={"ID":"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d","Type":"ContainerStarted","Data":"dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7"}
Jul 12 15:18:58.711306 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:58.711215    2566 generic.go:356] "Generic (PLEG): container finished" podID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerID="06a9104383328dfd1a52addeda2c0cec5abc4d1e38ef2a6913d7003f9c5e8eb5" exitCode=0
Jul 12 15:18:58.711306 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:18:58.711291    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k" event={"ID":"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d","Type":"ContainerDied","Data":"06a9104383328dfd1a52addeda2c0cec5abc4d1e38ef2a6913d7003f9c5e8eb5"}
Jul 12 15:19:01.726633 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.726596    2566 generic.go:356] "Generic (PLEG): container finished" podID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerID="22881dc07fd9c4afa339fdc92716f2bd8e2c66bdf74e137d5c762588b629b14c" exitCode=0
Jul 12 15:19:01.727036 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.726647    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k" event={"ID":"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d","Type":"ContainerDied","Data":"22881dc07fd9c4afa339fdc92716f2bd8e2c66bdf74e137d5c762588b629b14c"}
Jul 12 15:19:01.756141 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.756107    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpppj"]
Jul 12 15:19:01.759463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.759442    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.761675 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.761647    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fkmlh\""
Jul 12 15:19:01.761819 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.761648    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 15:19:01.761819 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.761757    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 15:19:01.765562 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.765533    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpppj"]
Jul 12 15:19:01.855302 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.855258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.855302 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.855307    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-kube-api-access-ntmwq\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.956027 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.955992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.956206 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.956042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-kube-api-access-ntmwq\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.963493 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.963455    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-bound-sa-token\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:01.963660 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:01.963610    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7ce96456-dcef-4714-b531-f6fe7c5cfba3-kube-api-access-ntmwq\") pod \"cert-manager-55b4d954d5-hpppj\" (UID: \"7ce96456-dcef-4714-b531-f6fe7c5cfba3\") " pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:02.068948 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:02.068815    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hpppj"
Jul 12 15:19:02.200566 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:02.200531    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hpppj"]
Jul 12 15:19:02.203408 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:19:02.203376    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ce96456_dcef_4714_b531_f6fe7c5cfba3.slice/crio-f01f1f1ac213fefb3bb349900a5d0e64f3b932a0ddd8c0d835c995cbb23e0a51 WatchSource:0}: Error finding container f01f1f1ac213fefb3bb349900a5d0e64f3b932a0ddd8c0d835c995cbb23e0a51: Status 404 returned error can't find the container with id f01f1f1ac213fefb3bb349900a5d0e64f3b932a0ddd8c0d835c995cbb23e0a51
Jul 12 15:19:02.734036 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:02.734000    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hpppj" event={"ID":"7ce96456-dcef-4714-b531-f6fe7c5cfba3","Type":"ContainerStarted","Data":"f01f1f1ac213fefb3bb349900a5d0e64f3b932a0ddd8c0d835c995cbb23e0a51"}
Jul 12 15:19:05.751591 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:05.751553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hpppj" event={"ID":"7ce96456-dcef-4714-b531-f6fe7c5cfba3","Type":"ContainerStarted","Data":"365ae6905d36f4e7329a3d9ce46b88cb128e5301f48f1c127b0af92517c65bb0"}
Jul 12 15:19:05.765495 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:05.765440    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hpppj" podStartSLOduration=1.65257011 podStartE2EDuration="4.765415494s" totalImagesPullingTime="3.112845384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:19:05.76453324 +0000 UTC m=+547.352835911" watchObservedRunningTime="2026-07-12 15:19:05.765415494 +0000 UTC m=+547.353718166"
Jul 12 15:19:09.772926 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:09.772876    2566 generic.go:356] "Generic (PLEG): container finished" podID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerID="7d46f7d7ff97f95128d43856f8e6a560eb4b18e89b6dfa69f682aacfffd62301" exitCode=0
Jul 12 15:19:09.773340 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:09.772939    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k" event={"ID":"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d","Type":"ContainerDied","Data":"7d46f7d7ff97f95128d43856f8e6a560eb4b18e89b6dfa69f682aacfffd62301"}
Jul 12 15:19:10.901610 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:10.901583    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:19:11.034046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.033955    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle\") pod \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") "
Jul 12 15:19:11.034046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.033989    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util\") pod \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") "
Jul 12 15:19:11.034225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.034072    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v66s\" (UniqueName: \"kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s\") pod \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\" (UID: \"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d\") "
Jul 12 15:19:11.034367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.034346    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle" (OuterVolumeSpecName: "bundle") pod "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" (UID: "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:19:11.036262 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.036232    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s" (OuterVolumeSpecName: "kube-api-access-4v66s") pod "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" (UID: "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d"). InnerVolumeSpecName "kube-api-access-4v66s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:19:11.039034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.039012    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util" (OuterVolumeSpecName: "util") pod "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" (UID: "473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:19:11.135160 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.135100    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v66s\" (UniqueName: \"kubernetes.io/projected/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-kube-api-access-4v66s\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:19:11.135160 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.135151    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:19:11.135160 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.135165    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:19:11.781533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.781498    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k" event={"ID":"473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d","Type":"ContainerDied","Data":"dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7"}
Jul 12 15:19:11.781533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.781523    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgkq7k"
Jul 12 15:19:11.781750 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:11.781547    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcd0e0807ddb259627f4398d664624b784b6a8a0ce0517eae28c74c920c5b3e7"
Jul 12 15:19:16.176659 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.176622    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"]
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.176992    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="pull"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177009    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="pull"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177021    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="util"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177029    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="util"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177039    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="extract"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177047    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="extract"
Jul 12 15:19:16.177137 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.177121    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="473a8f6f-f67b-4a63-9ad8-07e6ac69cf9d" containerName="extract"
Jul 12 15:19:16.246561 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.246517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"]
Jul 12 15:19:16.246723 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.246636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.248976 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.248953    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:19:16.249104 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.248984    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 15:19:16.249747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.249733    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rn5wt\""
Jul 12 15:19:16.375419 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.375373    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/06699e09-2996-4408-97fe-bd08ed4853dd-kube-api-access-fq7sk\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.375419 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.375424    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06699e09-2996-4408-97fe-bd08ed4853dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.476721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.476634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/06699e09-2996-4408-97fe-bd08ed4853dd-kube-api-access-fq7sk\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.476721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.476683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06699e09-2996-4408-97fe-bd08ed4853dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.477116 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.477098    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06699e09-2996-4408-97fe-bd08ed4853dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.486808 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.486773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/06699e09-2996-4408-97fe-bd08ed4853dd-kube-api-access-fq7sk\") pod \"openshift-lws-operator-fd8ccff4c-tj5vm\" (UID: \"06699e09-2996-4408-97fe-bd08ed4853dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.555701 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.555651    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"
Jul 12 15:19:16.700266 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.700241    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm"]
Jul 12 15:19:16.702870 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:19:16.702839    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06699e09_2996_4408_97fe_bd08ed4853dd.slice/crio-82f6def282c90ead9550750ea5bbd164ee43083c5fe125f881b76068aa4bfe76 WatchSource:0}: Error finding container 82f6def282c90ead9550750ea5bbd164ee43083c5fe125f881b76068aa4bfe76: Status 404 returned error can't find the container with id 82f6def282c90ead9550750ea5bbd164ee43083c5fe125f881b76068aa4bfe76
Jul 12 15:19:16.804236 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:16.804157    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm" event={"ID":"06699e09-2996-4408-97fe-bd08ed4853dd","Type":"ContainerStarted","Data":"82f6def282c90ead9550750ea5bbd164ee43083c5fe125f881b76068aa4bfe76"}
Jul 12 15:19:19.819235 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:19.819196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm" event={"ID":"06699e09-2996-4408-97fe-bd08ed4853dd","Type":"ContainerStarted","Data":"525afe1c840066c27704d2f3a425eda15ab3d418609e6e42a961fdb0a0675dcb"}
Jul 12 15:19:19.834133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:19.834055    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5vm" podStartSLOduration=1.410297676 podStartE2EDuration="3.834037249s" totalImagesPullingTime="2.423739573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:19:19.832988689 +0000 UTC m=+561.421291361" watchObservedRunningTime="2026-07-12 15:19:19.834037249 +0000 UTC m=+561.422339917"
Jul 12 15:19:39.083249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.083208    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"]
Jul 12 15:19:39.085710 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.085684    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.087993 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.087970    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 15:19:39.088282 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.088261    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 15:19:39.088361 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.088280    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 15:19:39.088361 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.088261    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 15:19:39.088677 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.088656    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9xpzx\""
Jul 12 15:19:39.115887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.115855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"]
Jul 12 15:19:39.146745 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.146705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-tmp\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.146944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.146759    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-manifests\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.146944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.146812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brmq\" (UniqueName: \"kubernetes.io/projected/d8b30e77-3207-42cc-9be6-8c7c7aa21248-kube-api-access-6brmq\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.146944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.146840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.147076 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.146975    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-manifests\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248100    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brmq\" (UniqueName: \"kubernetes.io/projected/d8b30e77-3207-42cc-9be6-8c7c7aa21248-kube-api-access-6brmq\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248309 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248309 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248247    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248384 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-tmp\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.248518 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.248495    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-manifests\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.250495 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.250467    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b30e77-3207-42cc-9be6-8c7c7aa21248-tmp\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.250727 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.250710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.250784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.250762    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b30e77-3207-42cc-9be6-8c7c7aa21248-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.263412 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.263379    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brmq\" (UniqueName: \"kubernetes.io/projected/d8b30e77-3207-42cc-9be6-8c7c7aa21248-kube-api-access-6brmq\") pod \"opendatahub-operator-controller-manager-d5d6cd7fc-hztjr\" (UID: \"d8b30e77-3207-42cc-9be6-8c7c7aa21248\") " pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.396195 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.396150    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:39.536055 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.536024    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"]
Jul 12 15:19:39.539718 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:19:39.539690    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b30e77_3207_42cc_9be6_8c7c7aa21248.slice/crio-849fe8ed934d7a2cbc7441816e1e7e70e9c8d7fcee2d098451fadfd2b7a6fd2a WatchSource:0}: Error finding container 849fe8ed934d7a2cbc7441816e1e7e70e9c8d7fcee2d098451fadfd2b7a6fd2a: Status 404 returned error can't find the container with id 849fe8ed934d7a2cbc7441816e1e7e70e9c8d7fcee2d098451fadfd2b7a6fd2a
Jul 12 15:19:39.897330 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:39.897293    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr" event={"ID":"d8b30e77-3207-42cc-9be6-8c7c7aa21248","Type":"ContainerStarted","Data":"849fe8ed934d7a2cbc7441816e1e7e70e9c8d7fcee2d098451fadfd2b7a6fd2a"}
Jul 12 15:19:42.912675 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:42.912638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr" event={"ID":"d8b30e77-3207-42cc-9be6-8c7c7aa21248","Type":"ContainerStarted","Data":"49bee47e668d553ad6ba327d629cd5545095c7f1639be903b08303971fdcd424"}
Jul 12 15:19:43.917820 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:43.917788    2566 generic.go:356] "Generic (PLEG): container finished" podID="d8b30e77-3207-42cc-9be6-8c7c7aa21248" containerID="49bee47e668d553ad6ba327d629cd5545095c7f1639be903b08303971fdcd424" exitCode=0
Jul 12 15:19:43.918235 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:43.917863    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr" event={"ID":"d8b30e77-3207-42cc-9be6-8c7c7aa21248","Type":"ContainerDied","Data":"49bee47e668d553ad6ba327d629cd5545095c7f1639be903b08303971fdcd424"}
Jul 12 15:19:44.923972 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:44.923939    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr" event={"ID":"d8b30e77-3207-42cc-9be6-8c7c7aa21248","Type":"ContainerStarted","Data":"8a7174f564a8577baab27506a9bf4680351d18f5bb7bbdf1de19c4203c9ed658"}
Jul 12 15:19:44.924357 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:44.924067    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:44.945051 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:44.945000    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr" podStartSLOduration=1.692431386 podStartE2EDuration="5.944981771s" totalImagesPullingTime="3.246951407s" totalInitContainerRuntime="1.005598978s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:19:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:19:44.943021687 +0000 UTC m=+586.531324369" watchObservedRunningTime="2026-07-12 15:19:44.944981771 +0000 UTC m=+586.533284439"
Jul 12 15:19:55.930895 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:55.930864    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5d6cd7fc-hztjr"
Jul 12 15:19:58.774374 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:58.774343    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:19:58.775071 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:19:58.775050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:20:04.899108 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.899072    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"]
Jul 12 15:20:04.902444 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.902414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:04.904687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.904661    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 15:20:04.904824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.904804    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 15:20:04.904893 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.904824    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 15:20:04.905096 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.905083    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 15:20:04.913293 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.913264    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"]
Jul 12 15:20:04.967712 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.967674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7pwc\" (UniqueName: \"kubernetes.io/projected/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-kube-api-access-f7pwc\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:04.967947 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.967813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tmp\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:04.967947 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:04.967895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tls-certs\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.056399 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.056355    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x9qjw"]
Jul 12 15:20:05.061841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.061811    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.065378 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.065351    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vbcgp\""
Jul 12 15:20:05.065378 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.065352    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 12 15:20:05.069205 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.069173    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tmp\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.069327 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.069242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tls-certs\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.069327 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.069304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7pwc\" (UniqueName: \"kubernetes.io/projected/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-kube-api-access-f7pwc\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.072023 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.072002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tmp\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.072125 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.072107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-tls-certs\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.075196 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.075165    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x9qjw"]
Jul 12 15:20:05.081040 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.081007    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7pwc\" (UniqueName: \"kubernetes.io/projected/1e4fbbfc-9c9e-48b3-a5ad-26761640138e-kube-api-access-f7pwc\") pod \"kube-auth-proxy-6fd5b5f7f7-7pxp5\" (UID: \"1e4fbbfc-9c9e-48b3-a5ad-26761640138e\") " pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.169843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.169733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vrf\" (UniqueName: \"kubernetes.io/projected/b74f5c53-42ca-47e8-8122-87c3d62774e5-kube-api-access-75vrf\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.169843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.169828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74f5c53-42ca-47e8-8122-87c3d62774e5-cert\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.213679 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.213640    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"
Jul 12 15:20:05.271135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.270590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vrf\" (UniqueName: \"kubernetes.io/projected/b74f5c53-42ca-47e8-8122-87c3d62774e5-kube-api-access-75vrf\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.271135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.270656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74f5c53-42ca-47e8-8122-87c3d62774e5-cert\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.276575 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.275756    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74f5c53-42ca-47e8-8122-87c3d62774e5-cert\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.280349 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.280286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vrf\" (UniqueName: \"kubernetes.io/projected/b74f5c53-42ca-47e8-8122-87c3d62774e5-kube-api-access-75vrf\") pod \"odh-model-controller-7998c67dc4-x9qjw\" (UID: \"b74f5c53-42ca-47e8-8122-87c3d62774e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.361191 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.361161    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5"]
Jul 12 15:20:05.366002 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:05.365965    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4fbbfc_9c9e_48b3_a5ad_26761640138e.slice/crio-5dd9a437a775e28849d317d930b74b87a628a32c18693cfe368c6e930b1fbbb8 WatchSource:0}: Error finding container 5dd9a437a775e28849d317d930b74b87a628a32c18693cfe368c6e930b1fbbb8: Status 404 returned error can't find the container with id 5dd9a437a775e28849d317d930b74b87a628a32c18693cfe368c6e930b1fbbb8
Jul 12 15:20:05.395950 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.395847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:05.537081 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.537044    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x9qjw"]
Jul 12 15:20:05.539961 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:05.539930    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74f5c53_42ca_47e8_8122_87c3d62774e5.slice/crio-9d8775f665ddc5c3f72d051148bada533894b82ccd16f8573ee6f12e97b9b854 WatchSource:0}: Error finding container 9d8775f665ddc5c3f72d051148bada533894b82ccd16f8573ee6f12e97b9b854: Status 404 returned error can't find the container with id 9d8775f665ddc5c3f72d051148bada533894b82ccd16f8573ee6f12e97b9b854
Jul 12 15:20:05.841683 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.841587    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f6txg"]
Jul 12 15:20:05.846064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.846037    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:05.848628 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.848585    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 12 15:20:05.848797 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.848771    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-d79z7\""
Jul 12 15:20:05.854733 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.854709    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f6txg"]
Jul 12 15:20:05.952636 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.952600    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:05.955748 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.955728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:05.958126 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.958101    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 15:20:05.958287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.958190    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 15:20:05.958287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.958205    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 15:20:05.958287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.958222    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tkhf9\""
Jul 12 15:20:05.958438 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.958407    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 15:20:05.968070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.968043    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:05.975484 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.975443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809bd374-64a8-439a-8136-fb8d9d13b759-tls-certs\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:05.975660 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:05.975536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp85q\" (UniqueName: \"kubernetes.io/projected/809bd374-64a8-439a-8136-fb8d9d13b759-kube-api-access-qp85q\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.015956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.015899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw" event={"ID":"b74f5c53-42ca-47e8-8122-87c3d62774e5","Type":"ContainerStarted","Data":"9d8775f665ddc5c3f72d051148bada533894b82ccd16f8573ee6f12e97b9b854"}
Jul 12 15:20:06.017016 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.016991    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5" event={"ID":"1e4fbbfc-9c9e-48b3-a5ad-26761640138e","Type":"ContainerStarted","Data":"5dd9a437a775e28849d317d930b74b87a628a32c18693cfe368c6e930b1fbbb8"}
Jul 12 15:20:06.076704 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.076660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.076995 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.076965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809bd374-64a8-439a-8136-fb8d9d13b759-tls-certs\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.077269 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077250    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.077453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7pt6\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.077523 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077497    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.077598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.077598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp85q\" (UniqueName: \"kubernetes.io/projected/809bd374-64a8-439a-8136-fb8d9d13b759-kube-api-access-qp85q\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.077598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.077750 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.077657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.080495 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.080461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809bd374-64a8-439a-8136-fb8d9d13b759-tls-certs\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.086167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.086133    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp85q\" (UniqueName: \"kubernetes.io/projected/809bd374-64a8-439a-8136-fb8d9d13b759-kube-api-access-qp85q\") pod \"model-serving-api-54d89bd5fc-f6txg\" (UID: \"809bd374-64a8-439a-8136-fb8d9d13b759\") " pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.158242 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.158206    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7pt6\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179252    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.179380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.196933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.180052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.205365 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.205290    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7pt6\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.213845 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.212365    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.213845 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.212927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.214228 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.214200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.214339 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.214234    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.215481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.215460    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token\") pod \"istiod-openshift-gateway-7574459656-n29j8\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.266654 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.266604    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:06.376527 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.376489    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f6txg"]
Jul 12 15:20:06.382089 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:06.382052    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809bd374_64a8_439a_8136_fb8d9d13b759.slice/crio-9d3e959c723aa9702bd69773c5d73d9db35804fbee787eb4306f90b3f94c436d WatchSource:0}: Error finding container 9d3e959c723aa9702bd69773c5d73d9db35804fbee787eb4306f90b3f94c436d: Status 404 returned error can't find the container with id 9d3e959c723aa9702bd69773c5d73d9db35804fbee787eb4306f90b3f94c436d
Jul 12 15:20:06.464427 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:06.463296    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:06.470210 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:06.470178    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ceb80c_b4d4_4bc8_ba64_7fce2a2409ee.slice/crio-a609994ebf986dbd45b5d281f0b64acb0a87ac2e073647ead68a1a7dc3a556fa WatchSource:0}: Error finding container a609994ebf986dbd45b5d281f0b64acb0a87ac2e073647ead68a1a7dc3a556fa: Status 404 returned error can't find the container with id a609994ebf986dbd45b5d281f0b64acb0a87ac2e073647ead68a1a7dc3a556fa
Jul 12 15:20:07.025391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:07.025304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg" event={"ID":"809bd374-64a8-439a-8136-fb8d9d13b759","Type":"ContainerStarted","Data":"9d3e959c723aa9702bd69773c5d73d9db35804fbee787eb4306f90b3f94c436d"}
Jul 12 15:20:07.027296 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:07.027217    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" event={"ID":"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee","Type":"ContainerStarted","Data":"a609994ebf986dbd45b5d281f0b64acb0a87ac2e073647ead68a1a7dc3a556fa"}
Jul 12 15:20:10.048933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.048408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw" event={"ID":"b74f5c53-42ca-47e8-8122-87c3d62774e5","Type":"ContainerStarted","Data":"8a138d8e3dd9c08e686578c63a3befda476572ce16875d495280ecc466ab24db"}
Jul 12 15:20:10.048933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.048542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:10.050244 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.050212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5" event={"ID":"1e4fbbfc-9c9e-48b3-a5ad-26761640138e","Type":"ContainerStarted","Data":"a34dc299da198efe7d070e113e55373234cf90462c1613428949b921583d429f"}
Jul 12 15:20:10.052160 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.052113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg" event={"ID":"809bd374-64a8-439a-8136-fb8d9d13b759","Type":"ContainerStarted","Data":"67c7773cd462d432ed1c4a289238c50f450358c88db997601458d6405769ef6b"}
Jul 12 15:20:10.052290 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.052261    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:10.065428 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.065291    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw" podStartSLOduration=0.7235912 podStartE2EDuration="5.065273479s" totalImagesPullingTime="4.341682279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:10.062491244 +0000 UTC m=+611.650793914" watchObservedRunningTime="2026-07-12 15:20:10.065273479 +0000 UTC m=+611.653576148"
Jul 12 15:20:10.079731 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.078974    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg" podStartSLOduration=1.576838451 podStartE2EDuration="5.078948542s" totalImagesPullingTime="3.502110091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:10.076634146 +0000 UTC m=+611.664936817" watchObservedRunningTime="2026-07-12 15:20:10.078948542 +0000 UTC m=+611.667251212"
Jul 12 15:20:10.091866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:10.091801    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd5b5f7f7-7pxp5" podStartSLOduration=1.5711237919999999 podStartE2EDuration="6.091777574s" totalImagesPullingTime="4.520653782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:10.090483555 +0000 UTC m=+611.678786237" watchObservedRunningTime="2026-07-12 15:20:10.091777574 +0000 UTC m=+611.680080247"
Jul 12 15:20:11.279502 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:11.279445    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:20:11.280039 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:11.279533    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:20:12.062467 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:12.062409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" event={"ID":"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee","Type":"ContainerStarted","Data":"59047a282e298c3219c9077f39bdf261b7b40777b7f84fc538f58e2406159a6f"}
Jul 12 15:20:12.062687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:12.062581    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:12.064499 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:12.064468    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-n29j8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:20:12.064645 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:12.064530    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:20:12.083702 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:12.083637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" podStartSLOduration=2.278365645 podStartE2EDuration="7.083612842s" totalImagesPullingTime="4.805247197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:12.082889135 +0000 UTC m=+613.671191805" watchObservedRunningTime="2026-07-12 15:20:12.083612842 +0000 UTC m=+613.671915513"
Jul 12 15:20:13.067965 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:13.067897    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:16.209063 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.209028    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"]
Jul 12 15:20:16.217562 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.217533    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.223871 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.223842    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 12 15:20:16.224472 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.224454    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qwkd7\""
Jul 12 15:20:16.235040 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.235014    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"]
Jul 12 15:20:16.238099 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.238080    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.242598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.242576    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 12 15:20:16.242763 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.242743    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8mckf\""
Jul 12 15:20:16.251293 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.250972    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"]
Jul 12 15:20:16.261800 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.261767    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"]
Jul 12 15:20:16.386621 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.386577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mr9\" (UniqueName: \"kubernetes.io/projected/997fe393-76dd-4227-902d-959809aeca13-kube-api-access-q5mr9\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.386799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.386638    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.386799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.386688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2j2w\" (UniqueName: \"kubernetes.io/projected/f3cd2b45-6feb-4370-8438-188d37de643c-kube-api-access-v2j2w\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.386799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.386747    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.487224 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.487125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.487401 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.487295    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mr9\" (UniqueName: \"kubernetes.io/projected/997fe393-76dd-4227-902d-959809aeca13-kube-api-access-q5mr9\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.487401 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.487359    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.487401 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:20:16.487305    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 12 15:20:16.487531 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.487405    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2j2w\" (UniqueName: \"kubernetes.io/projected/f3cd2b45-6feb-4370-8438-188d37de643c-kube-api-access-v2j2w\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.487531 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:20:16.487472    2566 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 12 15:20:16.487531 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:20:16.487514    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert podName:997fe393-76dd-4227-902d-959809aeca13 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:16.987490657 +0000 UTC m=+618.575793315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert") pod "kserve-controller-manager-d6f4b65b8-nvkhs" (UID: "997fe393-76dd-4227-902d-959809aeca13") : secret "kserve-webhook-server-cert" not found
Jul 12 15:20:16.487626 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:20:16.487535    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert podName:f3cd2b45-6feb-4370-8438-188d37de643c nodeName:}" failed. No retries permitted until 2026-07-12 15:20:16.987525372 +0000 UTC m=+618.575828026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert") pod "llmisvc-controller-manager-777c6bd7d5-sqrdq" (UID: "f3cd2b45-6feb-4370-8438-188d37de643c") : secret "llmisvc-webhook-server-cert" not found
Jul 12 15:20:16.496532 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.496502    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mr9\" (UniqueName: \"kubernetes.io/projected/997fe393-76dd-4227-902d-959809aeca13-kube-api-access-q5mr9\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.496744 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.496724    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2j2w\" (UniqueName: \"kubernetes.io/projected/f3cd2b45-6feb-4370-8438-188d37de643c-kube-api-access-v2j2w\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.991560 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.991521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:16.991769 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.991583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.994009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.993984    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3cd2b45-6feb-4370-8438-188d37de643c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sqrdq\" (UID: \"f3cd2b45-6feb-4370-8438-188d37de643c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:16.994124 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:16.994026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/997fe393-76dd-4227-902d-959809aeca13-cert\") pod \"kserve-controller-manager-d6f4b65b8-nvkhs\" (UID: \"997fe393-76dd-4227-902d-959809aeca13\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:17.127765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:17.127724    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:17.148485 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:17.148455    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:17.272293 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:17.272259    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"]
Jul 12 15:20:17.275147 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:17.275119    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997fe393_76dd_4227_902d_959809aeca13.slice/crio-c096c84feb40fcb5158fd1f56de1814c613aff0ab0914d223fc7877ce1e9880d WatchSource:0}: Error finding container c096c84feb40fcb5158fd1f56de1814c613aff0ab0914d223fc7877ce1e9880d: Status 404 returned error can't find the container with id c096c84feb40fcb5158fd1f56de1814c613aff0ab0914d223fc7877ce1e9880d
Jul 12 15:20:17.300285 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:17.300258    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"]
Jul 12 15:20:17.302687 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:20:17.302660    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3cd2b45_6feb_4370_8438_188d37de643c.slice/crio-e8bcd87b3bc72502ed107c81fe7ee5caf486aed69f52a18bf45789fe7de19467 WatchSource:0}: Error finding container e8bcd87b3bc72502ed107c81fe7ee5caf486aed69f52a18bf45789fe7de19467: Status 404 returned error can't find the container with id e8bcd87b3bc72502ed107c81fe7ee5caf486aed69f52a18bf45789fe7de19467
Jul 12 15:20:18.090205 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:18.090166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs" event={"ID":"997fe393-76dd-4227-902d-959809aeca13","Type":"ContainerStarted","Data":"c096c84feb40fcb5158fd1f56de1814c613aff0ab0914d223fc7877ce1e9880d"}
Jul 12 15:20:18.091585 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:18.091553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq" event={"ID":"f3cd2b45-6feb-4370-8438-188d37de643c","Type":"ContainerStarted","Data":"e8bcd87b3bc72502ed107c81fe7ee5caf486aed69f52a18bf45789fe7de19467"}
Jul 12 15:20:19.956095 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:19.956051    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:19.956566 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:19.956294    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerName="discovery" containerID="cri-o://59047a282e298c3219c9077f39bdf261b7b40777b7f84fc538f58e2406159a6f" gracePeriod=30
Jul 12 15:20:20.103935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.103892    2566 generic.go:356] "Generic (PLEG): container finished" podID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerID="59047a282e298c3219c9077f39bdf261b7b40777b7f84fc538f58e2406159a6f" exitCode=0
Jul 12 15:20:20.104051 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.103950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" event={"ID":"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee","Type":"ContainerDied","Data":"59047a282e298c3219c9077f39bdf261b7b40777b7f84fc538f58e2406159a6f"}
Jul 12 15:20:20.105540 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.105516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs" event={"ID":"997fe393-76dd-4227-902d-959809aeca13","Type":"ContainerStarted","Data":"5d028fe905801a85124e56f379ac3f15c7d4fbcaf727de8b67d5507c6adb2cac"}
Jul 12 15:20:20.105655 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.105631    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:20.157505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.157440    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs" podStartSLOduration=1.9252002209999999 podStartE2EDuration="4.157419108s" totalImagesPullingTime="2.232218887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:20.155026018 +0000 UTC m=+621.743328687" watchObservedRunningTime="2026-07-12 15:20:20.157419108 +0000 UTC m=+621.745721777"
Jul 12 15:20:20.280120 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.280095    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:20.317746 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317668    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.317746 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317730    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317762    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7pt6\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317812    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.317972    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318195 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.318021    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs\") pod \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\" (UID: \"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee\") "
Jul 12 15:20:20.318449 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.318405    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:20:20.320546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320512    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:20:20.320652 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320520    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:20:20.320652 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs" (OuterVolumeSpecName: "local-certs") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:20:20.320652 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320591    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:20:20.320652 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320579    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts" (OuterVolumeSpecName: "cacerts") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:20:20.320793 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.320712    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6" (OuterVolumeSpecName: "kube-api-access-s7pt6") pod "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" (UID: "52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee"). InnerVolumeSpecName "kube-api-access-s7pt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:20:20.419380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419334    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-kubeconfig\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419364    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7pt6\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-kube-api-access-s7pt6\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419374    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419382    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-dns-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419394    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-istio-csr-ca-configmap\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419671 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419402    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-local-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:20.419671 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:20.419411    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee-cacerts\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:20:21.058617 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.058587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-x9qjw"
Jul 12 15:20:21.060891 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.060860    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-f6txg"
Jul 12 15:20:21.113983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.113893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq" event={"ID":"f3cd2b45-6feb-4370-8438-188d37de643c","Type":"ContainerStarted","Data":"276814a409560b431565dedcf119ba46745ca8c50f828a439e36d545d24df40f"}
Jul 12 15:20:21.114217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.114194    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:20:21.115592 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.115559    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8" event={"ID":"52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee","Type":"ContainerDied","Data":"a609994ebf986dbd45b5d281f0b64acb0a87ac2e073647ead68a1a7dc3a556fa"}
Jul 12 15:20:21.115592 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.115587    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"
Jul 12 15:20:21.115755 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.115623    2566 scope.go:117] "RemoveContainer" containerID="59047a282e298c3219c9077f39bdf261b7b40777b7f84fc538f58e2406159a6f"
Jul 12 15:20:21.130039 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.129991    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq" podStartSLOduration=2.291128323 podStartE2EDuration="5.129975246s" totalImagesPullingTime="2.838846923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:21.127891053 +0000 UTC m=+622.716193722" watchObservedRunningTime="2026-07-12 15:20:21.129975246 +0000 UTC m=+622.718277915"
Jul 12 15:20:21.144113 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.144041    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:21.147101 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:21.147076    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n29j8"]
Jul 12 15:20:22.875350 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:22.875317    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" path="/var/lib/kubelet/pods/52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee/volumes"
Jul 12 15:20:51.121780 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:51.121746    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nvkhs"
Jul 12 15:20:52.124876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:20:52.124848    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sqrdq"
Jul 12 15:21:00.695928 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.695867    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:00.696334 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.696179    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerName="discovery"
Jul 12 15:21:00.696334 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.696190    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerName="discovery"
Jul 12 15:21:00.696334 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.696244    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ceb80c-b4d4-4bc8-ba64-7fce2a2409ee" containerName="discovery"
Jul 12 15:21:00.699559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.699532    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:00.702009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.701985    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 15:21:00.702824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.702807    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rzjlr\""
Jul 12 15:21:00.702944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.702874    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 15:21:00.709010 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.708983    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:00.868860 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.868820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8xdd\" (UniqueName: \"kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd\") pod \"kuadrant-operator-catalog-wcswr\" (UID: \"bb2cda43-f01c-4c4f-9beb-e3909472ada3\") " pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:00.970065 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.969967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8xdd\" (UniqueName: \"kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd\") pod \"kuadrant-operator-catalog-wcswr\" (UID: \"bb2cda43-f01c-4c4f-9beb-e3909472ada3\") " pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:00.977531 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:00.977497    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8xdd\" (UniqueName: \"kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd\") pod \"kuadrant-operator-catalog-wcswr\" (UID: \"bb2cda43-f01c-4c4f-9beb-e3909472ada3\") " pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:01.010729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.010682    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:01.063689 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.063656    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:01.143062 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.143032    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:01.145396 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:01.145367    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2cda43_f01c_4c4f_9beb_e3909472ada3.slice/crio-741bf3f69aff0889b88785fd646c941c579b01c0b9f9ba4f3ab81a44fb8438bc WatchSource:0}: Error finding container 741bf3f69aff0889b88785fd646c941c579b01c0b9f9ba4f3ab81a44fb8438bc: Status 404 returned error can't find the container with id 741bf3f69aff0889b88785fd646c941c579b01c0b9f9ba4f3ab81a44fb8438bc
Jul 12 15:21:01.273143 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.273058    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-79hfh"]
Jul 12 15:21:01.275898 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.275875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:01.283526 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.283497    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-79hfh"]
Jul 12 15:21:01.293123 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.293086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" event={"ID":"bb2cda43-f01c-4c4f-9beb-e3909472ada3","Type":"ContainerStarted","Data":"741bf3f69aff0889b88785fd646c941c579b01c0b9f9ba4f3ab81a44fb8438bc"}
Jul 12 15:21:01.374325 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.374284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6rw\" (UniqueName: \"kubernetes.io/projected/24ee4ef8-bcb7-4a57-a694-6f78156ceebd-kube-api-access-4n6rw\") pod \"kuadrant-operator-catalog-79hfh\" (UID: \"24ee4ef8-bcb7-4a57-a694-6f78156ceebd\") " pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:01.475349 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.475316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6rw\" (UniqueName: \"kubernetes.io/projected/24ee4ef8-bcb7-4a57-a694-6f78156ceebd-kube-api-access-4n6rw\") pod \"kuadrant-operator-catalog-79hfh\" (UID: \"24ee4ef8-bcb7-4a57-a694-6f78156ceebd\") " pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:01.491466 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.491434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6rw\" (UniqueName: \"kubernetes.io/projected/24ee4ef8-bcb7-4a57-a694-6f78156ceebd-kube-api-access-4n6rw\") pod \"kuadrant-operator-catalog-79hfh\" (UID: \"24ee4ef8-bcb7-4a57-a694-6f78156ceebd\") " pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:01.585834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.585739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:01.725505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:01.725480    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-79hfh"]
Jul 12 15:21:01.733700 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:01.733668    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ee4ef8_bcb7_4a57_a694_6f78156ceebd.slice/crio-28e5176d04a14ab0c47f9c3e9bd4a9e6d66a096c783095346c2b0ab05f1b8b90 WatchSource:0}: Error finding container 28e5176d04a14ab0c47f9c3e9bd4a9e6d66a096c783095346c2b0ab05f1b8b90: Status 404 returned error can't find the container with id 28e5176d04a14ab0c47f9c3e9bd4a9e6d66a096c783095346c2b0ab05f1b8b90
Jul 12 15:21:02.300405 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:02.300366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-79hfh" event={"ID":"24ee4ef8-bcb7-4a57-a694-6f78156ceebd","Type":"ContainerStarted","Data":"28e5176d04a14ab0c47f9c3e9bd4a9e6d66a096c783095346c2b0ab05f1b8b90"}
Jul 12 15:21:04.311125 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.311083    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" event={"ID":"bb2cda43-f01c-4c4f-9beb-e3909472ada3","Type":"ContainerStarted","Data":"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"}
Jul 12 15:21:04.311603 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.311123    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" podUID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" containerName="registry-server" containerID="cri-o://e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f" gracePeriod=2
Jul 12 15:21:04.312674 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.312643    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-79hfh" event={"ID":"24ee4ef8-bcb7-4a57-a694-6f78156ceebd","Type":"ContainerStarted","Data":"830a10d63c24d2307084e149704bc50c629daf633bd6418857d8ccb5afbdfb91"}
Jul 12 15:21:04.327120 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.327064    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" podStartSLOduration=2.141498068 podStartE2EDuration="4.327046427s" totalImagesPullingTime="2.185548359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:04.324592142 +0000 UTC m=+665.912894814" watchObservedRunningTime="2026-07-12 15:21:04.327046427 +0000 UTC m=+665.915349096"
Jul 12 15:21:04.338396 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.338346    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-79hfh" podStartSLOduration=1.738379531 podStartE2EDuration="3.338330957s" totalImagesPullingTime="1.599951426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:04.337778375 +0000 UTC m=+665.926081045" watchObservedRunningTime="2026-07-12 15:21:04.338330957 +0000 UTC m=+665.926633627"
Jul 12 15:21:04.557671 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.557639    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:04.702975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.702895    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8xdd\" (UniqueName: \"kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd\") pod \"bb2cda43-f01c-4c4f-9beb-e3909472ada3\" (UID: \"bb2cda43-f01c-4c4f-9beb-e3909472ada3\") "
Jul 12 15:21:04.705151 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.705124    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd" (OuterVolumeSpecName: "kube-api-access-k8xdd") pod "bb2cda43-f01c-4c4f-9beb-e3909472ada3" (UID: "bb2cda43-f01c-4c4f-9beb-e3909472ada3"). InnerVolumeSpecName "kube-api-access-k8xdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:04.804334 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:04.804294    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8xdd\" (UniqueName: \"kubernetes.io/projected/bb2cda43-f01c-4c4f-9beb-e3909472ada3-kube-api-access-k8xdd\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:05.318575 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.318539    2566 generic.go:356] "Generic (PLEG): container finished" podID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" containerID="e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f" exitCode=0
Jul 12 15:21:05.319030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.318588    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wcswr"
Jul 12 15:21:05.319030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.318627    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" event={"ID":"bb2cda43-f01c-4c4f-9beb-e3909472ada3","Type":"ContainerDied","Data":"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"}
Jul 12 15:21:05.319030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.318681    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wcswr" event={"ID":"bb2cda43-f01c-4c4f-9beb-e3909472ada3","Type":"ContainerDied","Data":"741bf3f69aff0889b88785fd646c941c579b01c0b9f9ba4f3ab81a44fb8438bc"}
Jul 12 15:21:05.319030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.318702    2566 scope.go:117] "RemoveContainer" containerID="e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"
Jul 12 15:21:05.327845 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.327826    2566 scope.go:117] "RemoveContainer" containerID="e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"
Jul 12 15:21:05.328180 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:21:05.328161    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f\": container with ID starting with e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f not found: ID does not exist" containerID="e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"
Jul 12 15:21:05.328233 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.328188    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f"} err="failed to get container status \"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f\": rpc error: code = NotFound desc = could not find container \"e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f\": container with ID starting with e1407f7d1fc6ecefbb50267bbe20521d6dd6f2d69949f6c119352bb8d723599f not found: ID does not exist"
Jul 12 15:21:05.334154 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.334120    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:05.335535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:05.335510    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wcswr"]
Jul 12 15:21:06.872473 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:06.872429    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" path="/var/lib/kubelet/pods/bb2cda43-f01c-4c4f-9beb-e3909472ada3/volumes"
Jul 12 15:21:11.586384 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:11.586338    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:11.586833 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:11.586410    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:11.609875 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:11.609843    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:12.372052 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:12.372022    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-79hfh"
Jul 12 15:21:16.502863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.502823    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"]
Jul 12 15:21:16.503271 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.503145    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" containerName="registry-server"
Jul 12 15:21:16.503271 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.503157    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" containerName="registry-server"
Jul 12 15:21:16.503271 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.503220    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2cda43-f01c-4c4f-9beb-e3909472ada3" containerName="registry-server"
Jul 12 15:21:16.507841 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.507817    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.510078 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.510058    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2jxw\""
Jul 12 15:21:16.517507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.517476    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"]
Jul 12 15:21:16.608112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.608073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.608328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.608191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppt7\" (UniqueName: \"kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.608328 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.608233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.709177 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.709129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppt7\" (UniqueName: \"kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.709177 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.709181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.709448 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.709242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.709622 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.709596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.709687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.709627    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.716925 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.716890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppt7\" (UniqueName: \"kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.818059 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.817958    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:16.960113 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:16.960062    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"]
Jul 12 15:21:16.962503 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:16.962474    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8220ca47_d382_4e18_a310_0a6791394996.slice/crio-f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3 WatchSource:0}: Error finding container f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3: Status 404 returned error can't find the container with id f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3
Jul 12 15:21:17.304465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.304424    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"]
Jul 12 15:21:17.307978 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.307944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.315674 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.315642    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"]
Jul 12 15:21:17.376163 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.376127    2566 generic.go:356] "Generic (PLEG): container finished" podID="8220ca47-d382-4e18-a310-0a6791394996" containerID="3e00d9ae3bb31ae695a27f02647c0d47567b7072ea1c88725f7282eacb47766f" exitCode=0
Jul 12 15:21:17.376322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.376208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr" event={"ID":"8220ca47-d382-4e18-a310-0a6791394996","Type":"ContainerDied","Data":"3e00d9ae3bb31ae695a27f02647c0d47567b7072ea1c88725f7282eacb47766f"}
Jul 12 15:21:17.376322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.376256    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr" event={"ID":"8220ca47-d382-4e18-a310-0a6791394996","Type":"ContainerStarted","Data":"f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3"}
Jul 12 15:21:17.376660 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.376643    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:21:17.415247 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.415206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6xm\" (UniqueName: \"kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.415423 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.415267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.415423 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.415323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.516098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.516058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.516496 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.516117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.516496 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.516171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6xm\" (UniqueName: \"kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.516496 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.516445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.516615 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.516504    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.523799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.523766    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6xm\" (UniqueName: \"kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.618890 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.618855    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:17.705050 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.704989    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"]
Jul 12 15:21:17.710122 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.710095    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.715547 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.715514    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"]
Jul 12 15:21:17.759111 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.759083    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"]
Jul 12 15:21:17.761359 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:17.761331    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70f32d1_c347_42e2_b005_4d715426ccd7.slice/crio-ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c WatchSource:0}: Error finding container ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c: Status 404 returned error can't find the container with id ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c
Jul 12 15:21:17.819226 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.819133    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgq56\" (UniqueName: \"kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.819283 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.819245    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.819323 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.819295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.920780 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.920742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgq56\" (UniqueName: \"kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.921020 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.920821    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.921020 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.920856    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.921320 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.921292    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.921447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.921375    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:17.928582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:17.928543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgq56\" (UniqueName: \"kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:18.036792 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.036755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:18.106812 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.106776    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"]
Jul 12 15:21:18.112026 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.111989    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.118153 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.118123    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"]
Jul 12 15:21:18.216561 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.216535    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"]
Jul 12 15:21:18.224196 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.224163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.224311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.224203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr65q\" (UniqueName: \"kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.224380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.224351    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.225019 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:18.224991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c018aa_a93c_44a2_b8cf_d4eb2344a137.slice/crio-5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d WatchSource:0}: Error finding container 5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d: Status 404 returned error can't find the container with id 5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d
Jul 12 15:21:18.325218 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.325176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.325373 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.325228    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.325373 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.325252    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr65q\" (UniqueName: \"kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.325626 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.325594    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.325687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.325634    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.333616 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.333586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr65q\" (UniqueName: \"kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.383066 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.382968    2566 generic.go:356] "Generic (PLEG): container finished" podID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerID="edc605c2f48647e6c63adb4285e57b7cb1918e4018c30e405a61525e58bd58cf" exitCode=0
Jul 12 15:21:18.383281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.383057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd" event={"ID":"79c018aa-a93c-44a2-b8cf-d4eb2344a137","Type":"ContainerDied","Data":"edc605c2f48647e6c63adb4285e57b7cb1918e4018c30e405a61525e58bd58cf"}
Jul 12 15:21:18.383281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.383118    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd" event={"ID":"79c018aa-a93c-44a2-b8cf-d4eb2344a137","Type":"ContainerStarted","Data":"5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d"}
Jul 12 15:21:18.384807 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.384765    2566 generic.go:356] "Generic (PLEG): container finished" podID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerID="3f3a516472d22d1c4add1a64fc6e8aa5f2b9c1b8362c87735c2161127129eeb5" exitCode=0
Jul 12 15:21:18.384950 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.384853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerDied","Data":"3f3a516472d22d1c4add1a64fc6e8aa5f2b9c1b8362c87735c2161127129eeb5"}
Jul 12 15:21:18.384950 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.384927    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerStarted","Data":"ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c"}
Jul 12 15:21:18.386885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.386862    2566 generic.go:356] "Generic (PLEG): container finished" podID="8220ca47-d382-4e18-a310-0a6791394996" containerID="c5691591b9b50ebcf0ce245651470debf999be0d5aefe68b14b8a5ecf2d7d4a5" exitCode=0
Jul 12 15:21:18.387003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.386938    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr" event={"ID":"8220ca47-d382-4e18-a310-0a6791394996","Type":"ContainerDied","Data":"c5691591b9b50ebcf0ce245651470debf999be0d5aefe68b14b8a5ecf2d7d4a5"}
Jul 12 15:21:18.441107 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.441070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:18.589132 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:18.589105    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"]
Jul 12 15:21:18.591060 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:18.591032    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d3603b_ff9d_413f_8ba1_e71fa15a273e.slice/crio-348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c WatchSource:0}: Error finding container 348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c: Status 404 returned error can't find the container with id 348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c
Jul 12 15:21:19.394518 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.394482    2566 generic.go:356] "Generic (PLEG): container finished" podID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerID="0414418c5e5f6bb39cc448737254b7f6b01a5e50345976034636783816db390e" exitCode=0
Jul 12 15:21:19.394637 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.394539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7" event={"ID":"a7d3603b-ff9d-413f-8ba1-e71fa15a273e","Type":"ContainerDied","Data":"0414418c5e5f6bb39cc448737254b7f6b01a5e50345976034636783816db390e"}
Jul 12 15:21:19.394637 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.394608    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7" event={"ID":"a7d3603b-ff9d-413f-8ba1-e71fa15a273e","Type":"ContainerStarted","Data":"348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c"}
Jul 12 15:21:19.396697 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.396667    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerStarted","Data":"ba12d76722783ca497d5781b67d103ca2b942aaa1e23f92734498ccfa431948c"}
Jul 12 15:21:19.400035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.399887    2566 generic.go:356] "Generic (PLEG): container finished" podID="8220ca47-d382-4e18-a310-0a6791394996" containerID="ddfafb6ba30e4de548f74bc48211fb22538a3bc3ef01c390891da2627ba370c0" exitCode=0
Jul 12 15:21:19.400035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:19.399941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr" event={"ID":"8220ca47-d382-4e18-a310-0a6791394996","Type":"ContainerDied","Data":"ddfafb6ba30e4de548f74bc48211fb22538a3bc3ef01c390891da2627ba370c0"}
Jul 12 15:21:20.407123 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.407089    2566 generic.go:356] "Generic (PLEG): container finished" podID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerID="ba12d76722783ca497d5781b67d103ca2b942aaa1e23f92734498ccfa431948c" exitCode=0
Jul 12 15:21:20.407565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.407175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerDied","Data":"ba12d76722783ca497d5781b67d103ca2b942aaa1e23f92734498ccfa431948c"}
Jul 12 15:21:20.409313 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.409289    2566 generic.go:356] "Generic (PLEG): container finished" podID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerID="28586277cc0a733d7f178270da0106a150f77840b5e13097e9d3fba7a06ac657" exitCode=0
Jul 12 15:21:20.409416 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.409370    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd" event={"ID":"79c018aa-a93c-44a2-b8cf-d4eb2344a137","Type":"ContainerDied","Data":"28586277cc0a733d7f178270da0106a150f77840b5e13097e9d3fba7a06ac657"}
Jul 12 15:21:20.411239 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.411215    2566 generic.go:356] "Generic (PLEG): container finished" podID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerID="875d8bbe96024076befa32f6e560b1a85678cd94c199db826f50bf922df8ae29" exitCode=0
Jul 12 15:21:20.411318 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.411281    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7" event={"ID":"a7d3603b-ff9d-413f-8ba1-e71fa15a273e","Type":"ContainerDied","Data":"875d8bbe96024076befa32f6e560b1a85678cd94c199db826f50bf922df8ae29"}
Jul 12 15:21:20.549407 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.549376    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:20.646455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.646419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util\") pod \"8220ca47-d382-4e18-a310-0a6791394996\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") "
Jul 12 15:21:20.646600 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.646493    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nppt7\" (UniqueName: \"kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7\") pod \"8220ca47-d382-4e18-a310-0a6791394996\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") "
Jul 12 15:21:20.646600 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.646538    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle\") pod \"8220ca47-d382-4e18-a310-0a6791394996\" (UID: \"8220ca47-d382-4e18-a310-0a6791394996\") "
Jul 12 15:21:20.647150 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.647111    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle" (OuterVolumeSpecName: "bundle") pod "8220ca47-d382-4e18-a310-0a6791394996" (UID: "8220ca47-d382-4e18-a310-0a6791394996"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:20.648621 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.648595    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7" (OuterVolumeSpecName: "kube-api-access-nppt7") pod "8220ca47-d382-4e18-a310-0a6791394996" (UID: "8220ca47-d382-4e18-a310-0a6791394996"). InnerVolumeSpecName "kube-api-access-nppt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:20.652063 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.652034    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util" (OuterVolumeSpecName: "util") pod "8220ca47-d382-4e18-a310-0a6791394996" (UID: "8220ca47-d382-4e18-a310-0a6791394996"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:20.747084 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.747044    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:20.747232 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.747102    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nppt7\" (UniqueName: \"kubernetes.io/projected/8220ca47-d382-4e18-a310-0a6791394996-kube-api-access-nppt7\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:20.747232 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:20.747114    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8220ca47-d382-4e18-a310-0a6791394996-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:21.417952 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.417895    2566 generic.go:356] "Generic (PLEG): container finished" podID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerID="f68542315bd86bc74e620e9f35198d906191f83517ff966bd975d2c2873de6f4" exitCode=0
Jul 12 15:21:21.418433 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.418010    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd" event={"ID":"79c018aa-a93c-44a2-b8cf-d4eb2344a137","Type":"ContainerDied","Data":"f68542315bd86bc74e620e9f35198d906191f83517ff966bd975d2c2873de6f4"}
Jul 12 15:21:21.420031 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.420002    2566 generic.go:356] "Generic (PLEG): container finished" podID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerID="3043294392ec0d95df3c62661ca57d0b975bfae7eefd0ad42f084bec1b52f8c9" exitCode=0
Jul 12 15:21:21.420167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.420079    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7" event={"ID":"a7d3603b-ff9d-413f-8ba1-e71fa15a273e","Type":"ContainerDied","Data":"3043294392ec0d95df3c62661ca57d0b975bfae7eefd0ad42f084bec1b52f8c9"}
Jul 12 15:21:21.422236 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.422205    2566 generic.go:356] "Generic (PLEG): container finished" podID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerID="b71801b930d46f7435ac520a97c97c5e17af6287317798b8c8cebbc98e954d73" exitCode=0
Jul 12 15:21:21.422355 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.422284    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerDied","Data":"b71801b930d46f7435ac520a97c97c5e17af6287317798b8c8cebbc98e954d73"}
Jul 12 15:21:21.424224 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.424199    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr" event={"ID":"8220ca47-d382-4e18-a310-0a6791394996","Type":"ContainerDied","Data":"f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3"}
Jul 12 15:21:21.424224 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.424211    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr"
Jul 12 15:21:21.424368 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:21.424238    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f056ef315838bc04d668383141b4c40c39e62ef8e33ee202ff8f9a9a66eef0b3"
Jul 12 15:21:22.592647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.592616    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:22.594624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.594599    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:22.631524 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.631495    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:22.662897 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.662865    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle\") pod \"e70f32d1-c347-42e2-b005-4d715426ccd7\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") "
Jul 12 15:21:22.662897 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.662919    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr65q\" (UniqueName: \"kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q\") pod \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") "
Jul 12 15:21:22.663135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.662950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd6xm\" (UniqueName: \"kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm\") pod \"e70f32d1-c347-42e2-b005-4d715426ccd7\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") "
Jul 12 15:21:22.663135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.662983    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgq56\" (UniqueName: \"kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56\") pod \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") "
Jul 12 15:21:22.663135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663021    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util\") pod \"e70f32d1-c347-42e2-b005-4d715426ccd7\" (UID: \"e70f32d1-c347-42e2-b005-4d715426ccd7\") "
Jul 12 15:21:22.663135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663044    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util\") pod \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") "
Jul 12 15:21:22.663135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663074    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle\") pod \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\" (UID: \"a7d3603b-ff9d-413f-8ba1-e71fa15a273e\") "
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663866    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle" (OuterVolumeSpecName: "bundle") pod "a7d3603b-ff9d-413f-8ba1-e71fa15a273e" (UID: "a7d3603b-ff9d-413f-8ba1-e71fa15a273e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663962    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util\") pod \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") "
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.663976    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle" (OuterVolumeSpecName: "bundle") pod "e70f32d1-c347-42e2-b005-4d715426ccd7" (UID: "e70f32d1-c347-42e2-b005-4d715426ccd7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.664011    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle\") pod \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\" (UID: \"79c018aa-a93c-44a2-b8cf-d4eb2344a137\") "
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.664458    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.664476    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.665031    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle" (OuterVolumeSpecName: "bundle") pod "79c018aa-a93c-44a2-b8cf-d4eb2344a137" (UID: "79c018aa-a93c-44a2-b8cf-d4eb2344a137"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.665665    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q" (OuterVolumeSpecName: "kube-api-access-jr65q") pod "a7d3603b-ff9d-413f-8ba1-e71fa15a273e" (UID: "a7d3603b-ff9d-413f-8ba1-e71fa15a273e"). InnerVolumeSpecName "kube-api-access-jr65q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.665706    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56" (OuterVolumeSpecName: "kube-api-access-hgq56") pod "79c018aa-a93c-44a2-b8cf-d4eb2344a137" (UID: "79c018aa-a93c-44a2-b8cf-d4eb2344a137"). InnerVolumeSpecName "kube-api-access-hgq56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.665734    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm" (OuterVolumeSpecName: "kube-api-access-wd6xm") pod "e70f32d1-c347-42e2-b005-4d715426ccd7" (UID: "e70f32d1-c347-42e2-b005-4d715426ccd7"). InnerVolumeSpecName "kube-api-access-wd6xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:21:22.673220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.673133    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util" (OuterVolumeSpecName: "util") pod "a7d3603b-ff9d-413f-8ba1-e71fa15a273e" (UID: "a7d3603b-ff9d-413f-8ba1-e71fa15a273e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.673684 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.673308    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util" (OuterVolumeSpecName: "util") pod "e70f32d1-c347-42e2-b005-4d715426ccd7" (UID: "e70f32d1-c347-42e2-b005-4d715426ccd7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.673887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.673860    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util" (OuterVolumeSpecName: "util") pod "79c018aa-a93c-44a2-b8cf-d4eb2344a137" (UID: "79c018aa-a93c-44a2-b8cf-d4eb2344a137"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765380    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr65q\" (UniqueName: \"kubernetes.io/projected/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-kube-api-access-jr65q\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765415    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd6xm\" (UniqueName: \"kubernetes.io/projected/e70f32d1-c347-42e2-b005-4d715426ccd7-kube-api-access-wd6xm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765428    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgq56\" (UniqueName: \"kubernetes.io/projected/79c018aa-a93c-44a2-b8cf-d4eb2344a137-kube-api-access-hgq56\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765441    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e70f32d1-c347-42e2-b005-4d715426ccd7-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765454    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7d3603b-ff9d-413f-8ba1-e71fa15a273e-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765465    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:22.765778 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:22.765504    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79c018aa-a93c-44a2-b8cf-d4eb2344a137-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:21:23.435374 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.435342    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd"
Jul 12 15:21:23.435537 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.435344    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd" event={"ID":"79c018aa-a93c-44a2-b8cf-d4eb2344a137","Type":"ContainerDied","Data":"5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d"}
Jul 12 15:21:23.435537 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.435474    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5112f5c36c2afc3cc6c6136ad069b1661888b087d8477c80748c2283cad5fa4d"
Jul 12 15:21:23.437407 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.437383    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7"
Jul 12 15:21:23.437716 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.437401    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7" event={"ID":"a7d3603b-ff9d-413f-8ba1-e71fa15a273e","Type":"ContainerDied","Data":"348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c"}
Jul 12 15:21:23.437898 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.437719    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348f46efc47489f16cf62f3205b19e9dbf74947d817e0b180c613737ef49bb6c"
Jul 12 15:21:23.439709 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.439687    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf" event={"ID":"e70f32d1-c347-42e2-b005-4d715426ccd7","Type":"ContainerDied","Data":"ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c"}
Jul 12 15:21:23.439808 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.439727    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae8edb04c5aa4017f64e8b4c228e3a145f798ecaf4513ca9186e265904bd688c"
Jul 12 15:21:23.439808 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:23.439696    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf"
Jul 12 15:21:32.634591 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.634546    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"]
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635025    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="util"
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635043    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="util"
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635057    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="util"
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635065    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="util"
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635081    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="extract"
Jul 12 15:21:32.635085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635089    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635103    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="util"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635111    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="util"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635122    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635129    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635138    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635146    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635158    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635166    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635175    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635182    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635195    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="util"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635203    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="util"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635214    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635222    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635230    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635238    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635252    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635259    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="pull"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635341    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d3603b-ff9d-413f-8ba1-e71fa15a273e" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635355    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e70f32d1-c347-42e2-b005-4d715426ccd7" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635363    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c018aa-a93c-44a2-b8cf-d4eb2344a137" containerName="extract"
Jul 12 15:21:32.635391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.635373    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8220ca47-d382-4e18-a310-0a6791394996" containerName="extract"
Jul 12 15:21:32.638882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.638860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:32.641207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.641185    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 12 15:21:32.641332 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.641223    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5nw8p\""
Jul 12 15:21:32.650259 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.650233    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"]
Jul 12 15:21:32.754859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.754808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbf7b\" (UniqueName: \"kubernetes.io/projected/955ac129-9df9-4c72-be7a-43b5d5dba1c9-kube-api-access-vbf7b\") pod \"dns-operator-controller-manager-864dd78c4c-kvscb\" (UID: \"955ac129-9df9-4c72-be7a-43b5d5dba1c9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:32.855542 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.855499    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbf7b\" (UniqueName: \"kubernetes.io/projected/955ac129-9df9-4c72-be7a-43b5d5dba1c9-kube-api-access-vbf7b\") pod \"dns-operator-controller-manager-864dd78c4c-kvscb\" (UID: \"955ac129-9df9-4c72-be7a-43b5d5dba1c9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:32.866516 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.866483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbf7b\" (UniqueName: \"kubernetes.io/projected/955ac129-9df9-4c72-be7a-43b5d5dba1c9-kube-api-access-vbf7b\") pod \"dns-operator-controller-manager-864dd78c4c-kvscb\" (UID: \"955ac129-9df9-4c72-be7a-43b5d5dba1c9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:32.949279 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:32.949187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:33.086591 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:33.086566    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"]
Jul 12 15:21:33.089005 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:33.088967    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955ac129_9df9_4c72_be7a_43b5d5dba1c9.slice/crio-ec566057dfcb0856a0fd8270e229b4f50b01e1a7122b755670285dd5c7221628 WatchSource:0}: Error finding container ec566057dfcb0856a0fd8270e229b4f50b01e1a7122b755670285dd5c7221628: Status 404 returned error can't find the container with id ec566057dfcb0856a0fd8270e229b4f50b01e1a7122b755670285dd5c7221628
Jul 12 15:21:33.494322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:33.494287    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb" event={"ID":"955ac129-9df9-4c72-be7a-43b5d5dba1c9","Type":"ContainerStarted","Data":"ec566057dfcb0856a0fd8270e229b4f50b01e1a7122b755670285dd5c7221628"}
Jul 12 15:21:35.510802 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:35.510714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb" event={"ID":"955ac129-9df9-4c72-be7a-43b5d5dba1c9","Type":"ContainerStarted","Data":"f87d567a378f4328e844f361bd0837718a0fb44fffcb11bf677a6a3e1436bde1"}
Jul 12 15:21:35.510802 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:35.510776    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:35.527128 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:35.527074    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb" podStartSLOduration=1.474079027 podStartE2EDuration="3.527056109s" totalImagesPullingTime="2.052977082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:35.525589254 +0000 UTC m=+697.113891927" watchObservedRunningTime="2026-07-12 15:21:35.527056109 +0000 UTC m=+697.115358778"
Jul 12 15:21:36.752384 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.749968    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"]
Jul 12 15:21:36.755061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.755029    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:36.757377 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.757350    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zxnwx\""
Jul 12 15:21:36.761561 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.761532    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"]
Jul 12 15:21:36.892670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.892628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrq4\" (UniqueName: \"kubernetes.io/projected/6b1cf3f0-2d1d-4092-8b59-4f813a069483-kube-api-access-bhrq4\") pod \"authorino-operator-75cc8d5cb7-dlggn\" (UID: \"6b1cf3f0-2d1d-4092-8b59-4f813a069483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:36.994024 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:36.993985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrq4\" (UniqueName: \"kubernetes.io/projected/6b1cf3f0-2d1d-4092-8b59-4f813a069483-kube-api-access-bhrq4\") pod \"authorino-operator-75cc8d5cb7-dlggn\" (UID: \"6b1cf3f0-2d1d-4092-8b59-4f813a069483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:37.001891 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:37.001858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrq4\" (UniqueName: \"kubernetes.io/projected/6b1cf3f0-2d1d-4092-8b59-4f813a069483-kube-api-access-bhrq4\") pod \"authorino-operator-75cc8d5cb7-dlggn\" (UID: \"6b1cf3f0-2d1d-4092-8b59-4f813a069483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:37.068064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:37.067966    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:37.206603 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:37.206570    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"]
Jul 12 15:21:37.209187 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:37.209150    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1cf3f0_2d1d_4092_8b59_4f813a069483.slice/crio-0554d39e299056d3f07890e6ce25be3e8a11dabc2affd5c6b1eb632d2d168d14 WatchSource:0}: Error finding container 0554d39e299056d3f07890e6ce25be3e8a11dabc2affd5c6b1eb632d2d168d14: Status 404 returned error can't find the container with id 0554d39e299056d3f07890e6ce25be3e8a11dabc2affd5c6b1eb632d2d168d14
Jul 12 15:21:37.521367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:37.521331    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn" event={"ID":"6b1cf3f0-2d1d-4092-8b59-4f813a069483","Type":"ContainerStarted","Data":"0554d39e299056d3f07890e6ce25be3e8a11dabc2affd5c6b1eb632d2d168d14"}
Jul 12 15:21:39.533606 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:39.533568    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn" event={"ID":"6b1cf3f0-2d1d-4092-8b59-4f813a069483","Type":"ContainerStarted","Data":"ace850b284cdbae628dba3675c0a07131b08c719907ceadff51b851182b31784"}
Jul 12 15:21:39.534014 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:39.533682    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:39.548062 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:39.548012    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn" podStartSLOduration=1.327075568 podStartE2EDuration="3.54799304s" totalImagesPullingTime="2.220917472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:39.546740502 +0000 UTC m=+701.135043172" watchObservedRunningTime="2026-07-12 15:21:39.54799304 +0000 UTC m=+701.136295733"
Jul 12 15:21:40.092857 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.092815    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"]
Jul 12 15:21:40.096317 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.096295    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:40.099252 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.099225    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-crdgg\""
Jul 12 15:21:40.107597 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.107567    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"]
Jul 12 15:21:40.222456 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.222416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhdz\" (UniqueName: \"kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz\") pod \"limitador-operator-controller-manager-859d7b78bd-929cv\" (UID: \"e335d583-b5f9-406e-9a83-0577192cd53c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:40.323135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.323082    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhdz\" (UniqueName: \"kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz\") pod \"limitador-operator-controller-manager-859d7b78bd-929cv\" (UID: \"e335d583-b5f9-406e-9a83-0577192cd53c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:40.331555 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.331521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhdz\" (UniqueName: \"kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz\") pod \"limitador-operator-controller-manager-859d7b78bd-929cv\" (UID: \"e335d583-b5f9-406e-9a83-0577192cd53c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:40.406578 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.406530    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:40.552683 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:40.552655    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"]
Jul 12 15:21:40.554776 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:40.554745    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode335d583_b5f9_406e_9a83_0577192cd53c.slice/crio-6bf8647f7172cfbc0479bcd5bfada1b43c5673088525f999a61c7510675e5521 WatchSource:0}: Error finding container 6bf8647f7172cfbc0479bcd5bfada1b43c5673088525f999a61c7510675e5521: Status 404 returned error can't find the container with id 6bf8647f7172cfbc0479bcd5bfada1b43c5673088525f999a61c7510675e5521
Jul 12 15:21:41.545296 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:41.545212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv" event={"ID":"e335d583-b5f9-406e-9a83-0577192cd53c","Type":"ContainerStarted","Data":"6bf8647f7172cfbc0479bcd5bfada1b43c5673088525f999a61c7510675e5521"}
Jul 12 15:21:42.551826 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:42.551791    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv" event={"ID":"e335d583-b5f9-406e-9a83-0577192cd53c","Type":"ContainerStarted","Data":"ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a"}
Jul 12 15:21:42.552207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:42.551933    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:21:42.571311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:42.571257    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv" podStartSLOduration=1.093460448 podStartE2EDuration="2.571237165s" totalImagesPullingTime="1.477776717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:42.570536115 +0000 UTC m=+704.158838785" watchObservedRunningTime="2026-07-12 15:21:42.571237165 +0000 UTC m=+704.159539835"
Jul 12 15:21:44.619273 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.619229    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"]
Jul 12 15:21:44.622435 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.622414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.625620 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.625594    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kf5n9\""
Jul 12 15:21:44.633723 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.633694    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"]
Jul 12 15:21:44.762839 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.762801    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sj6s\" (UniqueName: \"kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.763078 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.762895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.864019 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.863976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.864200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.864045    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sj6s\" (UniqueName: \"kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.864417 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.864397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.872104 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.872031    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sj6s\" (UniqueName: \"kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:44.934092 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:44.934052    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:45.087033 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:45.087004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"]
Jul 12 15:21:45.089931 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:21:45.089890    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42388290_8e56_47e7_a101_f6f1b45c5c22.slice/crio-6c3da3cb32018475583e36aa516e01ebade00652e98e4abb0f9a751588d27c1d WatchSource:0}: Error finding container 6c3da3cb32018475583e36aa516e01ebade00652e98e4abb0f9a751588d27c1d: Status 404 returned error can't find the container with id 6c3da3cb32018475583e36aa516e01ebade00652e98e4abb0f9a751588d27c1d
Jul 12 15:21:45.573273 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:45.573236    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb" event={"ID":"42388290-8e56-47e7-a101-f6f1b45c5c22","Type":"ContainerStarted","Data":"6c3da3cb32018475583e36aa516e01ebade00652e98e4abb0f9a751588d27c1d"}
Jul 12 15:21:46.517573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:46.517542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvscb"
Jul 12 15:21:50.542027 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:50.541800    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dlggn"
Jul 12 15:21:51.614877 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:51.614838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb" event={"ID":"42388290-8e56-47e7-a101-f6f1b45c5c22","Type":"ContainerStarted","Data":"4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e"}
Jul 12 15:21:51.615343 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:51.614947    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:21:51.632866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:51.632814    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb" podStartSLOduration=1.952170964 podStartE2EDuration="7.63280012s" totalImagesPullingTime="5.680629156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:51.631615417 +0000 UTC m=+713.219918087" watchObservedRunningTime="2026-07-12 15:21:51.63280012 +0000 UTC m=+713.221102789"
Jul 12 15:21:53.559785 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:21:53.559749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:02.622983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:02.622949    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.250324 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.250285    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"]
Jul 12 15:22:04.250823 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.250528    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" containerName="manager" containerID="cri-o://4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e" gracePeriod=2
Jul 12 15:22:04.252923 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.252890    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:04.257781 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.257755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.258260 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.258235    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"]
Jul 12 15:22:04.264547 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.264498    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"42388290-8e56-47e7-a101-f6f1b45c5c22\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.270927 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.270885    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:04.274572 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.274176    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"]
Jul 12 15:22:04.274572 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.274395    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" containerName="manager" containerID="cri-o://ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a" gracePeriod=2
Jul 12 15:22:04.277465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.277440    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:04.277901 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.277883    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" containerName="manager"
Jul 12 15:22:04.278001 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.277903    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" containerName="manager"
Jul 12 15:22:04.278001 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.277984    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" containerName="manager"
Jul 12 15:22:04.280943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.280919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.289810 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.289764    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.292345 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.292306    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.294491 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.294459    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:04.297848 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.297819    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"]
Jul 12 15:22:04.316192 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.316163    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.327735 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.327696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jsk\" (UniqueName: \"kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.327934 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.327757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.327934 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.327851    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.328060 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.327942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8wfl\" (UniqueName: \"kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.428735 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.428701    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jsk\" (UniqueName: \"kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.428956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.428745    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.428956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.428868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.429085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.428975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8wfl\" (UniqueName: \"kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.429139 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.429108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.429322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.429300    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.438843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.438787    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8wfl\" (UniqueName: \"kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bsw9r\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.439236 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.439210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jsk\" (UniqueName: \"kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmrrw\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.516535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.516510    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.518508 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.518487    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.518741 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.518715    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.520648 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.520622    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.522605 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.522578    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.524261 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.524233    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.529600 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.529578    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwhdz\" (UniqueName: \"kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz\") pod \"e335d583-b5f9-406e-9a83-0577192cd53c\" (UID: \"e335d583-b5f9-406e-9a83-0577192cd53c\") "
Jul 12 15:22:04.529702 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.529611    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sj6s\" (UniqueName: \"kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s\") pod \"42388290-8e56-47e7-a101-f6f1b45c5c22\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") "
Jul 12 15:22:04.529702 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.529662    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume\") pod \"42388290-8e56-47e7-a101-f6f1b45c5c22\" (UID: \"42388290-8e56-47e7-a101-f6f1b45c5c22\") "
Jul 12 15:22:04.530097 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.530076    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42388290-8e56-47e7-a101-f6f1b45c5c22" (UID: "42388290-8e56-47e7-a101-f6f1b45c5c22"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:22:04.531710 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.531690    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s" (OuterVolumeSpecName: "kube-api-access-4sj6s") pod "42388290-8e56-47e7-a101-f6f1b45c5c22" (UID: "42388290-8e56-47e7-a101-f6f1b45c5c22"). InnerVolumeSpecName "kube-api-access-4sj6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:22:04.531863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.531843    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz" (OuterVolumeSpecName: "kube-api-access-gwhdz") pod "e335d583-b5f9-406e-9a83-0577192cd53c" (UID: "e335d583-b5f9-406e-9a83-0577192cd53c"). InnerVolumeSpecName "kube-api-access-gwhdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:22:04.631118 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.631079    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sj6s\" (UniqueName: \"kubernetes.io/projected/42388290-8e56-47e7-a101-f6f1b45c5c22-kube-api-access-4sj6s\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:04.631118 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.631108    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42388290-8e56-47e7-a101-f6f1b45c5c22-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:04.631118 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.631119    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwhdz\" (UniqueName: \"kubernetes.io/projected/e335d583-b5f9-406e-9a83-0577192cd53c-kube-api-access-gwhdz\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:04.674010 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.673978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:04.678637 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.678605    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:04.679890 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.679861    2566 generic.go:356] "Generic (PLEG): container finished" podID="42388290-8e56-47e7-a101-f6f1b45c5c22" containerID="4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e" exitCode=0
Jul 12 15:22:04.680035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.679901    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.680035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.679963    2566 scope.go:117] "RemoveContainer" containerID="4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e"
Jul 12 15:22:04.681613 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.681429    2566 generic.go:356] "Generic (PLEG): container finished" podID="e335d583-b5f9-406e-9a83-0577192cd53c" containerID="ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a" exitCode=0
Jul 12 15:22:04.681613 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.681487    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.682111 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.682084    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.683743 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.683719    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.685540 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.685514    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.687339 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.687311    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.691156 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.691130    2566 scope.go:117] "RemoveContainer" containerID="4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e"
Jul 12 15:22:04.691578 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.691560    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e\": container with ID starting with 4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e not found: ID does not exist" containerID="4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e"
Jul 12 15:22:04.691706 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.691588    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e"} err="failed to get container status \"4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e\": rpc error: code = NotFound desc = could not find container \"4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e\": container with ID starting with 4be265117dfc022e7accc8d91749aab5228147ef15a1d4ce35110ac0dd8d7a0e not found: ID does not exist"
Jul 12 15:22:04.691706 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.691607    2566 scope.go:117] "RemoveContainer" containerID="ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a"
Jul 12 15:22:04.696025 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.695993    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.697883 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.697858    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.699749 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.699714    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-929cv\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-929cv"
Jul 12 15:22:04.701502 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.701477    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rfcb\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rfcb"
Jul 12 15:22:04.702941 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.702899    2566 scope.go:117] "RemoveContainer" containerID="ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a"
Jul 12 15:22:04.703312 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:04.703290    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a\": container with ID starting with ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a not found: ID does not exist" containerID="ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a"
Jul 12 15:22:04.703422 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.703320    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a"} err="failed to get container status \"ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a\": rpc error: code = NotFound desc = could not find container \"ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a\": container with ID starting with ab9b311f70517ca122ebe6bdbfe250a8344a803ef748400ad91b07b9c36c953a not found: ID does not exist"
Jul 12 15:22:04.836173 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.835675    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:04.847848 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.847822    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:04.853114 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:22:04.853087    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e90f431_5068_4b00_ad23_bdaa5388d78d.slice/crio-49f70dd5a05b81371d223b63ed5aa5da2f0227f528339169800035b9cac0f5a1 WatchSource:0}: Error finding container 49f70dd5a05b81371d223b63ed5aa5da2f0227f528339169800035b9cac0f5a1: Status 404 returned error can't find the container with id 49f70dd5a05b81371d223b63ed5aa5da2f0227f528339169800035b9cac0f5a1
Jul 12 15:22:04.873905 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.873872    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42388290-8e56-47e7-a101-f6f1b45c5c22" path="/var/lib/kubelet/pods/42388290-8e56-47e7-a101-f6f1b45c5c22/volumes"
Jul 12 15:22:04.874337 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:04.874316    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" path="/var/lib/kubelet/pods/e335d583-b5f9-406e-9a83-0577192cd53c/volumes"
Jul 12 15:22:05.690893 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.690856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" event={"ID":"7e90f431-5068-4b00-ad23-bdaa5388d78d","Type":"ContainerStarted","Data":"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"}
Jul 12 15:22:05.691376 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.690939    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" event={"ID":"7e90f431-5068-4b00-ad23-bdaa5388d78d","Type":"ContainerStarted","Data":"49f70dd5a05b81371d223b63ed5aa5da2f0227f528339169800035b9cac0f5a1"}
Jul 12 15:22:05.691376 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.690999    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:05.692658 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.692634    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" event={"ID":"43ab583d-712e-4789-bf5a-84c7422cc83d","Type":"ContainerStarted","Data":"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"}
Jul 12 15:22:05.692788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.692675    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" event={"ID":"43ab583d-712e-4789-bf5a-84c7422cc83d","Type":"ContainerStarted","Data":"47ab70c45edbcdb451a3277863fac4d3fe8b2785676b35d7c4c40cb113dec22a"}
Jul 12 15:22:05.692788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.692695    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:05.712223 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.712170    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" podStartSLOduration=1.712152368 podStartE2EDuration="1.712152368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:05.711591002 +0000 UTC m=+727.299893672" watchObservedRunningTime="2026-07-12 15:22:05.712152368 +0000 UTC m=+727.300455038"
Jul 12 15:22:05.728733 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:05.728673    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" podStartSLOduration=1.7286559270000001 podStartE2EDuration="1.728655927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:05.727937444 +0000 UTC m=+727.316240112" watchObservedRunningTime="2026-07-12 15:22:05.728655927 +0000 UTC m=+727.316958597"
Jul 12 15:22:16.699932 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:16.699878    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:16.700413 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:16.700112    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:16.768306 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:16.768274    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:16.768521 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:16.768496    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" podUID="7e90f431-5068-4b00-ad23-bdaa5388d78d" containerName="manager" containerID="cri-o://a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259" gracePeriod=10
Jul 12 15:22:17.008702 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.008674    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:22:17.009095 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.009078    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" containerName="manager"
Jul 12 15:22:17.009157 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.009097    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" containerName="manager"
Jul 12 15:22:17.009195 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.009165    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e335d583-b5f9-406e-9a83-0577192cd53c" containerName="manager"
Jul 12 15:22:17.012190 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.012164    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.027009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.026978    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:22:17.030311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.030287    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:17.138784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.138744    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume\") pod \"7e90f431-5068-4b00-ad23-bdaa5388d78d\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") "
Jul 12 15:22:17.138992 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.138834    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82jsk\" (UniqueName: \"kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk\") pod \"7e90f431-5068-4b00-ad23-bdaa5388d78d\" (UID: \"7e90f431-5068-4b00-ad23-bdaa5388d78d\") "
Jul 12 15:22:17.139057 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.139033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.139117 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.139070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tft9\" (UniqueName: \"kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.139298 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.139278    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7e90f431-5068-4b00-ad23-bdaa5388d78d" (UID: "7e90f431-5068-4b00-ad23-bdaa5388d78d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:22:17.140970 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.140947    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk" (OuterVolumeSpecName: "kube-api-access-82jsk") pod "7e90f431-5068-4b00-ad23-bdaa5388d78d" (UID: "7e90f431-5068-4b00-ad23-bdaa5388d78d"). InnerVolumeSpecName "kube-api-access-82jsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:22:17.239603 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.239506    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.239603 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.239544    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tft9\" (UniqueName: \"kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.239784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.239617    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82jsk\" (UniqueName: \"kubernetes.io/projected/7e90f431-5068-4b00-ad23-bdaa5388d78d-kube-api-access-82jsk\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:17.239784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.239627    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e90f431-5068-4b00-ad23-bdaa5388d78d-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:17.239901 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.239881    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.248151 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.248127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tft9\" (UniqueName: \"kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9\") pod \"kuadrant-operator-controller-manager-86878c769f-nddc6\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.338207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.338153    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.481828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.481791    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:22:17.485488 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:22:17.485446    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747e7987_f403_4589_a223_82f921817cfc.slice/crio-a52b9066b34bcc74e59da962f1a0e58140efd44d2f1a346fdcf4227c046f4278 WatchSource:0}: Error finding container a52b9066b34bcc74e59da962f1a0e58140efd44d2f1a346fdcf4227c046f4278: Status 404 returned error can't find the container with id a52b9066b34bcc74e59da962f1a0e58140efd44d2f1a346fdcf4227c046f4278
Jul 12 15:22:17.755447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.755341    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" event={"ID":"747e7987-f403-4589-a223-82f921817cfc","Type":"ContainerStarted","Data":"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"}
Jul 12 15:22:17.755447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.755408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" event={"ID":"747e7987-f403-4589-a223-82f921817cfc","Type":"ContainerStarted","Data":"a52b9066b34bcc74e59da962f1a0e58140efd44d2f1a346fdcf4227c046f4278"}
Jul 12 15:22:17.755447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.755447    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:17.756728 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.756701    2566 generic.go:356] "Generic (PLEG): container finished" podID="7e90f431-5068-4b00-ad23-bdaa5388d78d" containerID="a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259" exitCode=0
Jul 12 15:22:17.756782 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.756745    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"
Jul 12 15:22:17.756818 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.756780    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" event={"ID":"7e90f431-5068-4b00-ad23-bdaa5388d78d","Type":"ContainerDied","Data":"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"}
Jul 12 15:22:17.756852 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.756828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw" event={"ID":"7e90f431-5068-4b00-ad23-bdaa5388d78d","Type":"ContainerDied","Data":"49f70dd5a05b81371d223b63ed5aa5da2f0227f528339169800035b9cac0f5a1"}
Jul 12 15:22:17.756887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.756853    2566 scope.go:117] "RemoveContainer" containerID="a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"
Jul 12 15:22:17.766937 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.766902    2566 scope.go:117] "RemoveContainer" containerID="a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"
Jul 12 15:22:17.767252 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:17.767231    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259\": container with ID starting with a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259 not found: ID does not exist" containerID="a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"
Jul 12 15:22:17.767331 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.767262    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259"} err="failed to get container status \"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259\": rpc error: code = NotFound desc = could not find container \"a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259\": container with ID starting with a226f91f325bae7c1d95f741298ea43a8dedc3d8ddbbaa9e05300fb1b43c5259 not found: ID does not exist"
Jul 12 15:22:17.775183 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.775136    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" podStartSLOduration=1.775122549 podStartE2EDuration="1.775122549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:17.773566958 +0000 UTC m=+739.361869627" watchObservedRunningTime="2026-07-12 15:22:17.775122549 +0000 UTC m=+739.363425219"
Jul 12 15:22:17.788757 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.788723    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:17.800008 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:17.799975    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmrrw"]
Jul 12 15:22:18.873162 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:18.873131    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e90f431-5068-4b00-ad23-bdaa5388d78d" path="/var/lib/kubelet/pods/7e90f431-5068-4b00-ad23-bdaa5388d78d/volumes"
Jul 12 15:22:28.766065 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:28.766030    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:22:28.811574 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:28.811499    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:28.812226 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:28.811787    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" podUID="43ab583d-712e-4789-bf5a-84c7422cc83d" containerName="manager" containerID="cri-o://373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30" gracePeriod=10
Jul 12 15:22:29.061203 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.061169    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:29.147225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.147182    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume\") pod \"43ab583d-712e-4789-bf5a-84c7422cc83d\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") "
Jul 12 15:22:29.147225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.147235    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8wfl\" (UniqueName: \"kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl\") pod \"43ab583d-712e-4789-bf5a-84c7422cc83d\" (UID: \"43ab583d-712e-4789-bf5a-84c7422cc83d\") "
Jul 12 15:22:29.147557 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.147533    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "43ab583d-712e-4789-bf5a-84c7422cc83d" (UID: "43ab583d-712e-4789-bf5a-84c7422cc83d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:22:29.149373 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.149346    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl" (OuterVolumeSpecName: "kube-api-access-d8wfl") pod "43ab583d-712e-4789-bf5a-84c7422cc83d" (UID: "43ab583d-712e-4789-bf5a-84c7422cc83d"). InnerVolumeSpecName "kube-api-access-d8wfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:22:29.248515 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.248474    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43ab583d-712e-4789-bf5a-84c7422cc83d-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:29.248515 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.248509    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8wfl\" (UniqueName: \"kubernetes.io/projected/43ab583d-712e-4789-bf5a-84c7422cc83d-kube-api-access-d8wfl\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:22:29.827367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.827325    2566 generic.go:356] "Generic (PLEG): container finished" podID="43ab583d-712e-4789-bf5a-84c7422cc83d" containerID="373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30" exitCode=0
Jul 12 15:22:29.827367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.827371    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"
Jul 12 15:22:29.827851 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.827410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" event={"ID":"43ab583d-712e-4789-bf5a-84c7422cc83d","Type":"ContainerDied","Data":"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"}
Jul 12 15:22:29.827851 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.827474    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r" event={"ID":"43ab583d-712e-4789-bf5a-84c7422cc83d","Type":"ContainerDied","Data":"47ab70c45edbcdb451a3277863fac4d3fe8b2785676b35d7c4c40cb113dec22a"}
Jul 12 15:22:29.827851 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.827500    2566 scope.go:117] "RemoveContainer" containerID="373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"
Jul 12 15:22:29.837030 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.837011    2566 scope.go:117] "RemoveContainer" containerID="373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"
Jul 12 15:22:29.837363 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:22:29.837343    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30\": container with ID starting with 373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30 not found: ID does not exist" containerID="373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"
Jul 12 15:22:29.837428 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.837372    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30"} err="failed to get container status \"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30\": rpc error: code = NotFound desc = could not find container \"373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30\": container with ID starting with 373c5ad9e11ab9646922a72faa62022d6e6b59008e32c794b120fde18242ca30 not found: ID does not exist"
Jul 12 15:22:29.848366 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.848334    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:29.851676 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:29.851644    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bsw9r"]
Jul 12 15:22:30.872009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:30.871978    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ab583d-712e-4789-bf5a-84c7422cc83d" path="/var/lib/kubelet/pods/43ab583d-712e-4789-bf5a-84c7422cc83d/volumes"
Jul 12 15:22:33.040098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040059    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"]
Jul 12 15:22:33.040546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040530    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e90f431-5068-4b00-ad23-bdaa5388d78d" containerName="manager"
Jul 12 15:22:33.040589 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040549    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e90f431-5068-4b00-ad23-bdaa5388d78d" containerName="manager"
Jul 12 15:22:33.040589 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040570    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ab583d-712e-4789-bf5a-84c7422cc83d" containerName="manager"
Jul 12 15:22:33.040589 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040582    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ab583d-712e-4789-bf5a-84c7422cc83d" containerName="manager"
Jul 12 15:22:33.040693 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040682    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ab583d-712e-4789-bf5a-84c7422cc83d" containerName="manager"
Jul 12 15:22:33.040725 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.040698    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e90f431-5068-4b00-ad23-bdaa5388d78d" containerName="manager"
Jul 12 15:22:33.045296 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.045271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.047859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.047836    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 15:22:33.047859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.047837    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tjxjv\""
Jul 12 15:22:33.052513 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.052482    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"]
Jul 12 15:22:33.182546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182747 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182686    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmpn\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-kube-api-access-4gmpn\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d3c1ec-85f0-433d-9b11-64a0c2832246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182810    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.182991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.182838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.283830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.283830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283897    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283955    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.283985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284045    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmpn\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-kube-api-access-4gmpn\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284082    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d3c1ec-85f0-433d-9b11-64a0c2832246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284435 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284303    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284435 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284435 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284373    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284622 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284599    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.284666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.284650    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d3c1ec-85f0-433d-9b11-64a0c2832246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.286175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.286151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.286512 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.286491    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.292155 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.292101    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.292294 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.292272    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmpn\" (UniqueName: \"kubernetes.io/projected/61d3c1ec-85f0-433d-9b11-64a0c2832246-kube-api-access-4gmpn\") pod \"maas-default-gateway-openshift-default-56654dcf7-95bfs\" (UID: \"61d3c1ec-85f0-433d-9b11-64a0c2832246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.358484 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.358448    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:33.495272 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.495244    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"]
Jul 12 15:22:33.497892 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:22:33.497865    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d3c1ec_85f0_433d_9b11_64a0c2832246.slice/crio-f32caefcc740b669c9db7485a6e91d7ef4c2bc2e62e1c46da6c53b0e16b57be4 WatchSource:0}: Error finding container f32caefcc740b669c9db7485a6e91d7ef4c2bc2e62e1c46da6c53b0e16b57be4: Status 404 returned error can't find the container with id f32caefcc740b669c9db7485a6e91d7ef4c2bc2e62e1c46da6c53b0e16b57be4
Jul 12 15:22:33.850196 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:33.850158    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" event={"ID":"61d3c1ec-85f0-433d-9b11-64a0c2832246","Type":"ContainerStarted","Data":"f32caefcc740b669c9db7485a6e91d7ef4c2bc2e62e1c46da6c53b0e16b57be4"}
Jul 12 15:22:42.270181 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:42.270141    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:22:42.270487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:42.270216    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:22:42.270487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:42.270253    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:22:42.898793 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:42.898758    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" event={"ID":"61d3c1ec-85f0-433d-9b11-64a0c2832246","Type":"ContainerStarted","Data":"0c18b868185e2ead1b746635d60ede69aec52c9a9ec141999cce35679d257c2f"}
Jul 12 15:22:42.918746 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:42.918694    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" podStartSLOduration=1.14895471 podStartE2EDuration="9.918679398s" totalImagesPullingTime="8.769724688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:42.917690043 +0000 UTC m=+764.505992714" watchObservedRunningTime="2026-07-12 15:22:42.918679398 +0000 UTC m=+764.506982066"
Jul 12 15:22:43.359498 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:43.359465    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:43.364178 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:43.364156    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:43.903961 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:43.903903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:43.904843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:43.904822    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:22:47.411587 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.411551    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:22:47.415369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.415345    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.417472 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.417452    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 15:22:47.417609 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.417481    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2jxw\""
Jul 12 15:22:47.421024 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.420991    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:22:47.510193 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.510155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm7mc\" (UniqueName: \"kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.510402 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.510284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.513559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.513525    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:22:47.611752 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.611715    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.611970 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.611865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm7mc\" (UniqueName: \"kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.612408 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.612386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.620131 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.620102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm7mc\" (UniqueName: \"kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc\") pod \"limitador-limitador-64c94fd64f-9rsh8\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.721351 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.721268    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:22:47.724927 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.724894    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.727135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.727114    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:47.731674 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.731643    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:22:47.759882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.757659    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:22:47.814247 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.814149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea6e18c2-6067-478d-a198-09b0e2b247dd-config-file\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.814247 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.814230    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trc5l\" (UniqueName: \"kubernetes.io/projected/ea6e18c2-6067-478d-a198-09b0e2b247dd-kube-api-access-trc5l\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.869122 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.869096    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:22:47.871145 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:22:47.871110    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6e6e4d_44a0_4dde_9eab_ccdda53befe2.slice/crio-2ea6ff386e76bcae1a6b0c31166cc6fb646bd6546c4c678c3db148c120fd451b WatchSource:0}: Error finding container 2ea6ff386e76bcae1a6b0c31166cc6fb646bd6546c4c678c3db148c120fd451b: Status 404 returned error can't find the container with id 2ea6ff386e76bcae1a6b0c31166cc6fb646bd6546c4c678c3db148c120fd451b
Jul 12 15:22:47.915633 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.915591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trc5l\" (UniqueName: \"kubernetes.io/projected/ea6e18c2-6067-478d-a198-09b0e2b247dd-kube-api-access-trc5l\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.915853 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.915666    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea6e18c2-6067-478d-a198-09b0e2b247dd-config-file\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.916299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.916278    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea6e18c2-6067-478d-a198-09b0e2b247dd-config-file\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.923783 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.923757    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trc5l\" (UniqueName: \"kubernetes.io/projected/ea6e18c2-6067-478d-a198-09b0e2b247dd-kube-api-access-trc5l\") pod \"limitador-limitador-54d6d988d5-2868v\" (UID: \"ea6e18c2-6067-478d-a198-09b0e2b247dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:47.925051 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:47.925025    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" event={"ID":"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2","Type":"ContainerStarted","Data":"2ea6ff386e76bcae1a6b0c31166cc6fb646bd6546c4c678c3db148c120fd451b"}
Jul 12 15:22:48.037321 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:48.037232    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:48.202768 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:48.202671    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:22:48.205399 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:22:48.205369    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6e18c2_6067_478d_a198_09b0e2b247dd.slice/crio-3e77eadb92dd2a59871d0ed7cf3a02f9efa23920d373c0936be67b2aaa4070b1 WatchSource:0}: Error finding container 3e77eadb92dd2a59871d0ed7cf3a02f9efa23920d373c0936be67b2aaa4070b1: Status 404 returned error can't find the container with id 3e77eadb92dd2a59871d0ed7cf3a02f9efa23920d373c0936be67b2aaa4070b1
Jul 12 15:22:48.940520 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:48.940425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v" event={"ID":"ea6e18c2-6067-478d-a198-09b0e2b247dd","Type":"ContainerStarted","Data":"3e77eadb92dd2a59871d0ed7cf3a02f9efa23920d373c0936be67b2aaa4070b1"}
Jul 12 15:22:50.953616 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.953581    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" event={"ID":"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2","Type":"ContainerStarted","Data":"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"}
Jul 12 15:22:50.954066 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.953645    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:22:50.955120 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.955092    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v" event={"ID":"ea6e18c2-6067-478d-a198-09b0e2b247dd","Type":"ContainerStarted","Data":"d0eeef688783f0ebd859ddbb36b8e0495a4dc7f128741b5699af1e3575973c74"}
Jul 12 15:22:50.955238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.955190    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:22:50.967985 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.967932    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" podStartSLOduration=1.004956754 podStartE2EDuration="3.967897214s" totalImagesPullingTime="2.96294046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:50.96728533 +0000 UTC m=+772.555587999" watchObservedRunningTime="2026-07-12 15:22:50.967897214 +0000 UTC m=+772.556199880"
Jul 12 15:22:50.981756 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:22:50.981702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v" podStartSLOduration=1.342310374 podStartE2EDuration="3.98168405s" totalImagesPullingTime="2.639373676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:22:50.980827666 +0000 UTC m=+772.569130336" watchObservedRunningTime="2026-07-12 15:22:50.98168405 +0000 UTC m=+772.569986719"
Jul 12 15:23:01.961331 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:01.961300    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2868v"
Jul 12 15:23:01.961754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:01.961370    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:23:02.016047 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.016016    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:23:02.016216 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.016195    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" podUID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" containerName="limitador" containerID="cri-o://66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32" gracePeriod=30
Jul 12 15:23:02.570460 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.570431    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:23:02.656102 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.656064    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file\") pod \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") "
Jul 12 15:23:02.656275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.656114    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm7mc\" (UniqueName: \"kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc\") pod \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\" (UID: \"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2\") "
Jul 12 15:23:02.656442 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.656419    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file" (OuterVolumeSpecName: "config-file") pod "ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" (UID: "ab6e6e4d-44a0-4dde-9eab-ccdda53befe2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:23:02.658176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.658148    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc" (OuterVolumeSpecName: "kube-api-access-pm7mc") pod "ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" (UID: "ab6e6e4d-44a0-4dde-9eab-ccdda53befe2"). InnerVolumeSpecName "kube-api-access-pm7mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:23:02.757392 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.757352    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-config-file\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:02.757392 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:02.757384    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm7mc\" (UniqueName: \"kubernetes.io/projected/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2-kube-api-access-pm7mc\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:03.026347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.026253    2566 generic.go:356] "Generic (PLEG): container finished" podID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" containerID="66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32" exitCode=0
Jul 12 15:23:03.026347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.026317    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"
Jul 12 15:23:03.026347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.026335    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" event={"ID":"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2","Type":"ContainerDied","Data":"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"}
Jul 12 15:23:03.026825 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.026425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9rsh8" event={"ID":"ab6e6e4d-44a0-4dde-9eab-ccdda53befe2","Type":"ContainerDied","Data":"2ea6ff386e76bcae1a6b0c31166cc6fb646bd6546c4c678c3db148c120fd451b"}
Jul 12 15:23:03.026825 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.026453    2566 scope.go:117] "RemoveContainer" containerID="66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"
Jul 12 15:23:03.035282 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.035259    2566 scope.go:117] "RemoveContainer" containerID="66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"
Jul 12 15:23:03.035608 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:03.035587    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32\": container with ID starting with 66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32 not found: ID does not exist" containerID="66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"
Jul 12 15:23:03.035650 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.035619    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32"} err="failed to get container status \"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32\": rpc error: code = NotFound desc = could not find container \"66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32\": container with ID starting with 66d4e149c4e772563eb08f31b243e0b2dab9fbe244df767fc3507c8ba832da32 not found: ID does not exist"
Jul 12 15:23:03.042114 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.042073    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:23:03.047091 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:03.047064    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9rsh8"]
Jul 12 15:23:04.873515 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:04.873482    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" path="/var/lib/kubelet/pods/ab6e6e4d-44a0-4dde-9eab-ccdda53befe2/volumes"
Jul 12 15:23:17.246121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.246086    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dq56n"]
Jul 12 15:23:17.246800 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.246447    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" containerName="limitador"
Jul 12 15:23:17.246800 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.246460    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" containerName="limitador"
Jul 12 15:23:17.246800 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.246530    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6e6e4d-44a0-4dde-9eab-ccdda53befe2" containerName="limitador"
Jul 12 15:23:17.322519 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.322481    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dq56n"]
Jul 12 15:23:17.322690 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.322585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:17.325027 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.325003    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ckn5t\""
Jul 12 15:23:17.479503 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.479465    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dq56n"]
Jul 12 15:23:17.479748 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:17.479724    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rhnrg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dq56n" podUID="b7711359-d936-4dc5-97e5-de60ed7abfa0"
Jul 12 15:23:17.493664 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.493627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnrg\" (UniqueName: \"kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg\") pod \"authorino-5d4b67c446-dq56n\" (UID: \"b7711359-d936-4dc5-97e5-de60ed7abfa0\") " pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:17.506782 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.506698    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59f7d8885d-t4dvn"]
Jul 12 15:23:17.509211 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.509186    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:17.516111 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.516078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f7d8885d-t4dvn"]
Jul 12 15:23:17.594261 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.594225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnrg\" (UniqueName: \"kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg\") pod \"authorino-5d4b67c446-dq56n\" (UID: \"b7711359-d936-4dc5-97e5-de60ed7abfa0\") " pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:17.594428 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.594277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmsq\" (UniqueName: \"kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq\") pod \"authorino-59f7d8885d-t4dvn\" (UID: \"5793b729-c969-427a-8689-a9389fcd1248\") " pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:17.601599 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.601571    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnrg\" (UniqueName: \"kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg\") pod \"authorino-5d4b67c446-dq56n\" (UID: \"b7711359-d936-4dc5-97e5-de60ed7abfa0\") " pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:17.657772 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.657736    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f7d8885d-t4dvn"]
Jul 12 15:23:17.658041 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:17.658020    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wmmsq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-59f7d8885d-t4dvn" podUID="5793b729-c969-427a-8689-a9389fcd1248"
Jul 12 15:23:17.694728 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.694693    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmsq\" (UniqueName: \"kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq\") pod \"authorino-59f7d8885d-t4dvn\" (UID: \"5793b729-c969-427a-8689-a9389fcd1248\") " pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:17.708885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:17.708848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmsq\" (UniqueName: \"kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq\") pod \"authorino-59f7d8885d-t4dvn\" (UID: \"5793b729-c969-427a-8689-a9389fcd1248\") " pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:18.100072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.100039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:18.100263 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.100042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:18.106549 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.106517    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:18.109608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.109586    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:18.200239 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.200195    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhnrg\" (UniqueName: \"kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg\") pod \"b7711359-d936-4dc5-97e5-de60ed7abfa0\" (UID: \"b7711359-d936-4dc5-97e5-de60ed7abfa0\") "
Jul 12 15:23:18.200431 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.200272    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmmsq\" (UniqueName: \"kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq\") pod \"5793b729-c969-427a-8689-a9389fcd1248\" (UID: \"5793b729-c969-427a-8689-a9389fcd1248\") "
Jul 12 15:23:18.202465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.202426    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq" (OuterVolumeSpecName: "kube-api-access-wmmsq") pod "5793b729-c969-427a-8689-a9389fcd1248" (UID: "5793b729-c969-427a-8689-a9389fcd1248"). InnerVolumeSpecName "kube-api-access-wmmsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:23:18.202465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.202446    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg" (OuterVolumeSpecName: "kube-api-access-rhnrg") pod "b7711359-d936-4dc5-97e5-de60ed7abfa0" (UID: "b7711359-d936-4dc5-97e5-de60ed7abfa0"). InnerVolumeSpecName "kube-api-access-rhnrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:23:18.301481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.301443    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhnrg\" (UniqueName: \"kubernetes.io/projected/b7711359-d936-4dc5-97e5-de60ed7abfa0-kube-api-access-rhnrg\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:18.301481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:18.301471    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmmsq\" (UniqueName: \"kubernetes.io/projected/5793b729-c969-427a-8689-a9389fcd1248-kube-api-access-wmmsq\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:19.104835 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.104801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dq56n"
Jul 12 15:23:19.105026 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.104801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f7d8885d-t4dvn"
Jul 12 15:23:19.131031 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.130947    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dq56n"]
Jul 12 15:23:19.133180 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.133158    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dq56n"]
Jul 12 15:23:19.149821 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.149789    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f7d8885d-t4dvn"]
Jul 12 15:23:19.152936 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:19.152896    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59f7d8885d-t4dvn"]
Jul 12 15:23:20.873708 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:20.873612    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5793b729-c969-427a-8689-a9389fcd1248" path="/var/lib/kubelet/pods/5793b729-c969-427a-8689-a9389fcd1248/volumes"
Jul 12 15:23:20.874213 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:20.873993    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7711359-d936-4dc5-97e5-de60ed7abfa0" path="/var/lib/kubelet/pods/b7711359-d936-4dc5-97e5-de60ed7abfa0/volumes"
Jul 12 15:23:23.480699 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.480658    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:23.484258 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.484237    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.486667 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.486644    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ghbsb\""
Jul 12 15:23:23.486784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.486722    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 15:23:23.486784 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.486746    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 15:23:23.493150 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.493118    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:23.651645 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.651601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.651888 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.651664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qcl8\" (UniqueName: \"kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.753108 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.753003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qcl8\" (UniqueName: \"kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.753108 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.753101    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.755587 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.755559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.760986 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.760953    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qcl8\" (UniqueName: \"kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8\") pod \"maas-controller-694b65dcf4-b5zwt\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") " pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.796894 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.796857    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:23.937887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:23.937855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:23.940074 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:23:23.940047    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34be8c9_8ad5_4063_9369_39b0227d9064.slice/crio-2029cc0cdd833baed3c22291165b0c346ac21f75918fc7846ec70710ea81a831 WatchSource:0}: Error finding container 2029cc0cdd833baed3c22291165b0c346ac21f75918fc7846ec70710ea81a831: Status 404 returned error can't find the container with id 2029cc0cdd833baed3c22291165b0c346ac21f75918fc7846ec70710ea81a831
Jul 12 15:23:24.137876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:24.137831    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" event={"ID":"c34be8c9-8ad5-4063-9369-39b0227d9064","Type":"ContainerStarted","Data":"2029cc0cdd833baed3c22291165b0c346ac21f75918fc7846ec70710ea81a831"}
Jul 12 15:23:26.151202 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:26.151152    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" event={"ID":"c34be8c9-8ad5-4063-9369-39b0227d9064","Type":"ContainerStarted","Data":"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"}
Jul 12 15:23:26.151687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:26.151291    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:26.170298 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:26.170227    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" podStartSLOduration=1.357612317 podStartE2EDuration="3.170203878s" totalImagesPullingTime="1.812591561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:23:26.166875753 +0000 UTC m=+807.755178415" watchObservedRunningTime="2026-07-12 15:23:26.170203878 +0000 UTC m=+807.758506549"
Jul 12 15:23:37.161859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:37.161827    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:37.808788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:37.808752    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:37.808991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:37.808960    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" podUID="c34be8c9-8ad5-4063-9369-39b0227d9064" containerName="manager" containerID="cri-o://13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff" gracePeriod=30
Jul 12 15:23:38.064413 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.064347    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:38.181640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.181598    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qcl8\" (UniqueName: \"kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8\") pod \"c34be8c9-8ad5-4063-9369-39b0227d9064\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") "
Jul 12 15:23:38.182062 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.181689    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert\") pod \"c34be8c9-8ad5-4063-9369-39b0227d9064\" (UID: \"c34be8c9-8ad5-4063-9369-39b0227d9064\") "
Jul 12 15:23:38.183921 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.183880    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c34be8c9-8ad5-4063-9369-39b0227d9064" (UID: "c34be8c9-8ad5-4063-9369-39b0227d9064"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:23:38.184052 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.184031    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8" (OuterVolumeSpecName: "kube-api-access-8qcl8") pod "c34be8c9-8ad5-4063-9369-39b0227d9064" (UID: "c34be8c9-8ad5-4063-9369-39b0227d9064"). InnerVolumeSpecName "kube-api-access-8qcl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:23:38.216564 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.216531    2566 generic.go:356] "Generic (PLEG): container finished" podID="c34be8c9-8ad5-4063-9369-39b0227d9064" containerID="13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff" exitCode=0
Jul 12 15:23:38.216730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.216580    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-b5zwt"
Jul 12 15:23:38.216730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.216587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" event={"ID":"c34be8c9-8ad5-4063-9369-39b0227d9064","Type":"ContainerDied","Data":"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"}
Jul 12 15:23:38.216730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.216668    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-b5zwt" event={"ID":"c34be8c9-8ad5-4063-9369-39b0227d9064","Type":"ContainerDied","Data":"2029cc0cdd833baed3c22291165b0c346ac21f75918fc7846ec70710ea81a831"}
Jul 12 15:23:38.216730 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.216692    2566 scope.go:117] "RemoveContainer" containerID="13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"
Jul 12 15:23:38.225456 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.225437    2566 scope.go:117] "RemoveContainer" containerID="13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"
Jul 12 15:23:38.225755 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:38.225736    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff\": container with ID starting with 13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff not found: ID does not exist" containerID="13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"
Jul 12 15:23:38.225817 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.225768    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff"} err="failed to get container status \"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff\": rpc error: code = NotFound desc = could not find container \"13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff\": container with ID starting with 13e7ba93c140c8a24f2b186f2696a99b7d3d735eecb81ed7ceb7f97dd4e8bbff not found: ID does not exist"
Jul 12 15:23:38.237538 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.237505    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:38.242941 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.242884    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-b5zwt"]
Jul 12 15:23:38.282668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.282628    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c34be8c9-8ad5-4063-9369-39b0227d9064-webhook-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:38.282668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.282662    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qcl8\" (UniqueName: \"kubernetes.io/projected/c34be8c9-8ad5-4063-9369-39b0227d9064-kube-api-access-8qcl8\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:23:38.873214 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:38.873181    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c34be8c9-8ad5-4063-9369-39b0227d9064" path="/var/lib/kubelet/pods/c34be8c9-8ad5-4063-9369-39b0227d9064/volumes"
Jul 12 15:23:56.094534 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.094494    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d597d4445-gdwsz"]
Jul 12 15:23:56.095046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.094859    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c34be8c9-8ad5-4063-9369-39b0227d9064" containerName="manager"
Jul 12 15:23:56.095046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.094871    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c34be8c9-8ad5-4063-9369-39b0227d9064" containerName="manager"
Jul 12 15:23:56.095046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.094957    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c34be8c9-8ad5-4063-9369-39b0227d9064" containerName="manager"
Jul 12 15:23:56.098009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.097986    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.100342 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.100319    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lcn4n\""
Jul 12 15:23:56.100619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.100601    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 12 15:23:56.107670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.107636    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d597d4445-gdwsz"]
Jul 12 15:23:56.236136 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.236092    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547ee43e-257a-49ce-b8ee-ab9b136d91a8-openshift-service-ca\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.236318 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.236234    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.236318 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.236289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6dq\" (UniqueName: \"kubernetes.io/projected/547ee43e-257a-49ce-b8ee-ab9b136d91a8-kube-api-access-mf6dq\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.337498 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.337450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547ee43e-257a-49ce-b8ee-ab9b136d91a8-openshift-service-ca\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.337684 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.337558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.337684 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.337586    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6dq\" (UniqueName: \"kubernetes.io/projected/547ee43e-257a-49ce-b8ee-ab9b136d91a8-kube-api-access-mf6dq\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.337768 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:56.337699    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 12 15:23:56.337805 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:23:56.337780    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls podName:547ee43e-257a-49ce-b8ee-ab9b136d91a8 nodeName:}" failed. No retries permitted until 2026-07-12 15:23:56.837762589 +0000 UTC m=+838.426065236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls") pod "maas-api-5d597d4445-gdwsz" (UID: "547ee43e-257a-49ce-b8ee-ab9b136d91a8") : secret "maas-api-serving-cert" not found
Jul 12 15:23:56.338112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.338092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547ee43e-257a-49ce-b8ee-ab9b136d91a8-openshift-service-ca\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.346369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.346293    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6dq\" (UniqueName: \"kubernetes.io/projected/547ee43e-257a-49ce-b8ee-ab9b136d91a8-kube-api-access-mf6dq\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.569632 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.569593    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ctmcs"]
Jul 12 15:23:56.575191 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.575158    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.578286 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.578257    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 12 15:23:56.578443 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.578308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dkh49\""
Jul 12 15:23:56.585950 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.585922    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ctmcs"]
Jul 12 15:23:56.623347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.623306    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:23:56.640170 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.640132    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27bf\" (UniqueName: \"kubernetes.io/projected/4238ead9-f041-40d5-9e76-d756cd55d6ad-kube-api-access-p27bf\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.640349 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.640256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4238ead9-f041-40d5-9e76-d756cd55d6ad-plugins-config-volume\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.741059 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.741012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27bf\" (UniqueName: \"kubernetes.io/projected/4238ead9-f041-40d5-9e76-d756cd55d6ad-kube-api-access-p27bf\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.741252 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.741222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4238ead9-f041-40d5-9e76-d756cd55d6ad-plugins-config-volume\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.742159 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.742132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4238ead9-f041-40d5-9e76-d756cd55d6ad-plugins-config-volume\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.748895 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.748850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27bf\" (UniqueName: \"kubernetes.io/projected/4238ead9-f041-40d5-9e76-d756cd55d6ad-kube-api-access-p27bf\") pod \"payload-processing-58f86c7798-ctmcs\" (UID: \"4238ead9-f041-40d5-9e76-d756cd55d6ad\") " pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:56.842594 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.842558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.845086 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.845061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547ee43e-257a-49ce-b8ee-ab9b136d91a8-maas-api-tls\") pod \"maas-api-5d597d4445-gdwsz\" (UID: \"547ee43e-257a-49ce-b8ee-ab9b136d91a8\") " pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:56.888247 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:56.888151    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:57.010358 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:57.010321    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:57.028626 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:57.028404    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ctmcs"]
Jul 12 15:23:57.195387 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:57.195360    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d597d4445-gdwsz"]
Jul 12 15:23:57.197508 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:23:57.197478    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547ee43e_257a_49ce_b8ee_ab9b136d91a8.slice/crio-e273a9af32efe951e773e078d460ecb6113196d3dbd634a219aa8f6a2cce1c11 WatchSource:0}: Error finding container e273a9af32efe951e773e078d460ecb6113196d3dbd634a219aa8f6a2cce1c11: Status 404 returned error can't find the container with id e273a9af32efe951e773e078d460ecb6113196d3dbd634a219aa8f6a2cce1c11
Jul 12 15:23:57.313996 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:57.313959    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d597d4445-gdwsz" event={"ID":"547ee43e-257a-49ce-b8ee-ab9b136d91a8","Type":"ContainerStarted","Data":"e273a9af32efe951e773e078d460ecb6113196d3dbd634a219aa8f6a2cce1c11"}
Jul 12 15:23:57.315236 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:57.315211    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs" event={"ID":"4238ead9-f041-40d5-9e76-d756cd55d6ad","Type":"ContainerStarted","Data":"1cf50d83ea93f526da96d886770859798a73c3d7cf719b955e6092fd05f69117"}
Jul 12 15:23:59.327249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.327199    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs" event={"ID":"4238ead9-f041-40d5-9e76-d756cd55d6ad","Type":"ContainerStarted","Data":"8e9c26214b94de9eb1cb63664dedc6d2ba1658b18567018aabd23b3872fd903a"}
Jul 12 15:23:59.327716 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.327376    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:23:59.328702 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.328679    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d597d4445-gdwsz" event={"ID":"547ee43e-257a-49ce-b8ee-ab9b136d91a8","Type":"ContainerStarted","Data":"d83d35a4945615c01d9d0f36a8d1a1e9644b21c9b0df59c9c459f5b7073261b3"}
Jul 12 15:23:59.328829 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.328775    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:23:59.342885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.342834    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs" podStartSLOduration=1.42119431 podStartE2EDuration="3.342818377s" totalImagesPullingTime="1.921624067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:23:59.341201384 +0000 UTC m=+840.929504059" watchObservedRunningTime="2026-07-12 15:23:59.342818377 +0000 UTC m=+840.931121046"
Jul 12 15:23:59.356486 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:23:59.356429    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5d597d4445-gdwsz" podStartSLOduration=1.5984957770000001 podStartE2EDuration="3.356412727s" totalImagesPullingTime="1.75791695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:23:59.354900938 +0000 UTC m=+840.943203600" watchObservedRunningTime="2026-07-12 15:23:59.356412727 +0000 UTC m=+840.944715428"
Jul 12 15:24:04.353541 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.353503    2566 generic.go:356] "Generic (PLEG): container finished" podID="61d3c1ec-85f0-433d-9b11-64a0c2832246" containerID="0c18b868185e2ead1b746635d60ede69aec52c9a9ec141999cce35679d257c2f" exitCode=0
Jul 12 15:24:04.353962 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.353577    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" event={"ID":"61d3c1ec-85f0-433d-9b11-64a0c2832246","Type":"ContainerDied","Data":"0c18b868185e2ead1b746635d60ede69aec52c9a9ec141999cce35679d257c2f"}
Jul 12 15:24:04.354008 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.353963    2566 scope.go:117] "RemoveContainer" containerID="0c18b868185e2ead1b746635d60ede69aec52c9a9ec141999cce35679d257c2f"
Jul 12 15:24:04.354942 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.354902    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:24:04.354996 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.354984    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:24:04.355029 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:04.355018    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:24:05.339597 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:05.339568    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d597d4445-gdwsz"
Jul 12 15:24:05.361322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:05.361270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" event={"ID":"61d3c1ec-85f0-433d-9b11-64a0c2832246","Type":"ContainerStarted","Data":"bb4998f50854635ab3c712506b0f3361d6ba12bb6922b53551c34b834d3d230e"}
Jul 12 15:24:06.358999 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:06.358958    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:24:06.359311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:06.359281    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-95bfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 12 15:24:06.359556 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:06.359527    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" podUID="61d3c1ec-85f0-433d-9b11-64a0c2832246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 12 15:24:07.360122 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:07.360074    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-95bfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 12 15:24:07.360644 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:07.360149    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" podUID="61d3c1ec-85f0-433d-9b11-64a0c2832246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 12 15:24:08.359543 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:08.359501    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-95bfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 12 15:24:08.359858 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:08.359818    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" podUID="61d3c1ec-85f0-433d-9b11-64a0c2832246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 12 15:24:09.359283 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:09.359243    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-95bfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 12 15:24:09.359956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:09.359893    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs" podUID="61d3c1ec-85f0-433d-9b11-64a0c2832246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 12 15:24:10.336889 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:10.336859    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-ctmcs"
Jul 12 15:24:10.363447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:10.363406    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:24:10.363870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:10.363818    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:24:10.364812 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:10.364789    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-95bfs"
Jul 12 15:24:19.543171 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:19.543135    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:24:27.514480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:27.514435    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:24:36.317543 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.317509    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"]
Jul 12 15:24:36.322055 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.322033    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.324457 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.324431    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 15:24:36.324457 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.324431    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 15:24:36.324632 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.324465    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 15:24:36.324632 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.324576    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5qs5s\""
Jul 12 15:24:36.328079 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.328054    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"]
Jul 12 15:24:36.427577 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.427742 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427585    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.427742 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.427821 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.427821 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.427887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.427818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257xl\" (UniqueName: \"kubernetes.io/projected/2e0eb10a-af76-427b-a6d4-ed756620f1f4-kube-api-access-257xl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.528866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.528818    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.528866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.528871    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.528957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257xl\" (UniqueName: \"kubernetes.io/projected/2e0eb10a-af76-427b-a6d4-ed756620f1f4-kube-api-access-257xl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.528997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.529033    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.529060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529368 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.529334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.529442    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.529463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.529458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.531320 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.531298    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e0eb10a-af76-427b-a6d4-ed756620f1f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.531553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.531535    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e0eb10a-af76-427b-a6d4-ed756620f1f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.536157 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.536131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-257xl\" (UniqueName: \"kubernetes.io/projected/2e0eb10a-af76-427b-a6d4-ed756620f1f4-kube-api-access-257xl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nxns9\" (UID: \"2e0eb10a-af76-427b-a6d4-ed756620f1f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.633714 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.633672    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:36.777264 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:36.777098    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"]
Jul 12 15:24:36.779592 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:24:36.779555    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0eb10a_af76_427b_a6d4_ed756620f1f4.slice/crio-d97ce7b023c023f4cded3e8965c6de354fe0af5563fb04040c94ec0b2fc3cfa5 WatchSource:0}: Error finding container d97ce7b023c023f4cded3e8965c6de354fe0af5563fb04040c94ec0b2fc3cfa5: Status 404 returned error can't find the container with id d97ce7b023c023f4cded3e8965c6de354fe0af5563fb04040c94ec0b2fc3cfa5
Jul 12 15:24:37.559126 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:37.559082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9" event={"ID":"2e0eb10a-af76-427b-a6d4-ed756620f1f4","Type":"ContainerStarted","Data":"d97ce7b023c023f4cded3e8965c6de354fe0af5563fb04040c94ec0b2fc3cfa5"}
Jul 12 15:24:37.809983 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:37.809872    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:24:38.566764 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:38.566723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9" event={"ID":"2e0eb10a-af76-427b-a6d4-ed756620f1f4","Type":"ContainerStarted","Data":"da5e5132ef4aa7d2080b699eaf41e59918de3c38735c9a5ee306cdfca555186e"}
Jul 12 15:24:38.584460 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:38.584405    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9" podStartSLOduration=1.545156712 podStartE2EDuration="2.584385951s" totalImagesPullingTime="1.039229239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:38.582723145 +0000 UTC m=+880.171025814" watchObservedRunningTime="2026-07-12 15:24:38.584385951 +0000 UTC m=+880.172688621"
Jul 12 15:24:46.634648 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:46.634605    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:46.635190 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:46.634686    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:46.647330 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:46.647299    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:47.626674 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:47.626635    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nxns9"
Jul 12 15:24:58.809643 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:58.809560    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:24:58.810086 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:58.809782    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:24:59.022676 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:24:59.022644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:25:06.720345 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:06.720302    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:25:20.706779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.706738    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"]
Jul 12 15:25:20.716737 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.716696    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.719196 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.719156    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 15:25:20.720452 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.720424    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"]
Jul 12 15:25:20.832708 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmqt\" (UniqueName: \"kubernetes.io/projected/728c12e6-87a1-405f-bd41-88d7b9638f18-kube-api-access-pfmqt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.832945 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832739    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.832945 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728c12e6-87a1-405f-bd41-88d7b9638f18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.832945 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832839    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.832945 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.833112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.832969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934040 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934062    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728c12e6-87a1-405f-bd41-88d7b9638f18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmqt\" (UniqueName: \"kubernetes.io/projected/728c12e6-87a1-405f-bd41-88d7b9638f18-kube-api-access-pfmqt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934506    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934602 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.934602 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.934560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.936546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.936516    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728c12e6-87a1-405f-bd41-88d7b9638f18-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.936947 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.936923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728c12e6-87a1-405f-bd41-88d7b9638f18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:20.941876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:20.941845    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmqt\" (UniqueName: \"kubernetes.io/projected/728c12e6-87a1-405f-bd41-88d7b9638f18-kube-api-access-pfmqt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2\" (UID: \"728c12e6-87a1-405f-bd41-88d7b9638f18\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:21.029850 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:21.029754    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:21.179793 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:21.179758    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"]
Jul 12 15:25:21.180457 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:25:21.180423    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod728c12e6_87a1_405f_bd41_88d7b9638f18.slice/crio-f3765a20c96f0b9348fbd23e2f98c1e9d0851c00f940d147c82676c3c5c14502 WatchSource:0}: Error finding container f3765a20c96f0b9348fbd23e2f98c1e9d0851c00f940d147c82676c3c5c14502: Status 404 returned error can't find the container with id f3765a20c96f0b9348fbd23e2f98c1e9d0851c00f940d147c82676c3c5c14502
Jul 12 15:25:21.794582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:21.794534    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2" event={"ID":"728c12e6-87a1-405f-bd41-88d7b9638f18","Type":"ContainerStarted","Data":"6a5923cafc6642633f064d3ab1fe24e5beca3c145a883bb477a20066ced8e971"}
Jul 12 15:25:21.794582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:21.794589    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2" event={"ID":"728c12e6-87a1-405f-bd41-88d7b9638f18","Type":"ContainerStarted","Data":"f3765a20c96f0b9348fbd23e2f98c1e9d0851c00f940d147c82676c3c5c14502"}
Jul 12 15:25:21.812554 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:21.812496    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2" podStartSLOduration=1.643408736 podStartE2EDuration="1.812474545s" totalImagesPullingTime="169.065809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:21.810214151 +0000 UTC m=+923.398516822" watchObservedRunningTime="2026-07-12 15:25:21.812474545 +0000 UTC m=+923.400777215"
Jul 12 15:25:23.218635 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:23.218594    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:25:31.030353 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:31.030309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:31.030852 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:31.030374    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:31.043329 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:31.043294    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:25:31.860044 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:25:31.860003    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2"
Jul 12 15:26:51.323155 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:26:51.323118    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:27:00.513083 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:27:00.513037    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:27:11.911025 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:27:11.910984    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:27:20.015946 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:27:20.015886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:27:31.110822 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:27:31.110777    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:27:57.714086 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:27:57.714001    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:28:10.215930 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:28:10.215866    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:28:44.311949 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:28:44.311894    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:28:53.515685 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:28:53.515644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:03.513558 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:03.513518    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:09.409956 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:09.409920    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:19.421346 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:19.421308    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:30.214866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:30.214780    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:41.110719 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:41.110681    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:50.813047 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:50.813008    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:29:58.841684 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:58.841657    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:29:58.843488 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:29:58.843454    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:30:12.715294 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:30:12.715247    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:30:24.227160 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:30:24.227119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:30:47.520631 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:30:47.520586    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:30:58.307078 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:30:58.306983    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:31:12.412444 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:31:12.412401    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:31:23.112241 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:31:23.112204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:31:32.613631 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:31:32.613586    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:31:41.921378 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:31:41.921334    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:31:51.013839 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:31:51.013802    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:32:17.189936 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:17.189869    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:32:17.190460 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:17.190142    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" podUID="747e7987-f403-4589-a223-82f921817cfc" containerName="manager" containerID="cri-o://70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486" gracePeriod=10
Jul 12 15:32:20.049194 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.049160    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:32:20.057497 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.057462    2566 generic.go:356] "Generic (PLEG): container finished" podID="747e7987-f403-4589-a223-82f921817cfc" containerID="70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486" exitCode=0
Jul 12 15:32:20.057682 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.057506    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"
Jul 12 15:32:20.057682 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.057541    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" event={"ID":"747e7987-f403-4589-a223-82f921817cfc","Type":"ContainerDied","Data":"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"}
Jul 12 15:32:20.057682 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.057608    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6" event={"ID":"747e7987-f403-4589-a223-82f921817cfc","Type":"ContainerDied","Data":"a52b9066b34bcc74e59da962f1a0e58140efd44d2f1a346fdcf4227c046f4278"}
Jul 12 15:32:20.057682 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.057632    2566 scope.go:117] "RemoveContainer" containerID="70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"
Jul 12 15:32:20.068187 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.068161    2566 scope.go:117] "RemoveContainer" containerID="70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"
Jul 12 15:32:20.068528 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:32:20.068506    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486\": container with ID starting with 70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486 not found: ID does not exist" containerID="70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"
Jul 12 15:32:20.068584 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.068538    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486"} err="failed to get container status \"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486\": rpc error: code = NotFound desc = could not find container \"70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486\": container with ID starting with 70da34be28ddd4430014f1bdd774b8b0828ec3e84a59da4333b3bfd3bccac486 not found: ID does not exist"
Jul 12 15:32:20.186167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.186060    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tft9\" (UniqueName: \"kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9\") pod \"747e7987-f403-4589-a223-82f921817cfc\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") "
Jul 12 15:32:20.186167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.186114    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume\") pod \"747e7987-f403-4589-a223-82f921817cfc\" (UID: \"747e7987-f403-4589-a223-82f921817cfc\") "
Jul 12 15:32:20.186566 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.186542    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "747e7987-f403-4589-a223-82f921817cfc" (UID: "747e7987-f403-4589-a223-82f921817cfc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:32:20.188321 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.188292    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9" (OuterVolumeSpecName: "kube-api-access-5tft9") pod "747e7987-f403-4589-a223-82f921817cfc" (UID: "747e7987-f403-4589-a223-82f921817cfc"). InnerVolumeSpecName "kube-api-access-5tft9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:32:20.287779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.287738    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tft9\" (UniqueName: \"kubernetes.io/projected/747e7987-f403-4589-a223-82f921817cfc-kube-api-access-5tft9\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:32:20.287779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.287771    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747e7987-f403-4589-a223-82f921817cfc-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:32:20.380451 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.380418    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:32:20.383321 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.383292    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nddc6"]
Jul 12 15:32:20.873401 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:32:20.873359    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="747e7987-f403-4589-a223-82f921817cfc" path="/var/lib/kubelet/pods/747e7987-f403-4589-a223-82f921817cfc/volumes"
Jul 12 15:33:18.282183 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.282144    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"]
Jul 12 15:33:18.282598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.282513    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747e7987-f403-4589-a223-82f921817cfc" containerName="manager"
Jul 12 15:33:18.282598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.282523    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="747e7987-f403-4589-a223-82f921817cfc" containerName="manager"
Jul 12 15:33:18.282598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.282582    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="747e7987-f403-4589-a223-82f921817cfc" containerName="manager"
Jul 12 15:33:18.286799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.286777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.289214 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.289179    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kf5n9\""
Jul 12 15:33:18.296925 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.296886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"]
Jul 12 15:33:18.423319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.423274    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br8nh\" (UniqueName: \"kubernetes.io/projected/0359bdbf-5952-40aa-958e-07ed670564c7-kube-api-access-br8nh\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.423504 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.423385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0359bdbf-5952-40aa-958e-07ed670564c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.524606 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.524563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br8nh\" (UniqueName: \"kubernetes.io/projected/0359bdbf-5952-40aa-958e-07ed670564c7-kube-api-access-br8nh\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.524778 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.524626    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0359bdbf-5952-40aa-958e-07ed670564c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.525060 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.525042    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0359bdbf-5952-40aa-958e-07ed670564c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.532172 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.532145    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br8nh\" (UniqueName: \"kubernetes.io/projected/0359bdbf-5952-40aa-958e-07ed670564c7-kube-api-access-br8nh\") pod \"kuadrant-operator-controller-manager-86878c769f-69429\" (UID: \"0359bdbf-5952-40aa-958e-07ed670564c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.599017 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.598899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:18.746364 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:18.746334    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"]
Jul 12 15:33:18.748185 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:33:18.748157    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0359bdbf_5952_40aa_958e_07ed670564c7.slice/crio-08ecfa33a91d9068f033c656377ddc6361f7baa566b94a39b463161fb72debb7 WatchSource:0}: Error finding container 08ecfa33a91d9068f033c656377ddc6361f7baa566b94a39b463161fb72debb7: Status 404 returned error can't find the container with id 08ecfa33a91d9068f033c656377ddc6361f7baa566b94a39b463161fb72debb7
Jul 12 15:33:19.369533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:19.369501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429" event={"ID":"0359bdbf-5952-40aa-958e-07ed670564c7","Type":"ContainerStarted","Data":"9a78aba8edf09cf797ac38e62f83bce982fc4b9690ff70c53ca4a6649b72a7cb"}
Jul 12 15:33:19.369943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:19.369552    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429" event={"ID":"0359bdbf-5952-40aa-958e-07ed670564c7","Type":"ContainerStarted","Data":"08ecfa33a91d9068f033c656377ddc6361f7baa566b94a39b463161fb72debb7"}
Jul 12 15:33:19.369943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:19.369607    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:19.390875 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:19.390821    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429" podStartSLOduration=1.390803196 podStartE2EDuration="1.390803196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:19.389036077 +0000 UTC m=+1400.977338748" watchObservedRunningTime="2026-07-12 15:33:19.390803196 +0000 UTC m=+1400.979105866"
Jul 12 15:33:30.376564 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:30.376535    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-69429"
Jul 12 15:33:40.212175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:40.212129    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:33:51.914239 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:33:51.914156    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:00.017922 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:00.017866    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:09.215737 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:09.215699    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:18.311553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:18.311517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:27.718760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:27.718723    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:38.115040 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:38.115001    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:48.018495 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:48.018457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:56.216109 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:56.216060    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:34:58.875594 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:58.875565    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:34:58.879113 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:34:58.879090    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:35:05.212290 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:35:05.212246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:35:14.009528 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:35:14.009487    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:35:24.410335 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:35:24.410242    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:35:46.125347 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:35:46.125305    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:35:55.315472 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:35:55.315431    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:04.609368 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:04.609330    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:16.910595 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:16.910555    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:32.614860 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:32.614822    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:42.014008 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:42.013966    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:51.408768 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:51.408676    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:36:59.321675 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:36:59.321635    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:08.519085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:08.519047    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:17.212135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:17.212098    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:22.913490 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:22.913447    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:32.012813 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:32.012773    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:40.920370 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:40.920330    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:37:49.718208 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:37:49.718167    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:02.311462 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:02.311418    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:13.906836 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:13.906801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:22.814404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:22.814315    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:35.407890 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:35.407854    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:46.816008 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:46.815970    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:38:57.914887 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:38:57.914846    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:06.607564 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:06.607529    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:16.211061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:16.211018    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:24.712609 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:24.712571    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:33.016653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:33.016610    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:35.301695 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.301659    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:35.305444 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.305418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.308052 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.308024    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-ed14bc5b-serving-cert\""
Jul 12 15:39:35.317494 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.317417    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:35.410741 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.410705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.410959 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.410750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfqtv\" (UniqueName: \"kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.410959 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.410897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.511526 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.511493    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.511731 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.511606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.511731 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.511634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqtv\" (UniqueName: \"kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.511731 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:35.511659    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-ed14bc5b-serving-cert: secret "maas-api-e2e-ait-ed14bc5b-serving-cert" not found
Jul 12 15:39:35.511899 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:35.511734    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls podName:e77688ae-2658-49be-ae09-d8dba30cf2ca nodeName:}" failed. No retries permitted until 2026-07-12 15:39:36.011714033 +0000 UTC m=+1777.600016694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls") pod "maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" (UID: "e77688ae-2658-49be-ae09-d8dba30cf2ca") : secret "maas-api-e2e-ait-ed14bc5b-serving-cert" not found
Jul 12 15:39:35.512371 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.512351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:35.521343 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:35.521311    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfqtv\" (UniqueName: \"kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:36.016427 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.016384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:36.018897 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.018874    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") pod \"maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") " pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:36.219767 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.219730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:36.359369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.359342    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:36.361524 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:39:36.361496    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77688ae_2658_49be_ae09_d8dba30cf2ca.slice/crio-86fd4b23d347b9fe2c6a82efe7137f57b4331b4841eb5b6865a529d2c92fcbf5 WatchSource:0}: Error finding container 86fd4b23d347b9fe2c6a82efe7137f57b4331b4841eb5b6865a529d2c92fcbf5: Status 404 returned error can't find the container with id 86fd4b23d347b9fe2c6a82efe7137f57b4331b4841eb5b6865a529d2c92fcbf5
Jul 12 15:39:36.363225 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.363206    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:39:36.388828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:36.388787    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" event={"ID":"e77688ae-2658-49be-ae09-d8dba30cf2ca","Type":"ContainerStarted","Data":"86fd4b23d347b9fe2c6a82efe7137f57b4331b4841eb5b6865a529d2c92fcbf5"}
Jul 12 15:39:37.396343 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:37.396305    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" event={"ID":"e77688ae-2658-49be-ae09-d8dba30cf2ca","Type":"ContainerStarted","Data":"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"}
Jul 12 15:39:37.396723 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:37.396433    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:37.413298 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:37.413240    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" podStartSLOduration=1.907225814 podStartE2EDuration="2.41322328s" totalImagesPullingTime="505.997466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:39:37.412817714 +0000 UTC m=+1779.001120385" watchObservedRunningTime="2026-07-12 15:39:37.41322328 +0000 UTC m=+1779.001525949"
Jul 12 15:39:40.505205 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.505154    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:40.506139 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.505474    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" podUID="e77688ae-2658-49be-ae09-d8dba30cf2ca" containerName="maas-api" containerID="cri-o://8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13" gracePeriod=30
Jul 12 15:39:40.772171 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.772103    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:40.859851 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.859815    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca\") pod \"e77688ae-2658-49be-ae09-d8dba30cf2ca\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") "
Jul 12 15:39:40.859851 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.859852    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfqtv\" (UniqueName: \"kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv\") pod \"e77688ae-2658-49be-ae09-d8dba30cf2ca\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") "
Jul 12 15:39:40.860138 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.859932    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") pod \"e77688ae-2658-49be-ae09-d8dba30cf2ca\" (UID: \"e77688ae-2658-49be-ae09-d8dba30cf2ca\") "
Jul 12 15:39:40.860303 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.860276    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e77688ae-2658-49be-ae09-d8dba30cf2ca" (UID: "e77688ae-2658-49be-ae09-d8dba30cf2ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:39:40.862003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.861968    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e77688ae-2658-49be-ae09-d8dba30cf2ca" (UID: "e77688ae-2658-49be-ae09-d8dba30cf2ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:39:40.862109 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.862040    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv" (OuterVolumeSpecName: "kube-api-access-sfqtv") pod "e77688ae-2658-49be-ae09-d8dba30cf2ca" (UID: "e77688ae-2658-49be-ae09-d8dba30cf2ca"). InnerVolumeSpecName "kube-api-access-sfqtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:39:40.961453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.961419    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e77688ae-2658-49be-ae09-d8dba30cf2ca-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:40.961453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.961448    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfqtv\" (UniqueName: \"kubernetes.io/projected/e77688ae-2658-49be-ae09-d8dba30cf2ca-kube-api-access-sfqtv\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:40.961453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:40.961459    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e77688ae-2658-49be-ae09-d8dba30cf2ca-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:41.420580 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.420547    2566 generic.go:356] "Generic (PLEG): container finished" podID="e77688ae-2658-49be-ae09-d8dba30cf2ca" containerID="8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13" exitCode=0
Jul 12 15:39:41.420765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.420591    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"
Jul 12 15:39:41.420765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.420626    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" event={"ID":"e77688ae-2658-49be-ae09-d8dba30cf2ca","Type":"ContainerDied","Data":"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"}
Jul 12 15:39:41.420765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.420681    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st" event={"ID":"e77688ae-2658-49be-ae09-d8dba30cf2ca","Type":"ContainerDied","Data":"86fd4b23d347b9fe2c6a82efe7137f57b4331b4841eb5b6865a529d2c92fcbf5"}
Jul 12 15:39:41.420765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.420704    2566 scope.go:117] "RemoveContainer" containerID="8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"
Jul 12 15:39:41.430064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.430042    2566 scope.go:117] "RemoveContainer" containerID="8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"
Jul 12 15:39:41.430330 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:41.430311    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13\": container with ID starting with 8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13 not found: ID does not exist" containerID="8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"
Jul 12 15:39:41.430373 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.430340    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13"} err="failed to get container status \"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13\": rpc error: code = NotFound desc = could not find container \"8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13\": container with ID starting with 8bcbf440d9fea1bbdb7c8c2c66f258d1a49ae7c20120d98f524d3bcee1bc6d13 not found: ID does not exist"
Jul 12 15:39:41.435585 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.435554    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:41.437611 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:41.437586    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-ed14bc5b-644b8bb7b4-hh8st"]
Jul 12 15:39:42.874190 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:42.874159    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e77688ae-2658-49be-ae09-d8dba30cf2ca" path="/var/lib/kubelet/pods/e77688ae-2658-49be-ae09-d8dba30cf2ca/volumes"
Jul 12 15:39:47.557154 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.557117    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:47.557650 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.557532    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77688ae-2658-49be-ae09-d8dba30cf2ca" containerName="maas-api"
Jul 12 15:39:47.557650 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.557545    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77688ae-2658-49be-ae09-d8dba30cf2ca" containerName="maas-api"
Jul 12 15:39:47.557650 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.557617    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77688ae-2658-49be-ae09-d8dba30cf2ca" containerName="maas-api"
Jul 12 15:39:47.562304 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.562268    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.564613 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.564580    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-8ae6e889-serving-cert\""
Jul 12 15:39:47.573386 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.573355    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:47.623876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.623837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.624123 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.623894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.624123 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.623986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcj9\" (UniqueName: \"kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.724799 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.724754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.725031 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.724812    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.725031 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.724861    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcj9\" (UniqueName: \"kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.725031 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:47.724928    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-8ae6e889-serving-cert: secret "maas-api-e2e-ait-8ae6e889-serving-cert" not found
Jul 12 15:39:47.725031 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:47.725007    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls podName:b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6 nodeName:}" failed. No retries permitted until 2026-07-12 15:39:48.224987962 +0000 UTC m=+1789.813290619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls") pod "maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" (UID: "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6") : secret "maas-api-e2e-ait-8ae6e889-serving-cert" not found
Jul 12 15:39:47.725580 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.725558    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:47.732700 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:47.732666    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcj9\" (UniqueName: \"kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:48.230016 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:48.229975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:48.232571 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:48.232542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") pod \"maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") " pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:48.482338 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:48.482247    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:48.625493 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:48.625466    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:48.627358 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:39:48.627331    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09da4ae_63b2_46f7_b6d6_ee5772fb8bb6.slice/crio-2d01947f11bcbef97341823ebdef0807a81bb73d30d2b5ed9b1b33b460e8d24c WatchSource:0}: Error finding container 2d01947f11bcbef97341823ebdef0807a81bb73d30d2b5ed9b1b33b460e8d24c: Status 404 returned error can't find the container with id 2d01947f11bcbef97341823ebdef0807a81bb73d30d2b5ed9b1b33b460e8d24c
Jul 12 15:39:49.471250 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:49.471200    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" event={"ID":"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6","Type":"ContainerStarted","Data":"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"}
Jul 12 15:39:49.471456 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:49.471274    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" event={"ID":"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6","Type":"ContainerStarted","Data":"2d01947f11bcbef97341823ebdef0807a81bb73d30d2b5ed9b1b33b460e8d24c"}
Jul 12 15:39:49.471573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:49.471458    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:49.486593 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:49.486526    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" podStartSLOduration=2.107805719 podStartE2EDuration="2.486506354s" totalImagesPullingTime="378.700635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:39:49.486048036 +0000 UTC m=+1791.074350711" watchObservedRunningTime="2026-07-12 15:39:49.486506354 +0000 UTC m=+1791.074809076"
Jul 12 15:39:50.609460 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:50.609373    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:39:52.798385 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:52.798346    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:52.798897 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:52.798634    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" podUID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" containerName="maas-api" containerID="cri-o://87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0" gracePeriod=30
Jul 12 15:39:53.060423 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.060355    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:53.175385 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.175349    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhcj9\" (UniqueName: \"kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9\") pod \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") "
Jul 12 15:39:53.175596 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.175465    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") pod \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") "
Jul 12 15:39:53.175596 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.175495    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca\") pod \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\" (UID: \"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6\") "
Jul 12 15:39:53.175849 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.175824    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" (UID: "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:39:53.177625 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.177599    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9" (OuterVolumeSpecName: "kube-api-access-hhcj9") pod "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" (UID: "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6"). InnerVolumeSpecName "kube-api-access-hhcj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:39:53.177748 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.177722    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" (UID: "b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:39:53.276624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.276580    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:53.276624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.276616    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:53.276624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.276628    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhcj9\" (UniqueName: \"kubernetes.io/projected/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6-kube-api-access-hhcj9\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:39:53.493546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.493515    2566 generic.go:356] "Generic (PLEG): container finished" podID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" containerID="87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0" exitCode=0
Jul 12 15:39:53.493734 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.493565    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"
Jul 12 15:39:53.493734 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.493599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" event={"ID":"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6","Type":"ContainerDied","Data":"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"}
Jul 12 15:39:53.493734 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.493669    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d" event={"ID":"b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6","Type":"ContainerDied","Data":"2d01947f11bcbef97341823ebdef0807a81bb73d30d2b5ed9b1b33b460e8d24c"}
Jul 12 15:39:53.493734 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.493697    2566 scope.go:117] "RemoveContainer" containerID="87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"
Jul 12 15:39:53.503342 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.503320    2566 scope.go:117] "RemoveContainer" containerID="87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"
Jul 12 15:39:53.503608 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:39:53.503591    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0\": container with ID starting with 87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0 not found: ID does not exist" containerID="87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"
Jul 12 15:39:53.503662 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.503617    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0"} err="failed to get container status \"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0\": rpc error: code = NotFound desc = could not find container \"87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0\": container with ID starting with 87985715934fa0281827b06662d79185d30bf72ca167769261aca9ac08dbe4a0 not found: ID does not exist"
Jul 12 15:39:53.513948 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.513890    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:53.517371 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:53.517341    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ae6e889-c5756b578-k9g6d"]
Jul 12 15:39:54.873722 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:54.873688    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" path="/var/lib/kubelet/pods/b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6/volumes"
Jul 12 15:39:58.907819 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:58.907790    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:39:58.912249 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:39:58.912224    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:40:00.810878 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:00.810840    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:40:04.607978 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.607938    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:04.608565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.608286    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" containerName="maas-api"
Jul 12 15:40:04.608565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.608297    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" containerName="maas-api"
Jul 12 15:40:04.608565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.608370    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09da4ae-63b2-46f7-b6d6-ee5772fb8bb6" containerName="maas-api"
Jul 12 15:40:04.611135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.611109    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.613762 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.613708    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4747cd9d-openshift-default-dockercfg-b29tt\""
Jul 12 15:40:04.621660 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.621627    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:04.788448 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788567    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788639    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc847\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.788830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.788736    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.889858 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.889858 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889808    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.889858 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.889858 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889871    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.889984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890010    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc847\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890075    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890238 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890321    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890533 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890614 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890752 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.890791 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.890736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.892669 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.892648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.892804 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.892785    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.898855 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.898826    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc847\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.899012 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.898988    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token\") pod \"e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") " pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:04.924681 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:04.924638    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:05.068899 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.068869    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:05.070981 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:40:05.070941    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b5a284_42e8_4f46_8108_ccda9b6ca526.slice/crio-ebc89e7e307cdc2784c00bdbdf3e5d06c9de757de608de0f08296d643bf59803 WatchSource:0}: Error finding container ebc89e7e307cdc2784c00bdbdf3e5d06c9de757de608de0f08296d643bf59803: Status 404 returned error can't find the container with id ebc89e7e307cdc2784c00bdbdf3e5d06c9de757de608de0f08296d643bf59803
Jul 12 15:40:05.073311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.073271    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:40:05.073392 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.073359    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:40:05.073435 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.073404    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:40:05.559379 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.559335    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" event={"ID":"48b5a284-42e8-4f46-8108-ccda9b6ca526","Type":"ContainerStarted","Data":"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"}
Jul 12 15:40:05.559605 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.559398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" event={"ID":"48b5a284-42e8-4f46-8108-ccda9b6ca526","Type":"ContainerStarted","Data":"ebc89e7e307cdc2784c00bdbdf3e5d06c9de757de608de0f08296d643bf59803"}
Jul 12 15:40:05.578445 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.578393    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" podStartSLOduration=1.578373576 podStartE2EDuration="1.578373576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:40:05.576187484 +0000 UTC m=+1807.164490158" watchObservedRunningTime="2026-07-12 15:40:05.578373576 +0000 UTC m=+1807.166676248"
Jul 12 15:40:05.911400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.911364    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:05.915033 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.915011    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:05.917383 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.917364    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-4747cd9d-serving-cert\""
Jul 12 15:40:05.923729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.923698    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:05.924759 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:05.924737    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:06.001521 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.001484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqg6k\" (UniqueName: \"kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.001741 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.001547    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.001741 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.001638    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.103059 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.103026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqg6k\" (UniqueName: \"kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.103265 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.103079    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.103265 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.103165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.103821 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.103794    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.105635 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.105613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.110868 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.110839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqg6k\" (UniqueName: \"kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k\") pod \"maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") " pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.228135 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.228036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:06.386047 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.386009    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:06.387616 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:40:06.387586    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424fc94f_8d9b_4a11_8e1b_0c43a0e0441c.slice/crio-a0db5bbb120bf6fdba950883f489a5cf905108b6499390e7908d391eb66ad9cc WatchSource:0}: Error finding container a0db5bbb120bf6fdba950883f489a5cf905108b6499390e7908d391eb66ad9cc: Status 404 returned error can't find the container with id a0db5bbb120bf6fdba950883f489a5cf905108b6499390e7908d391eb66ad9cc
Jul 12 15:40:06.567607 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.567504    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" event={"ID":"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c","Type":"ContainerStarted","Data":"a0db5bbb120bf6fdba950883f489a5cf905108b6499390e7908d391eb66ad9cc"}
Jul 12 15:40:06.930227 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:06.930194    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:07.575335 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:07.575301    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" event={"ID":"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c","Type":"ContainerStarted","Data":"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"}
Jul 12 15:40:07.575552 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:07.575535    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:07.575628 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:07.575580    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:07.576581 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:07.576558    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:07.593579 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:07.593519    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" podStartSLOduration=2.190740934 podStartE2EDuration="2.593499154s" totalImagesPullingTime="402.75822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:40:07.591687352 +0000 UTC m=+1809.179990023" watchObservedRunningTime="2026-07-12 15:40:07.593499154 +0000 UTC m=+1809.181801824"
Jul 12 15:40:08.111481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:08.111443    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:40:10.418176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.418139    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:10.566326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.565551    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:10.566326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.565902    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" podUID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" containerName="maas-api" containerID="cri-o://1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f" gracePeriod=30
Jul 12 15:40:10.604621 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.604570    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" podUID="48b5a284-42e8-4f46-8108-ccda9b6ca526" containerName="istio-proxy" containerID="cri-o://8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23" gracePeriod=30
Jul 12 15:40:10.847505 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.847476    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:10.951668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.951564    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls\") pod \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") "
Jul 12 15:40:10.951668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.951631    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca\") pod \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") "
Jul 12 15:40:10.951901 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.951713    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqg6k\" (UniqueName: \"kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k\") pod \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\" (UID: \"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c\") "
Jul 12 15:40:10.952317 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.952291    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" (UID: "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:40:10.954201 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.954078    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" (UID: "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:40:10.954201 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:10.954151    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k" (OuterVolumeSpecName: "kube-api-access-kqg6k") pod "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" (UID: "424fc94f-8d9b-4a11-8e1b-0c43a0e0441c"). InnerVolumeSpecName "kube-api-access-kqg6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:40:11.052933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.052872    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:11.052933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.052933    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:11.053153 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.052947    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqg6k\" (UniqueName: \"kubernetes.io/projected/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c-kube-api-access-kqg6k\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:11.611159 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.611125    2566 generic.go:356] "Generic (PLEG): container finished" podID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" containerID="1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f" exitCode=0
Jul 12 15:40:11.611571 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.611190    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" event={"ID":"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c","Type":"ContainerDied","Data":"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"}
Jul 12 15:40:11.611571 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.611275    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf" event={"ID":"424fc94f-8d9b-4a11-8e1b-0c43a0e0441c","Type":"ContainerDied","Data":"a0db5bbb120bf6fdba950883f489a5cf905108b6499390e7908d391eb66ad9cc"}
Jul 12 15:40:11.611571 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.611285    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"
Jul 12 15:40:11.611571 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.611307    2566 scope.go:117] "RemoveContainer" containerID="1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"
Jul 12 15:40:11.620291 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.620269    2566 scope.go:117] "RemoveContainer" containerID="1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"
Jul 12 15:40:11.620618 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:40:11.620597    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f\": container with ID starting with 1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f not found: ID does not exist" containerID="1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"
Jul 12 15:40:11.620695 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.620630    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f"} err="failed to get container status \"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f\": rpc error: code = NotFound desc = could not find container \"1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f\": container with ID starting with 1e190ddca2af349eb33449bf9c3c3776304a88bf0c2ffada3def594653c6bd5f not found: ID does not exist"
Jul 12 15:40:11.631774 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.631739    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:11.635630 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:11.635602    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-4747cd9d-7b79d9d4cc-bqssf"]
Jul 12 15:40:12.875231 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:12.875184    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" path="/var/lib/kubelet/pods/424fc94f-8d9b-4a11-8e1b-0c43a0e0441c/volumes"
Jul 12 15:40:15.969204 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:15.969143    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:16.021300 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021271    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021314    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021333    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc847\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021380    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021413    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021463 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021450    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021471    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021492    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021545    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy\") pod \"48b5a284-42e8-4f46-8108-ccda9b6ca526\" (UID: \"48b5a284-42e8-4f46-8108-ccda9b6ca526\") "
Jul 12 15:40:16.021880 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021728    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:40:16.021880 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021766    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:40:16.021880 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021797    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:40:16.021880 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021872    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.022096 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.021894    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.022096 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.022082    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:40:16.022233 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.022206    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data" (OuterVolumeSpecName: "istio-data") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:40:16.023668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.023609    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token" (OuterVolumeSpecName: "istio-token") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:40:16.023798 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.023694    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847" (OuterVolumeSpecName: "kube-api-access-qc847") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "kube-api-access-qc847". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:40:16.023798 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.023706    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:40:16.023798 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.023742    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48b5a284-42e8-4f46-8108-ccda9b6ca526" (UID: "48b5a284-42e8-4f46-8108-ccda9b6ca526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:40:16.122465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122433    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48b5a284-42e8-4f46-8108-ccda9b6ca526-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122460    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122472    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122493    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122501    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122508    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48b5a284-42e8-4f46-8108-ccda9b6ca526-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.122666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.122516    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc847\" (UniqueName: \"kubernetes.io/projected/48b5a284-42e8-4f46-8108-ccda9b6ca526-kube-api-access-qc847\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:40:16.640957 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.640899    2566 generic.go:356] "Generic (PLEG): container finished" podID="48b5a284-42e8-4f46-8108-ccda9b6ca526" containerID="8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23" exitCode=0
Jul 12 15:40:16.640957 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.640948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" event={"ID":"48b5a284-42e8-4f46-8108-ccda9b6ca526","Type":"ContainerDied","Data":"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"}
Jul 12 15:40:16.641166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.640974    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"
Jul 12 15:40:16.641166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.641002    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t" event={"ID":"48b5a284-42e8-4f46-8108-ccda9b6ca526","Type":"ContainerDied","Data":"ebc89e7e307cdc2784c00bdbdf3e5d06c9de757de608de0f08296d643bf59803"}
Jul 12 15:40:16.641166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.641027    2566 scope.go:117] "RemoveContainer" containerID="8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"
Jul 12 15:40:16.650261 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.650093    2566 scope.go:117] "RemoveContainer" containerID="8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"
Jul 12 15:40:16.650428 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:40:16.650381    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23\": container with ID starting with 8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23 not found: ID does not exist" containerID="8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"
Jul 12 15:40:16.650492 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.650415    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23"} err="failed to get container status \"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23\": rpc error: code = NotFound desc = could not find container \"8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23\": container with ID starting with 8624b8624f80b1c002a6fae804de943bd5189ac7df36ed8aaa2b149dcedeaf23 not found: ID does not exist"
Jul 12 15:40:16.664049 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.664011    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:16.669119 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.669092    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4747cd9d-openshift-default-5dcf8799dc-wbk7t"]
Jul 12 15:40:16.873303 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:16.873272    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b5a284-42e8-4f46-8108-ccda9b6ca526" path="/var/lib/kubelet/pods/48b5a284-42e8-4f46-8108-ccda9b6ca526/volumes"
Jul 12 15:40:20.915889 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:40:20.915850    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:41:36.811356 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:36.811272    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:41:45.302962 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:45.302922    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:41:49.567973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.567929    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:41:49.568499 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568482    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b5a284-42e8-4f46-8108-ccda9b6ca526" containerName="istio-proxy"
Jul 12 15:41:49.568544 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568502    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b5a284-42e8-4f46-8108-ccda9b6ca526" containerName="istio-proxy"
Jul 12 15:41:49.568544 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568516    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" containerName="maas-api"
Jul 12 15:41:49.568544 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568525    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" containerName="maas-api"
Jul 12 15:41:49.568635 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568608    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b5a284-42e8-4f46-8108-ccda9b6ca526" containerName="istio-proxy"
Jul 12 15:41:49.568635 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.568620    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="424fc94f-8d9b-4a11-8e1b-0c43a0e0441c" containerName="maas-api"
Jul 12 15:41:49.572148 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.572126    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.575371 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.575348    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6979e616-openshift-default-dockercfg-dzrs7\""
Jul 12 15:41:49.593535 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.593503    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:41:49.662134 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662134 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662147    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662296    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.662400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.662378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5vh\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763342    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763380 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5vh\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763651 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763552    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763651 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763607    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763651 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763648    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763819 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763819 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763797    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763968 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.763968 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.763846    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.764479 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.764450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.764612 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.764585    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.764754 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.764735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.764979 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.764960    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.765195 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.765179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.766330 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.766305    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.766611 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.766591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.771690 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.771660    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.771814 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.771791    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5vh\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh\") pod \"e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") " pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:49.883127 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:49.883091    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:50.031185 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.031158    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:41:50.033197 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:41:50.033158    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0563b5e_1a29_44e2_9c0e_3e7328c9215e.slice/crio-18de6afd81f17e77527c8c6d8f0590233e27844c0ff4c6efea63aa7b8a50eaff WatchSource:0}: Error finding container 18de6afd81f17e77527c8c6d8f0590233e27844c0ff4c6efea63aa7b8a50eaff: Status 404 returned error can't find the container with id 18de6afd81f17e77527c8c6d8f0590233e27844c0ff4c6efea63aa7b8a50eaff
Jul 12 15:41:50.035410 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.035373    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:41:50.035490 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.035470    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:41:50.035537 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.035520    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:41:50.142975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.142852    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerStarted","Data":"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"}
Jul 12 15:41:50.142975 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.142932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerStarted","Data":"18de6afd81f17e77527c8c6d8f0590233e27844c0ff4c6efea63aa7b8a50eaff"}
Jul 12 15:41:50.165427 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.161277    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podStartSLOduration=1.161254217 podStartE2EDuration="1.161254217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:41:50.159290554 +0000 UTC m=+1911.747593239" watchObservedRunningTime="2026-07-12 15:41:50.161254217 +0000 UTC m=+1911.749556891"
Jul 12 15:41:50.883764 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:50.883730    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:51.888142 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:51.888111    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:52.152997 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.152888    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:52.154005 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.153983    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:41:52.381549 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.381515    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:41:52.388507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.388472    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.399596 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.391298    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-6979e616-serving-cert\""
Jul 12 15:41:52.403167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.403099    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:41:52.490898 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.490843    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.491116 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.490897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.491116 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.491037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l7sf\" (UniqueName: \"kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.592010 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.591970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.592204 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.592018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.592204 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.592063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l7sf\" (UniqueName: \"kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.592706 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.592677    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.594555 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.594530    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.600004 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.599982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l7sf\" (UniqueName: \"kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf\") pod \"maas-api-e2e-mt-6979e616-76668df5c8-5cvhb\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") " pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.707025 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.706927    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:52.849322 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:52.849294    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:41:52.851204 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:41:52.851173    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e784c7_04a9_4210_a081_6cedc5676475.slice/crio-0ff63ecfdc1d9d0e66fc3cab9a17162a92b304117757eb3048dce9d93eb536fe WatchSource:0}: Error finding container 0ff63ecfdc1d9d0e66fc3cab9a17162a92b304117757eb3048dce9d93eb536fe: Status 404 returned error can't find the container with id 0ff63ecfdc1d9d0e66fc3cab9a17162a92b304117757eb3048dce9d93eb536fe
Jul 12 15:41:53.162475 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:53.162433    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" event={"ID":"b9e784c7-04a9-4210-a081-6cedc5676475","Type":"ContainerStarted","Data":"0ff63ecfdc1d9d0e66fc3cab9a17162a92b304117757eb3048dce9d93eb536fe"}
Jul 12 15:41:54.170982 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:54.170941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" event={"ID":"b9e784c7-04a9-4210-a081-6cedc5676475","Type":"ContainerStarted","Data":"c93c7485e2a41316ee19cdfbfa61cbd4ed5f39c25256120e4d0911dc254652b2"}
Jul 12 15:41:54.171390 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:54.171175    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:41:54.187211 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:54.187157    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" podStartSLOduration=1.7389615 podStartE2EDuration="2.187138236s" totalImagesPullingTime="448.176736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:41:54.186261762 +0000 UTC m=+1915.774564444" watchObservedRunningTime="2026-07-12 15:41:54.187138236 +0000 UTC m=+1915.775440907"
Jul 12 15:41:55.412353 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:41:55.412316    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:42:00.185866 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:00.185820    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:42:04.032056 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.032021    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:42:04.032570 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.032249    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" podUID="b9e784c7-04a9-4210-a081-6cedc5676475" containerName="maas-api" containerID="cri-o://c93c7485e2a41316ee19cdfbfa61cbd4ed5f39c25256120e4d0911dc254652b2" gracePeriod=30
Jul 12 15:42:04.233443 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.233407    2566 generic.go:356] "Generic (PLEG): container finished" podID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerID="2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580" exitCode=0
Jul 12 15:42:04.233813 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.233788    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerDied","Data":"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"}
Jul 12 15:42:04.234459 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.234439    2566 scope.go:117] "RemoveContainer" containerID="2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"
Jul 12 15:42:04.237958 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.237925    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:42:04.243284 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.243259    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:42:04.243494 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.243476    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:42:04.248504 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.243010    2566 generic.go:356] "Generic (PLEG): container finished" podID="b9e784c7-04a9-4210-a081-6cedc5676475" containerID="c93c7485e2a41316ee19cdfbfa61cbd4ed5f39c25256120e4d0911dc254652b2" exitCode=0
Jul 12 15:42:04.248504 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.243036    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" event={"ID":"b9e784c7-04a9-4210-a081-6cedc5676475","Type":"ContainerDied","Data":"c93c7485e2a41316ee19cdfbfa61cbd4ed5f39c25256120e4d0911dc254652b2"}
Jul 12 15:42:04.319121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.319098    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:42:04.400668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.400635    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca\") pod \"b9e784c7-04a9-4210-a081-6cedc5676475\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") "
Jul 12 15:42:04.400668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.400677    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l7sf\" (UniqueName: \"kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf\") pod \"b9e784c7-04a9-4210-a081-6cedc5676475\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") "
Jul 12 15:42:04.400885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.400743    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls\") pod \"b9e784c7-04a9-4210-a081-6cedc5676475\" (UID: \"b9e784c7-04a9-4210-a081-6cedc5676475\") "
Jul 12 15:42:04.401084 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.401057    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9e784c7-04a9-4210-a081-6cedc5676475" (UID: "b9e784c7-04a9-4210-a081-6cedc5676475"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:42:04.403004 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.402974    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf" (OuterVolumeSpecName: "kube-api-access-5l7sf") pod "b9e784c7-04a9-4210-a081-6cedc5676475" (UID: "b9e784c7-04a9-4210-a081-6cedc5676475"). InnerVolumeSpecName "kube-api-access-5l7sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:42:04.403400 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.403379    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9e784c7-04a9-4210-a081-6cedc5676475" (UID: "b9e784c7-04a9-4210-a081-6cedc5676475"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:42:04.502215 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.502167    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e784c7-04a9-4210-a081-6cedc5676475-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:04.502215 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.502204    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e784c7-04a9-4210-a081-6cedc5676475-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:04.502215 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:04.502218    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l7sf\" (UniqueName: \"kubernetes.io/projected/b9e784c7-04a9-4210-a081-6cedc5676475-kube-api-access-5l7sf\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:05.253935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.253815    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerStarted","Data":"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"}
Jul 12 15:42:05.255187 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.255165    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb" event={"ID":"b9e784c7-04a9-4210-a081-6cedc5676475","Type":"ContainerDied","Data":"0ff63ecfdc1d9d0e66fc3cab9a17162a92b304117757eb3048dce9d93eb536fe"}
Jul 12 15:42:05.255304 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.255188    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"
Jul 12 15:42:05.255304 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.255214    2566 scope.go:117] "RemoveContainer" containerID="c93c7485e2a41316ee19cdfbfa61cbd4ed5f39c25256120e4d0911dc254652b2"
Jul 12 15:42:05.287547 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.287503    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:42:05.292354 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.292283    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-6979e616-76668df5c8-5cvhb"]
Jul 12 15:42:05.883829 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.883788    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:05.885147 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.885110    2566 patch_prober.go:28] interesting pod/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 12 15:42:05.885310 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:05.885177    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 12 15:42:06.877786 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:06.877737    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e784c7-04a9-4210-a081-6cedc5676475" path="/var/lib/kubelet/pods/b9e784c7-04a9-4210-a081-6cedc5676475/volumes"
Jul 12 15:42:06.884012 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:06.883977    2566 patch_prober.go:28] interesting pod/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 12 15:42:06.884353 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:06.884311    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 12 15:42:07.153011 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:07.152903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:07.884240 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:07.884185    2566 patch_prober.go:28] interesting pod/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 12 15:42:07.884751 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:07.884259    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 12 15:42:08.884439 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:08.884389    2566 patch_prober.go:28] interesting pod/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 12 15:42:08.884966 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:08.884460    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 12 15:42:08.910367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:08.910328    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:42:09.888475 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:09.888437    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:09.889530 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:09.889509    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:10.348812 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:10.348728    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:42:11.317383 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:11.317335    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy" containerID="cri-o://0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13" gracePeriod=30
Jul 12 15:42:16.583191 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.583117    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:16.716795 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.716795 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716798    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716833    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716873    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716898    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.716965    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717013    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5vh\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717053 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717053    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717087    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token\") pod \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\" (UID: \"e0563b5e-1a29-44e2-9c0e-3e7328c9215e\") "
Jul 12 15:42:16.717369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717189    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:42:16.717369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717234    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:42:16.717538 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717421    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.717538 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717440    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.717647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717558    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:42:16.717647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717597    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:42:16.717766 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.717742    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:42:16.719201 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.719176    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh" (OuterVolumeSpecName: "kube-api-access-7m5vh") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "kube-api-access-7m5vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:42:16.719201 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.719187    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:42:16.719594 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.719575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:42:16.719661 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.719572    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0563b5e-1a29-44e2-9c0e-3e7328c9215e" (UID: "e0563b5e-1a29-44e2-9c0e-3e7328c9215e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:42:16.818863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818825    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.818863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818856    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.818863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818865    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.818863 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818874    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.819175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818883    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5vh\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-kube-api-access-7m5vh\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.819175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818892    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:16.819175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:16.818901    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0563b5e-1a29-44e2-9c0e-3e7328c9215e-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:42:17.351389 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.351299    2566 generic.go:356] "Generic (PLEG): container finished" podID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerID="0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13" exitCode=0
Jul 12 15:42:17.351389 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.351348    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"
Jul 12 15:42:17.351389 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.351379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerDied","Data":"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"}
Jul 12 15:42:17.351647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.351441    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7" event={"ID":"e0563b5e-1a29-44e2-9c0e-3e7328c9215e","Type":"ContainerDied","Data":"18de6afd81f17e77527c8c6d8f0590233e27844c0ff4c6efea63aa7b8a50eaff"}
Jul 12 15:42:17.351647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.351467    2566 scope.go:117] "RemoveContainer" containerID="0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"
Jul 12 15:42:17.360445 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.360424    2566 scope.go:117] "RemoveContainer" containerID="2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"
Jul 12 15:42:17.369457 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.369432    2566 scope.go:117] "RemoveContainer" containerID="0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"
Jul 12 15:42:17.369730 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:42:17.369710    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13\": container with ID starting with 0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13 not found: ID does not exist" containerID="0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"
Jul 12 15:42:17.369803 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.369738    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13"} err="failed to get container status \"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13\": rpc error: code = NotFound desc = could not find container \"0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13\": container with ID starting with 0417321a587befe2003fbbcbeca9a6feb202e025c9716b72f4509724b7699a13 not found: ID does not exist"
Jul 12 15:42:17.369803 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.369757    2566 scope.go:117] "RemoveContainer" containerID="2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"
Jul 12 15:42:17.370068 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:42:17.370048    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580\": container with ID starting with 2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580 not found: ID does not exist" containerID="2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"
Jul 12 15:42:17.370141 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.370077    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580"} err="failed to get container status \"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580\": rpc error: code = NotFound desc = could not find container \"2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580\": container with ID starting with 2c5ada6a1380016d1bf56c0bdfd3abe6d5f64559ffa9613a83022a1581f8e580 not found: ID does not exist"
Jul 12 15:42:17.370981 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.370956    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:42:17.373942 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:17.373899    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6979e616-openshift-default-6bf896cc59-9qvb7"]
Jul 12 15:42:18.879474 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:18.879437    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" path="/var/lib/kubelet/pods/e0563b5e-1a29-44e2-9c0e-3e7328c9215e/volumes"
Jul 12 15:42:32.205200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205158    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:42:32.205746 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205727    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e784c7-04a9-4210-a081-6cedc5676475" containerName="maas-api"
Jul 12 15:42:32.205806 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205751    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e784c7-04a9-4210-a081-6cedc5676475" containerName="maas-api"
Jul 12 15:42:32.205806 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205767    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:42:32.205806 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205777    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:42:32.205952 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205893    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e784c7-04a9-4210-a081-6cedc5676475" containerName="maas-api"
Jul 12 15:42:32.205952 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.205929    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:42:32.209487 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.209463    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.211673 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.211645    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ffed116f-serving-cert\""
Jul 12 15:42:32.218691 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.218659    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:42:32.263442 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.263380    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.263442 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.263445    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5t2\" (UniqueName: \"kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.263721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.263528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.364218 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.364175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.364426 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.364250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.364426 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.364278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5t2\" (UniqueName: \"kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.364426 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:42:32.364404    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-ffed116f-serving-cert: secret "maas-api-e2e-mt-ffed116f-serving-cert" not found
Jul 12 15:42:32.364559 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:42:32.364479    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls podName:5d3ba80a-13df-42c8-8877-06f461775e98 nodeName:}" failed. No retries permitted until 2026-07-12 15:42:32.864458731 +0000 UTC m=+1954.452761391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls") pod "maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" (UID: "5d3ba80a-13df-42c8-8877-06f461775e98") : secret "maas-api-e2e-mt-ffed116f-serving-cert" not found
Jul 12 15:42:32.365049 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.365024    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.374828 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.374799    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5t2\" (UniqueName: \"kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.867710 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.867672    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:32.870670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:32.870635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") pod \"maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") " pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:33.123277 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:33.123173    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:33.265404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:33.265360    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:42:33.270065 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:42:33.270024    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3ba80a_13df_42c8_8877_06f461775e98.slice/crio-cef6bdfe9d9eb25500de58f43e8791c2761069a5c3ec5ee1762bf66cf45a1cd7 WatchSource:0}: Error finding container cef6bdfe9d9eb25500de58f43e8791c2761069a5c3ec5ee1762bf66cf45a1cd7: Status 404 returned error can't find the container with id cef6bdfe9d9eb25500de58f43e8791c2761069a5c3ec5ee1762bf66cf45a1cd7
Jul 12 15:42:33.438888 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:33.438804    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" event={"ID":"5d3ba80a-13df-42c8-8877-06f461775e98","Type":"ContainerStarted","Data":"cef6bdfe9d9eb25500de58f43e8791c2761069a5c3ec5ee1762bf66cf45a1cd7"}
Jul 12 15:42:34.446069 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:34.446030    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" event={"ID":"5d3ba80a-13df-42c8-8877-06f461775e98","Type":"ContainerStarted","Data":"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"}
Jul 12 15:42:34.446540 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:34.446221    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:34.461865 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:34.461807    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" podStartSLOduration=2.078307373 podStartE2EDuration="2.4617901s" totalImagesPullingTime="383.482727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:42:34.461134783 +0000 UTC m=+1956.049437452" watchObservedRunningTime="2026-07-12 15:42:34.4617901 +0000 UTC m=+1956.050092818"
Jul 12 15:42:34.812839 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:34.812744    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:42:40.457494 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:40.457462    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:42:53.416565 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:42:53.416455    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:43:11.609739 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:11.609703    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:43:14.666507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:14.666471    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:43:14.667219 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:14.667158    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" podUID="5d3ba80a-13df-42c8-8877-06f461775e98" containerName="maas-api" containerID="cri-o://c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6" gracePeriod=30
Jul 12 15:43:14.924063 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:14.923992    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:43:15.049246 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.049204    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") pod \"5d3ba80a-13df-42c8-8877-06f461775e98\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") "
Jul 12 15:43:15.049453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.049261    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk5t2\" (UniqueName: \"kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2\") pod \"5d3ba80a-13df-42c8-8877-06f461775e98\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") "
Jul 12 15:43:15.049453 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.049289    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca\") pod \"5d3ba80a-13df-42c8-8877-06f461775e98\" (UID: \"5d3ba80a-13df-42c8-8877-06f461775e98\") "
Jul 12 15:43:15.049706 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.049670    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d3ba80a-13df-42c8-8877-06f461775e98" (UID: "5d3ba80a-13df-42c8-8877-06f461775e98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:43:15.051454 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.051423    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2" (OuterVolumeSpecName: "kube-api-access-pk5t2") pod "5d3ba80a-13df-42c8-8877-06f461775e98" (UID: "5d3ba80a-13df-42c8-8877-06f461775e98"). InnerVolumeSpecName "kube-api-access-pk5t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:43:15.051561 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.051474    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d3ba80a-13df-42c8-8877-06f461775e98" (UID: "5d3ba80a-13df-42c8-8877-06f461775e98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:43:15.150437 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.150397    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3ba80a-13df-42c8-8877-06f461775e98-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:43:15.150437 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.150431    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk5t2\" (UniqueName: \"kubernetes.io/projected/5d3ba80a-13df-42c8-8877-06f461775e98-kube-api-access-pk5t2\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:43:15.150437 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.150442    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3ba80a-13df-42c8-8877-06f461775e98-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:43:15.678843 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.678806    2566 generic.go:356] "Generic (PLEG): container finished" podID="5d3ba80a-13df-42c8-8877-06f461775e98" containerID="c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6" exitCode=0
Jul 12 15:43:15.679326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.678854    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"
Jul 12 15:43:15.679326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.678858    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" event={"ID":"5d3ba80a-13df-42c8-8877-06f461775e98","Type":"ContainerDied","Data":"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"}
Jul 12 15:43:15.679326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.678974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl" event={"ID":"5d3ba80a-13df-42c8-8877-06f461775e98","Type":"ContainerDied","Data":"cef6bdfe9d9eb25500de58f43e8791c2761069a5c3ec5ee1762bf66cf45a1cd7"}
Jul 12 15:43:15.679326 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.679009    2566 scope.go:117] "RemoveContainer" containerID="c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"
Jul 12 15:43:15.688446 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.688420    2566 scope.go:117] "RemoveContainer" containerID="c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"
Jul 12 15:43:15.688745 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:43:15.688711    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6\": container with ID starting with c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6 not found: ID does not exist" containerID="c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"
Jul 12 15:43:15.688833 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.688743    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6"} err="failed to get container status \"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6\": rpc error: code = NotFound desc = could not find container \"c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6\": container with ID starting with c400f05b42e8d8cb9b92dc2fcd0ac1f8c237c9abaede1e0e95310f642a9b77b6 not found: ID does not exist"
Jul 12 15:43:15.700245 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.700215    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:43:15.702237 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:15.702211    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ffed116f-9f66457cb-bdlcl"]
Jul 12 15:43:16.874979 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:16.874934    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3ba80a-13df-42c8-8877-06f461775e98" path="/var/lib/kubelet/pods/5d3ba80a-13df-42c8-8877-06f461775e98/volumes"
Jul 12 15:43:25.306187 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:43:25.306144    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:44:04.608168 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:44:04.608125    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:44:58.940578 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:44:58.940500    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:44:58.945554 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:44:58.945532    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:45:04.981245 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981207    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:45:04.981717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981613    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:45:04.981717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981627    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:45:04.981717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981640    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3ba80a-13df-42c8-8877-06f461775e98" containerName="maas-api"
Jul 12 15:45:04.981717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981648    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3ba80a-13df-42c8-8877-06f461775e98" containerName="maas-api"
Jul 12 15:45:04.981717 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981714    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3ba80a-13df-42c8-8877-06f461775e98" containerName="maas-api"
Jul 12 15:45:04.982009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.981725    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0563b5e-1a29-44e2-9c0e-3e7328c9215e" containerName="istio-proxy"
Jul 12 15:45:04.984902 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.984874    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:04.988085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.988052    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-eba8e3-serving-cert\""
Jul 12 15:45:04.995165 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:04.995080    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:45:05.025756 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.025713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.025957 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.025782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.025957 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.025809    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52sj\" (UniqueName: \"kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.126798 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.126754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.126998 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.126851    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.126998 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.126881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52sj\" (UniqueName: \"kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.126998 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:45:05.126948    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-eba8e3-serving-cert: secret "maas-api-e2e-inf-a-eba8e3-serving-cert" not found
Jul 12 15:45:05.127230 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:45:05.127031    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls podName:d688e9de-7d21-4a33-bf03-50497c711b6a nodeName:}" failed. No retries permitted until 2026-07-12 15:45:05.627007615 +0000 UTC m=+2107.215310267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls") pod "maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" (UID: "d688e9de-7d21-4a33-bf03-50497c711b6a") : secret "maas-api-e2e-inf-a-eba8e3-serving-cert" not found
Jul 12 15:45:05.127869 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.127837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.145608 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.145577    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52sj\" (UniqueName: \"kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.631987 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.631946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.634480 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.634452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") pod \"maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") " pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:05.898058 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:05.897957    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:06.037507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:06.037482    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:45:06.039036 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:45:06.039007    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd688e9de_7d21_4a33_bf03_50497c711b6a.slice/crio-a2f70850d5c1f4985e0f233b3d36a79c725a0f747fc6b23022664975be3474ea WatchSource:0}: Error finding container a2f70850d5c1f4985e0f233b3d36a79c725a0f747fc6b23022664975be3474ea: Status 404 returned error can't find the container with id a2f70850d5c1f4985e0f233b3d36a79c725a0f747fc6b23022664975be3474ea
Jul 12 15:45:06.040370 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:06.040350    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:45:06.247035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:06.246945    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" event={"ID":"d688e9de-7d21-4a33-bf03-50497c711b6a","Type":"ContainerStarted","Data":"a2f70850d5c1f4985e0f233b3d36a79c725a0f747fc6b23022664975be3474ea"}
Jul 12 15:45:07.254099 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:07.254065    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" event={"ID":"d688e9de-7d21-4a33-bf03-50497c711b6a","Type":"ContainerStarted","Data":"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"}
Jul 12 15:45:07.254512 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:07.254167    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:07.269268 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:07.269212    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" podStartSLOduration=2.482745677 podStartE2EDuration="3.269194518s" totalImagesPullingTime="786.448841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:45:07.268087727 +0000 UTC m=+2108.856390398" watchObservedRunningTime="2026-07-12 15:45:07.269194518 +0000 UTC m=+2108.857497205"
Jul 12 15:45:09.908775 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.908733    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:45:09.912745 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.912718    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.915122 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.915096    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6cab7d-openshift-default-dockercfg-8fg47\""
Jul 12 15:45:09.924073 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.924045    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:45:09.975668 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975631    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.975885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.975885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.975885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.975885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.975885 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975835    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.976198 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.975972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.976198 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.976029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:09.976198 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:09.976121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2pn\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077260 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077260 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077329    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077397    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077536 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2pn\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.077846 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077688    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.078027 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.077999    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.078128 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.078089    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.078232 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.078200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.078374 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.078352    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.079958 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.079935    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.080221 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.080203    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.084794 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.084772    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.085006 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.084985    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2pn\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn\") pod \"e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") " pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.226902 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.226806    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:10.372890 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.372861    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:45:10.374270 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:45:10.374243    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aea2e56_02fb_4ebf_8e99_f6f461e8125e.slice/crio-969f7de5a1413bba1246207f1bb1f573cb15f1d881aac4e4466082f25d3c97f6 WatchSource:0}: Error finding container 969f7de5a1413bba1246207f1bb1f573cb15f1d881aac4e4466082f25d3c97f6: Status 404 returned error can't find the container with id 969f7de5a1413bba1246207f1bb1f573cb15f1d881aac4e4466082f25d3c97f6
Jul 12 15:45:10.376552 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.376512    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:10.376622 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.376606    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:10.376666 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:10.376650    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:11.280515 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:11.280481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerStarted","Data":"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"}
Jul 12 15:45:11.280934 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:11.280532    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerStarted","Data":"969f7de5a1413bba1246207f1bb1f573cb15f1d881aac4e4466082f25d3c97f6"}
Jul 12 15:45:11.300776 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:11.300721    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podStartSLOduration=2.300703397 podStartE2EDuration="2.300703397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:45:11.29718957 +0000 UTC m=+2112.885492239" watchObservedRunningTime="2026-07-12 15:45:11.300703397 +0000 UTC m=+2112.889006067"
Jul 12 15:45:12.227870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:12.227833    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:12.233104 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:12.233076    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:12.285584 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:12.285545    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:12.286529 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:12.286509    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:12.511038 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:12.510938    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:45:13.269467 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.269436    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:45:13.331028 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.330989    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:45:13.335829 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.335424    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.337729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.337700    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-6cab7d-serving-cert\""
Jul 12 15:45:13.346311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.346057    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:45:13.412345 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.412297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.412552 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.412349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.412552 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.412414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btf48\" (UniqueName: \"kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.513267 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.513221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.513267 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.513272    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.513541 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.513392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btf48\" (UniqueName: \"kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.514003 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.513984    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.515748 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.515723    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.528753 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.528679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btf48\" (UniqueName: \"kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48\") pod \"maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") " pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.651172 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.651132    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:13.801969 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:13.801934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:45:13.803706 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:45:13.803680    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2363925e_f423_45cb_95f2_2b0622fa9d6c.slice/crio-99e5153b31f0de4e53c80762ba11489dcd58459a3af5b6e34387c6c0905777a1 WatchSource:0}: Error finding container 99e5153b31f0de4e53c80762ba11489dcd58459a3af5b6e34387c6c0905777a1: Status 404 returned error can't find the container with id 99e5153b31f0de4e53c80762ba11489dcd58459a3af5b6e34387c6c0905777a1
Jul 12 15:45:14.298296 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:14.298228    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" event={"ID":"2363925e-f423-45cb-95f2-2b0622fa9d6c","Type":"ContainerStarted","Data":"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"}
Jul 12 15:45:14.298296 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:14.298296    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" event={"ID":"2363925e-f423-45cb-95f2-2b0622fa9d6c","Type":"ContainerStarted","Data":"99e5153b31f0de4e53c80762ba11489dcd58459a3af5b6e34387c6c0905777a1"}
Jul 12 15:45:14.298558 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:14.298329    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:14.317129 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:14.317071    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" podStartSLOduration=1.044173602 podStartE2EDuration="1.317052918s" totalImagesPullingTime="272.879316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:45:14.314370558 +0000 UTC m=+2115.902673228" watchObservedRunningTime="2026-07-12 15:45:14.317052918 +0000 UTC m=+2115.905355627"
Jul 12 15:45:20.309042 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:20.309011    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:45:23.815977 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:23.815938    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:45:27.287350 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.287230    2566 patch_prober.go:28] interesting pod/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 12 15:45:27.287783 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.287336    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 12 15:45:27.372049 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.372015    2566 generic.go:356] "Generic (PLEG): container finished" podID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerID="449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3" exitCode=0
Jul 12 15:45:27.372253 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.372069    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerDied","Data":"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"}
Jul 12 15:45:27.372485 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.372469    2566 scope.go:117] "RemoveContainer" containerID="449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"
Jul 12 15:45:27.373559 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.373530    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:27.373639 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.373611    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:27.373676 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:27.373645    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:45:28.380231 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:28.380189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerStarted","Data":"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"}
Jul 12 15:45:29.227108 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:29.227069    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:29.227343 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:29.227319    2566 patch_prober.go:28] interesting pod/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 12 15:45:29.227405 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:29.227370    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 12 15:45:30.228267 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:30.228228    2566 patch_prober.go:28] interesting pod/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 12 15:45:30.228769 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:30.228287    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 12 15:45:31.227591 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:31.227547    2566 patch_prober.go:28] interesting pod/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 12 15:45:31.227779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:31.227607    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 12 15:45:32.228285 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:32.228240    2566 patch_prober.go:28] interesting pod/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 12 15:45:32.228761 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:32.228304    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 12 15:45:33.231305 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:33.231272    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:33.231779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:33.231556    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:33.232477 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:33.232459    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:45:37.114246 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:37.114209    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:45:59.213367 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:45:59.213288    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:46:12.308414 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:12.308375    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:46:33.163520 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.163481    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:46:33.164067 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.163739    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerName="maas-api" containerID="cri-o://b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49" gracePeriod=30
Jul 12 15:46:33.264050 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.264003    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.57:8443/health\": dial tcp 10.134.0.57:8443: connect: connection refused"
Jul 12 15:46:33.424649 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.424574    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:46:33.475813 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.475780    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x52sj\" (UniqueName: \"kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj\") pod \"d688e9de-7d21-4a33-bf03-50497c711b6a\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") "
Jul 12 15:46:33.476035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.475857    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca\") pod \"d688e9de-7d21-4a33-bf03-50497c711b6a\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") "
Jul 12 15:46:33.476035 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.475953    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") pod \"d688e9de-7d21-4a33-bf03-50497c711b6a\" (UID: \"d688e9de-7d21-4a33-bf03-50497c711b6a\") "
Jul 12 15:46:33.476261 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.476229    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d688e9de-7d21-4a33-bf03-50497c711b6a" (UID: "d688e9de-7d21-4a33-bf03-50497c711b6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:46:33.478080 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.478050    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj" (OuterVolumeSpecName: "kube-api-access-x52sj") pod "d688e9de-7d21-4a33-bf03-50497c711b6a" (UID: "d688e9de-7d21-4a33-bf03-50497c711b6a"). InnerVolumeSpecName "kube-api-access-x52sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:46:33.478198 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.478174    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d688e9de-7d21-4a33-bf03-50497c711b6a" (UID: "d688e9de-7d21-4a33-bf03-50497c711b6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:46:33.576777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.576740    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x52sj\" (UniqueName: \"kubernetes.io/projected/d688e9de-7d21-4a33-bf03-50497c711b6a-kube-api-access-x52sj\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:46:33.576777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.576771    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d688e9de-7d21-4a33-bf03-50497c711b6a-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:46:33.576777 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.576781    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d688e9de-7d21-4a33-bf03-50497c711b6a-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:46:33.744275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.744178    2566 generic.go:356] "Generic (PLEG): container finished" podID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerID="b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49" exitCode=0
Jul 12 15:46:33.744275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.744238    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"
Jul 12 15:46:33.744275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.744263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" event={"ID":"d688e9de-7d21-4a33-bf03-50497c711b6a","Type":"ContainerDied","Data":"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"}
Jul 12 15:46:33.744551 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.744314    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k" event={"ID":"d688e9de-7d21-4a33-bf03-50497c711b6a","Type":"ContainerDied","Data":"a2f70850d5c1f4985e0f233b3d36a79c725a0f747fc6b23022664975be3474ea"}
Jul 12 15:46:33.744551 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.744336    2566 scope.go:117] "RemoveContainer" containerID="b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"
Jul 12 15:46:33.754136 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.754114    2566 scope.go:117] "RemoveContainer" containerID="b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"
Jul 12 15:46:33.754399 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:46:33.754382    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49\": container with ID starting with b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49 not found: ID does not exist" containerID="b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"
Jul 12 15:46:33.754449 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.754408    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49"} err="failed to get container status \"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49\": rpc error: code = NotFound desc = could not find container \"b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49\": container with ID starting with b8625727e80b2154b9ababd1d35f6f97ea17463f8a16665ed67372ab3bc06a49 not found: ID does not exist"
Jul 12 15:46:33.765726 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.765697    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:46:33.768619 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:33.768595    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-eba8e3-6595578f77-n2x5k"]
Jul 12 15:46:34.873454 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:34.873414    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" path="/var/lib/kubelet/pods/d688e9de-7d21-4a33-bf03-50497c711b6a/volumes"
Jul 12 15:46:36.214633 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:46:36.214594    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:47:15.862157 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:15.862093    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:47:15.863032 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:15.862995    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" podUID="2363925e-f423-45cb-95f2-2b0622fa9d6c" containerName="maas-api" containerID="cri-o://fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3" gracePeriod=30
Jul 12 15:47:16.126814 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.126745    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:47:16.184170 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.184133    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca\") pod \"2363925e-f423-45cb-95f2-2b0622fa9d6c\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") "
Jul 12 15:47:16.184348 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.184186    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls\") pod \"2363925e-f423-45cb-95f2-2b0622fa9d6c\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") "
Jul 12 15:47:16.184348 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.184214    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btf48\" (UniqueName: \"kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48\") pod \"2363925e-f423-45cb-95f2-2b0622fa9d6c\" (UID: \"2363925e-f423-45cb-95f2-2b0622fa9d6c\") "
Jul 12 15:47:16.184518 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.184495    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2363925e-f423-45cb-95f2-2b0622fa9d6c" (UID: "2363925e-f423-45cb-95f2-2b0622fa9d6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:47:16.186330 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.186309    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48" (OuterVolumeSpecName: "kube-api-access-btf48") pod "2363925e-f423-45cb-95f2-2b0622fa9d6c" (UID: "2363925e-f423-45cb-95f2-2b0622fa9d6c"). InnerVolumeSpecName "kube-api-access-btf48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:47:16.186402 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.186383    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2363925e-f423-45cb-95f2-2b0622fa9d6c" (UID: "2363925e-f423-45cb-95f2-2b0622fa9d6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:47:16.285402 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.285364    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2363925e-f423-45cb-95f2-2b0622fa9d6c-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:16.285402 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.285400    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btf48\" (UniqueName: \"kubernetes.io/projected/2363925e-f423-45cb-95f2-2b0622fa9d6c-kube-api-access-btf48\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:16.285618 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.285415    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2363925e-f423-45cb-95f2-2b0622fa9d6c-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:16.982340 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.982300    2566 generic.go:356] "Generic (PLEG): container finished" podID="2363925e-f423-45cb-95f2-2b0622fa9d6c" containerID="fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3" exitCode=0
Jul 12 15:47:16.982759 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.982349    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"
Jul 12 15:47:16.982759 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.982380    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" event={"ID":"2363925e-f423-45cb-95f2-2b0622fa9d6c","Type":"ContainerDied","Data":"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"}
Jul 12 15:47:16.982759 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.982434    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv" event={"ID":"2363925e-f423-45cb-95f2-2b0622fa9d6c","Type":"ContainerDied","Data":"99e5153b31f0de4e53c80762ba11489dcd58459a3af5b6e34387c6c0905777a1"}
Jul 12 15:47:16.982759 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.982460    2566 scope.go:117] "RemoveContainer" containerID="fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"
Jul 12 15:47:16.992070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.992051    2566 scope.go:117] "RemoveContainer" containerID="fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"
Jul 12 15:47:16.992386 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:16.992364    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3\": container with ID starting with fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3 not found: ID does not exist" containerID="fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"
Jul 12 15:47:16.992494 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.992394    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3"} err="failed to get container status \"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3\": rpc error: code = NotFound desc = could not find container \"fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3\": container with ID starting with fb235815119c1c0b5ad6769e5aced34fc53adeb5f0db4c4fdd2b42bf18b601c3 not found: ID does not exist"
Jul 12 15:47:16.999142 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:16.999117    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:47:17.002640 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:17.002614    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6cab7d-776c7b45cf-m4blv"]
Jul 12 15:47:18.874676 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:18.874642    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2363925e-f423-45cb-95f2-2b0622fa9d6c" path="/var/lib/kubelet/pods/2363925e-f423-45cb-95f2-2b0622fa9d6c/volumes"
Jul 12 15:47:18.911369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:18.911334    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:47:21.426483 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:21.426402    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:47:21.426867 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:21.426661    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy" containerID="cri-o://2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7" gracePeriod=30
Jul 12 15:47:25.546202 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546163    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:25.546726 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546711    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2363925e-f423-45cb-95f2-2b0622fa9d6c" containerName="maas-api"
Jul 12 15:47:25.546771 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546729    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2363925e-f423-45cb-95f2-2b0622fa9d6c" containerName="maas-api"
Jul 12 15:47:25.546771 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546745    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerName="maas-api"
Jul 12 15:47:25.546771 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546753    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerName="maas-api"
Jul 12 15:47:25.546871 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546838    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d688e9de-7d21-4a33-bf03-50497c711b6a" containerName="maas-api"
Jul 12 15:47:25.546871 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.546851    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2363925e-f423-45cb-95f2-2b0622fa9d6c" containerName="maas-api"
Jul 12 15:47:25.551712 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.551675    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.554076 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.554034    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-09744e-serving-cert\""
Jul 12 15:47:25.556798 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.556767    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:25.671275 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.671240    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.671467 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.671297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.671467 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.671351    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jth6b\" (UniqueName: \"kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.772934 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.772880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.773121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.772988    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.773121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.773031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jth6b\" (UniqueName: \"kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.773203 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:25.773146    2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-09744e-serving-cert: secret "maas-api-e2e-api-a-09744e-serving-cert" not found
Jul 12 15:47:25.773241 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:25.773215    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls podName:00ae89d6-8da6-44c2-92d9-704ca735c2cd nodeName:}" failed. No retries permitted until 2026-07-12 15:47:26.273198354 +0000 UTC m=+2247.861501003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls") pod "maas-api-e2e-api-a-09744e-59975757cc-nkr5x" (UID: "00ae89d6-8da6-44c2-92d9-704ca735c2cd") : secret "maas-api-e2e-api-a-09744e-serving-cert" not found
Jul 12 15:47:25.773630 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.773611    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:25.782110 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:25.782079    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jth6b\" (UniqueName: \"kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:26.277546 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.277510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:26.279989 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.279964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") pod \"maas-api-e2e-api-a-09744e-59975757cc-nkr5x\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") " pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:26.466631 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.466585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:26.621980 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.621938    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:26.622844 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:47:26.622800    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ae89d6_8da6_44c2_92d9_704ca735c2cd.slice/crio-43360bb396f0d034731465ee0afb7a144baad09528033d0b8f6f82c59009c837 WatchSource:0}: Error finding container 43360bb396f0d034731465ee0afb7a144baad09528033d0b8f6f82c59009c837: Status 404 returned error can't find the container with id 43360bb396f0d034731465ee0afb7a144baad09528033d0b8f6f82c59009c837
Jul 12 15:47:26.691441 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.691405    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:47:26.782470 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782429    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782470 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782470    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782487    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc2pn\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782517    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782542    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782577    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782615    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782663    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.782720 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.782687    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket\") pod \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\" (UID: \"9aea2e56-02fb-4ebf-8e99-f6f461e8125e\") "
Jul 12 15:47:26.783193 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.783124    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:47:26.783277 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.783246    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:47:26.783349 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.783277    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:47:26.783405 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.783379    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:47:26.783473 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.783430    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:47:26.785093 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.785064    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn" (OuterVolumeSpecName: "kube-api-access-lc2pn") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "kube-api-access-lc2pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:47:26.785217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.785155    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:47:26.785217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.785187    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:47:26.785302 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.785229    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9aea2e56-02fb-4ebf-8e99-f6f461e8125e" (UID: "9aea2e56-02fb-4ebf-8e99-f6f461e8125e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:47:26.883629 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883606    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883629 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883629    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883639    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc2pn\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-kube-api-access-lc2pn\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883649    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883658    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883665    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883673    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883680    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:26.883760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:26.883688    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aea2e56-02fb-4ebf-8e99-f6f461e8125e-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:27.038972 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.038938    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" event={"ID":"00ae89d6-8da6-44c2-92d9-704ca735c2cd","Type":"ContainerStarted","Data":"43360bb396f0d034731465ee0afb7a144baad09528033d0b8f6f82c59009c837"}
Jul 12 15:47:27.040446 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.040416    2566 generic.go:356] "Generic (PLEG): container finished" podID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerID="2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7" exitCode=0
Jul 12 15:47:27.040573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.040467    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"
Jul 12 15:47:27.040573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.040502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerDied","Data":"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"}
Jul 12 15:47:27.040573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.040555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld" event={"ID":"9aea2e56-02fb-4ebf-8e99-f6f461e8125e","Type":"ContainerDied","Data":"969f7de5a1413bba1246207f1bb1f573cb15f1d881aac4e4466082f25d3c97f6"}
Jul 12 15:47:27.040687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.040577    2566 scope.go:117] "RemoveContainer" containerID="2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"
Jul 12 15:47:27.049929 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.049889    2566 scope.go:117] "RemoveContainer" containerID="449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"
Jul 12 15:47:27.057148 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.057117    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:47:27.059406 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.059379    2566 scope.go:117] "RemoveContainer" containerID="2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"
Jul 12 15:47:27.059774 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:27.059749    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7\": container with ID starting with 2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7 not found: ID does not exist" containerID="2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"
Jul 12 15:47:27.059861 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.059788    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7"} err="failed to get container status \"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7\": rpc error: code = NotFound desc = could not find container \"2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7\": container with ID starting with 2d9c59df3f16659a22a87a7ac960dba02f3291c0847bba520dba0990aca624a7 not found: ID does not exist"
Jul 12 15:47:27.059861 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.059813    2566 scope.go:117] "RemoveContainer" containerID="449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"
Jul 12 15:47:27.060149 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:27.060126    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3\": container with ID starting with 449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3 not found: ID does not exist" containerID="449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"
Jul 12 15:47:27.060224 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.060157    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3"} err="failed to get container status \"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3\": rpc error: code = NotFound desc = could not find container \"449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3\": container with ID starting with 449b7b2658cc507fab52044479a2ed18ad6b27dac4088356778086d2658e88e3 not found: ID does not exist"
Jul 12 15:47:27.061876 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:27.061414    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6cab7d-openshift-default-7f774b7b8f-4cmld"]
Jul 12 15:47:28.052134 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:28.052096    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" event={"ID":"00ae89d6-8da6-44c2-92d9-704ca735c2cd","Type":"ContainerStarted","Data":"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"}
Jul 12 15:47:28.052569 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:28.052198    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:28.069173 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:28.069118    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" podStartSLOduration=2.5084881230000002 podStartE2EDuration="3.069100648s" totalImagesPullingTime="560.612525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:47:28.066591148 +0000 UTC m=+2249.654893818" watchObservedRunningTime="2026-07-12 15:47:28.069100648 +0000 UTC m=+2249.657403317"
Jul 12 15:47:28.875009 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:28.874974    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" path="/var/lib/kubelet/pods/9aea2e56-02fb-4ebf-8e99-f6f461e8125e/volumes"
Jul 12 15:47:30.679922 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.679883    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:47:30.680492 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.680285    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:47:30.680492 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.680301    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:47:30.680492 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.680384    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:47:30.680492 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.680394    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:47:30.683431 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.683393    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.686297 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.686275    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c20960-openshift-default-dockercfg-k6dst\""
Jul 12 15:47:30.704937 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.704888    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:47:30.819183 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819142    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819183 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819185    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmr62\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819286    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819308    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819337    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819361    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.819434 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.819423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920087    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920146    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920170    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920204    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920341 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920268    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmr62\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920528    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920765 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920654    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920969 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920969 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920821    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.920969 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.920897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.921182 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.921163    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.921251 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.921201    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.922644 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.922619    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.923109 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.923083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.929273 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.929243    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmr62\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.929796 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.929774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token\") pod \"e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") " pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:30.993527 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:30.993425    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:31.138442 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:31.138417    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:47:31.140119 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:47:31.140077    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29eb3966_ced7_432b_9449_0b6d525188a8.slice/crio-f4484ac08d5b1d227b46b3fd438f1e02b14a14148470c53ba2ad286018a73aa2 WatchSource:0}: Error finding container f4484ac08d5b1d227b46b3fd438f1e02b14a14148470c53ba2ad286018a73aa2: Status 404 returned error can't find the container with id f4484ac08d5b1d227b46b3fd438f1e02b14a14148470c53ba2ad286018a73aa2
Jul 12 15:47:31.142259 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:31.142229    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:31.142332 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:31.142295    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:31.142332 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:31.142323    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:32.080410 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:32.080374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerStarted","Data":"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"}
Jul 12 15:47:32.080824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:32.080455    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerStarted","Data":"f4484ac08d5b1d227b46b3fd438f1e02b14a14148470c53ba2ad286018a73aa2"}
Jul 12 15:47:32.100383 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:32.100322    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podStartSLOduration=2.10030358 podStartE2EDuration="2.10030358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:47:32.097940378 +0000 UTC m=+2253.686243049" watchObservedRunningTime="2026-07-12 15:47:32.10030358 +0000 UTC m=+2253.688606250"
Jul 12 15:47:32.993688 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:32.993645    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:32.998481 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:32.998454    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:33.086044 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:33.086016    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:33.087066 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:33.087047    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:34.008900 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:34.008854    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:47:34.063785 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:34.063753    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:46.510175 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:46.510135    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:47:48.087809 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.087712    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 12 15:47:48.087809 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.087777    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 12 15:47:48.173693 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.173659    2566 generic.go:356] "Generic (PLEG): container finished" podID="29eb3966-ced7-432b-9449-0b6d525188a8" containerID="624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95" exitCode=0
Jul 12 15:47:48.173878 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.173743    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerDied","Data":"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"}
Jul 12 15:47:48.174190 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.174174    2566 scope.go:117] "RemoveContainer" containerID="624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"
Jul 12 15:47:48.175340 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.175303    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:48.175455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.175387    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:48.175455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:48.175443    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:47:49.187226 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:49.187182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerStarted","Data":"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"}
Jul 12 15:47:49.993760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:49.993694    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:49.994072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:49.994041    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 12 15:47:49.994178 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:49.994105    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 12 15:47:50.994211 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:50.994172    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 12 15:47:50.994629 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:50.994230    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 12 15:47:51.850206 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:51.850166    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:51.850733 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:51.850692    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" podUID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" containerName="maas-api" containerID="cri-o://2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd" gracePeriod=30
Jul 12 15:47:51.994624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:51.994586    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 12 15:47:51.995034 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:51.994644    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 12 15:47:52.194541 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.194515    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:52.206041 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.206006    2566 generic.go:356] "Generic (PLEG): container finished" podID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" containerID="2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd" exitCode=0
Jul 12 15:47:52.206234 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.206055    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"
Jul 12 15:47:52.206234 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.206060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" event={"ID":"00ae89d6-8da6-44c2-92d9-704ca735c2cd","Type":"ContainerDied","Data":"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"}
Jul 12 15:47:52.206234 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.206151    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x" event={"ID":"00ae89d6-8da6-44c2-92d9-704ca735c2cd","Type":"ContainerDied","Data":"43360bb396f0d034731465ee0afb7a144baad09528033d0b8f6f82c59009c837"}
Jul 12 15:47:52.206234 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.206181    2566 scope.go:117] "RemoveContainer" containerID="2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"
Jul 12 15:47:52.217563 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.217526    2566 scope.go:117] "RemoveContainer" containerID="2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"
Jul 12 15:47:52.218052 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:47:52.217984    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd\": container with ID starting with 2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd not found: ID does not exist" containerID="2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"
Jul 12 15:47:52.218052 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.218021    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd"} err="failed to get container status \"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd\": rpc error: code = NotFound desc = could not find container \"2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd\": container with ID starting with 2d8435e85f6b21520d31074165c72aacf3f1221eaee682a6fdb1fa887141dabd not found: ID does not exist"
Jul 12 15:47:52.232791 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.232745    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") pod \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") "
Jul 12 15:47:52.232978 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.232894    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca\") pod \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") "
Jul 12 15:47:52.233332 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.233301    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00ae89d6-8da6-44c2-92d9-704ca735c2cd" (UID: "00ae89d6-8da6-44c2-92d9-704ca735c2cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:47:52.233447 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.233390    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jth6b\" (UniqueName: \"kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b\") pod \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\" (UID: \"00ae89d6-8da6-44c2-92d9-704ca735c2cd\") "
Jul 12 15:47:52.233705 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.233685    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ae89d6-8da6-44c2-92d9-704ca735c2cd-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:52.235169 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.235145    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00ae89d6-8da6-44c2-92d9-704ca735c2cd" (UID: "00ae89d6-8da6-44c2-92d9-704ca735c2cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:47:52.235753 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.235731    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b" (OuterVolumeSpecName: "kube-api-access-jth6b") pod "00ae89d6-8da6-44c2-92d9-704ca735c2cd" (UID: "00ae89d6-8da6-44c2-92d9-704ca735c2cd"). InnerVolumeSpecName "kube-api-access-jth6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:47:52.334311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.334269    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jth6b\" (UniqueName: \"kubernetes.io/projected/00ae89d6-8da6-44c2-92d9-704ca735c2cd-kube-api-access-jth6b\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:52.334311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.334314    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ae89d6-8da6-44c2-92d9-704ca735c2cd-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:47:52.527945 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.527893    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:52.530190 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.530160    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-09744e-59975757cc-nkr5x"]
Jul 12 15:47:52.877840 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.877787    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" path="/var/lib/kubelet/pods/00ae89d6-8da6-44c2-92d9-704ca735c2cd/volumes"
Jul 12 15:47:52.994648 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.994611    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 12 15:47:52.995079 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:52.994667    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 12 15:47:53.998203 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:53.998168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:53.998587 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:53.998497    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:53.999450 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:53.999431    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:47:58.312996 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:47:58.312953    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:48:04.707502 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:04.707467    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:48:04.708121 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:04.707703    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" containerID="cri-o://2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb" gracePeriod=30
Jul 12 15:48:08.512404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:08.512363    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:48:09.000930 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:09.000872    2566 patch_prober.go:28] interesting pod/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:48:09.001143 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:09.000963    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:48:09.985582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:09.985539    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:48:10.101369 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101327    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101392    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101429    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101455    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101494    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101553 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101542    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101571    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmr62\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101597    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101637    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket\") pod \"29eb3966-ced7-432b-9449-0b6d525188a8\" (UID: \"29eb3966-ced7-432b-9449-0b6d525188a8\") "
Jul 12 15:48:10.101824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101802    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:48:10.102061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.101883    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:48:10.102061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.102042    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.102176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.102059    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:48:10.102176 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.102063    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.102285 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.102169    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:48:10.102285 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.102236    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:48:10.103760 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.103734    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:48:10.103896 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.103881    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:48:10.104026 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.104006    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:48:10.104080 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.104027    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62" (OuterVolumeSpecName: "kube-api-access-zmr62") pod "29eb3966-ced7-432b-9449-0b6d525188a8" (UID: "29eb3966-ced7-432b-9449-0b6d525188a8"). InnerVolumeSpecName "kube-api-access-zmr62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:48:10.202701 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202656    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.202701 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202691    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.202701 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202705    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29eb3966-ced7-432b-9449-0b6d525188a8-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.202701 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202713    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.203021 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202720    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29eb3966-ced7-432b-9449-0b6d525188a8-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.203021 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202729    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmr62\" (UniqueName: \"kubernetes.io/projected/29eb3966-ced7-432b-9449-0b6d525188a8-kube-api-access-zmr62\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.203021 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.202737    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29eb3966-ced7-432b-9449-0b6d525188a8-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:48:10.317085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.316994    2566 generic.go:356] "Generic (PLEG): container finished" podID="29eb3966-ced7-432b-9449-0b6d525188a8" containerID="2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb" exitCode=0
Jul 12 15:48:10.317085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.317050    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"
Jul 12 15:48:10.317085 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.317073    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerDied","Data":"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"}
Jul 12 15:48:10.317319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.317135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb" event={"ID":"29eb3966-ced7-432b-9449-0b6d525188a8","Type":"ContainerDied","Data":"f4484ac08d5b1d227b46b3fd438f1e02b14a14148470c53ba2ad286018a73aa2"}
Jul 12 15:48:10.317319 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.317161    2566 scope.go:117] "RemoveContainer" containerID="2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"
Jul 12 15:48:10.328386 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.328360    2566 scope.go:117] "RemoveContainer" containerID="624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"
Jul 12 15:48:10.338024 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.337997    2566 scope.go:117] "RemoveContainer" containerID="2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"
Jul 12 15:48:10.338428 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:48:10.338397    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb\": container with ID starting with 2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb not found: ID does not exist" containerID="2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"
Jul 12 15:48:10.338531 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.338440    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb"} err="failed to get container status \"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb\": rpc error: code = NotFound desc = could not find container \"2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb\": container with ID starting with 2b39e4274a8972213931005dd432fb80425ba56c5316d0a6474d422cbb9761bb not found: ID does not exist"
Jul 12 15:48:10.338531 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.338463    2566 scope.go:117] "RemoveContainer" containerID="624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"
Jul 12 15:48:10.338765 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:48:10.338744    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95\": container with ID starting with 624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95 not found: ID does not exist" containerID="624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"
Jul 12 15:48:10.338831 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.338771    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95"} err="failed to get container status \"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95\": rpc error: code = NotFound desc = could not find container \"624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95\": container with ID starting with 624ecb0cb93059ebeda314a58bc68e8711a091de3b09093bf96bba38ddd7fe95 not found: ID does not exist"
Jul 12 15:48:10.340267 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.340245    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:48:10.343891 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.343865    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c20960-openshift-default-6fbd7bbdcc-2gwcb"]
Jul 12 15:48:10.874432 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:10.874392    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" path="/var/lib/kubelet/pods/29eb3966-ced7-432b-9449-0b6d525188a8/volumes"
Jul 12 15:48:13.727595 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.727554    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:48:13.728149 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728124    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:48:13.728149 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728147    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:48:13.728299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728181    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:48:13.728299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728190    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aea2e56-02fb-4ebf-8e99-f6f461e8125e" containerName="istio-proxy"
Jul 12 15:48:13.728299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728203    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" containerName="maas-api"
Jul 12 15:48:13.728299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728211    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" containerName="maas-api"
Jul 12 15:48:13.728299 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728296    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ae89d6-8da6-44c2-92d9-704ca735c2cd" containerName="maas-api"
Jul 12 15:48:13.728491 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728310    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:48:13.728491 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.728322    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:48:13.733334 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.733309    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.735440 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.735413    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b08e9f-openshift-default-dockercfg-kwbv2\""
Jul 12 15:48:13.741567 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.741538    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:48:13.840656 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.840656 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7f59\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.840883 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840684    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.840883 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840759    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.840883 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.840883 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840876    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.841045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.841045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.841045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.840986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.941726 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.941686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.941726 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.941729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942001 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.941865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942001 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.941968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942073 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942073 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7f59\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942073 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942061    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942207 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942360 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942236    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942360 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942297    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942360 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.942826 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.942801    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.944520 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.944490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.944645 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.944570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.950554 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.950528    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:13.950767 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:13.950743    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7f59\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59\") pod \"e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") " pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:14.045525 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.045419    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:14.196180 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.196149    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:48:14.197457 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:48:14.197431    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f2e30d_0b29_46a3_8281_ce748dbdbe6b.slice/crio-e2268f4e911101a6d46d1acba033bfd5ad55c1e32a4893dbe1c9e3df843ebc3f WatchSource:0}: Error finding container e2268f4e911101a6d46d1acba033bfd5ad55c1e32a4893dbe1c9e3df843ebc3f: Status 404 returned error can't find the container with id e2268f4e911101a6d46d1acba033bfd5ad55c1e32a4893dbe1c9e3df843ebc3f
Jul 12 15:48:14.199574 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.199538    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:14.199687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.199612    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:14.199687 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.199641    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:14.346045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.345946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerStarted","Data":"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"}
Jul 12 15:48:14.346045 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.346016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerStarted","Data":"e2268f4e911101a6d46d1acba033bfd5ad55c1e32a4893dbe1c9e3df843ebc3f"}
Jul 12 15:48:14.365412 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:14.365215    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podStartSLOduration=1.36518769 podStartE2EDuration="1.36518769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:48:14.364597414 +0000 UTC m=+2295.952900084" watchObservedRunningTime="2026-07-12 15:48:14.36518769 +0000 UTC m=+2295.953490362"
Jul 12 15:48:15.046178 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:15.046140    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:15.051678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:15.051643    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:15.356810 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:15.353936    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:15.358039 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:15.358005    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:20.115152 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:20.115106    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:48:28.432825 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.432786    2566 generic.go:356] "Generic (PLEG): container finished" podID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerID="9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37" exitCode=0
Jul 12 15:48:28.433339 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.432860    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerDied","Data":"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"}
Jul 12 15:48:28.433339 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.433309    2566 scope.go:117] "RemoveContainer" containerID="9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"
Jul 12 15:48:28.434364 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.434334    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:28.434422 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.434407    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:28.434461 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:28.434442    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 15:48:29.449882 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:29.449836    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerStarted","Data":"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"}
Jul 12 15:48:30.046603 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:30.046572    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:30.047677 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:30.047646    2566 patch_prober.go:28] interesting pod/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 12 15:48:30.047810 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:30.047710    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 12 15:48:30.353971 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:30.353923    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:31.045802 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:31.045764    2566 patch_prober.go:28] interesting pod/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 12 15:48:31.046280 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:31.045821    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 12 15:48:32.046651 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:32.046613    2566 patch_prober.go:28] interesting pod/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 12 15:48:32.047129 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:32.046667    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 12 15:48:33.045856 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:33.045805    2566 patch_prober.go:28] interesting pod/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 12 15:48:33.046096 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:33.045896    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 12 15:48:34.050308 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:34.050270    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:34.051376 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:34.051358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:48:34.708740 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:34.708703    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:48:54.709251 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:48:54.709151    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:49:17.613409 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:49:17.613369    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:49:35.116991 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:49:35.116953    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:49:48.207464 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:49:48.207422    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:49:58.973167 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:49:58.973133    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:49:58.986624 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:49:58.986598    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw7v4_d5ec9889-71dd-4db1-b58b-a13af72f5505/ovn-acl-logging/0.log"
Jul 12 15:50:02.314814 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:50:02.314778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:50:16.211728 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:50:16.211688    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:50:29.513465 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:50:29.513375    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:50:47.218531 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:50:47.218489    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:51:04.416981 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:51:04.416941    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:51:22.321173 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:51:22.321133    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:51:36.418669 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:51:36.418626    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:51:56.912705 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:51:56.912625    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:52:17.306592 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:52:17.306549    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:52:32.110358 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:52:32.110318    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:52:46.721729 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:52:46.721688    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:53:04.507686 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:53:04.507642    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:53:15.613199 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:53:15.613149    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:53:56.706253 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:53:56.706203    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2868v"]
Jul 12 15:54:00.353890 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:00.353851    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:54:00.354421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:00.354107    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" containerID="cri-o://5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183" gracePeriod=30
Jul 12 15:54:04.052686 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:04.052647    2566 patch_prober.go:28] interesting pod/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:54:04.053166 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:04.052732    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:54:05.346982 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.346939    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nvkhs_997fe393-76dd-4227-902d-959809aeca13/manager/0.log"
Jul 12 15:54:05.465543 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.465497    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sqrdq_f3cd2b45-6feb-4370-8438-188d37de643c/manager/0.log"
Jul 12 15:54:05.583312 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.583281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d597d4445-gdwsz_547ee43e-257a-49ce-b8ee-ab9b136d91a8/maas-api/0.log"
Jul 12 15:54:05.623573 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.623549    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:54:05.697440 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697405    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697454    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697492    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697513    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697647 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697586    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697717    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697759    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7f59\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.697870 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697832    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.698061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697886    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data\") pod \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\" (UID: \"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b\") "
Jul 12 15:54:05.698061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.697897    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:54:05.698061 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698027    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:54:05.698220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698060    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:54:05.698220 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698204    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:54:05.698404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698382    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.698404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698405    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.698582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698418    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.698582 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698432    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.699004 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.698980    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:54:05.699990 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.699971    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 15:54:05.700064 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.699972    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:54:05.700162 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.700137    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:54:05.700247 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.700188    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59" (OuterVolumeSpecName: "kube-api-access-d7f59") pod "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" (UID: "d4f2e30d-0b29-46a3-8281-ce748dbdbe6b"). InnerVolumeSpecName "kube-api-access-d7f59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:54:05.799361 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.799322    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.799361 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.799356    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.799361 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.799366    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7f59\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-kube-api-access-d7f59\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.799613 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.799374    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:05.799613 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:05.799385    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 12 15:54:06.038789 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.038706    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f6txg_809bd374-64a8-439a-8136-fb8d9d13b759/server/0.log"
Jul 12 15:54:06.167405 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.167372    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x9qjw_b74f5c53-42ca-47e8-8122-87c3d62774e5/manager/0.log"
Jul 12 15:54:06.303948 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.303833    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5d6cd7fc-hztjr_d8b30e77-3207-42cc-9be6-8c7c7aa21248/manager/0.log"
Jul 12 15:54:06.313147 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.313117    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5d6cd7fc-hztjr_d8b30e77-3207-42cc-9be6-8c7c7aa21248/copy-manifests/0.log"
Jul 12 15:54:06.339509 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.339472    2566 generic.go:356] "Generic (PLEG): container finished" podID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerID="5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183" exitCode=0
Jul 12 15:54:06.339678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.339521    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"
Jul 12 15:54:06.339678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.339546    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerDied","Data":"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"}
Jul 12 15:54:06.339678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.339595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t" event={"ID":"d4f2e30d-0b29-46a3-8281-ce748dbdbe6b","Type":"ContainerDied","Data":"e2268f4e911101a6d46d1acba033bfd5ad55c1e32a4893dbe1c9e3df843ebc3f"}
Jul 12 15:54:06.339678 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.339617    2566 scope.go:117] "RemoveContainer" containerID="5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"
Jul 12 15:54:06.349438 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.349412    2566 scope.go:117] "RemoveContainer" containerID="9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"
Jul 12 15:54:06.358543 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.358517    2566 scope.go:117] "RemoveContainer" containerID="5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"
Jul 12 15:54:06.359138 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:54:06.359113    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183\": container with ID starting with 5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183 not found: ID does not exist" containerID="5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"
Jul 12 15:54:06.359256 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.359146    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183"} err="failed to get container status \"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183\": rpc error: code = NotFound desc = could not find container \"5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183\": container with ID starting with 5749b355d9aa91dd216880cf344d1e343b8b87ac2e328032eaabc17f30686183 not found: ID does not exist"
Jul 12 15:54:06.359256 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.359167    2566 scope.go:117] "RemoveContainer" containerID="9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"
Jul 12 15:54:06.359459 ip-10-0-138-45 kubenswrapper[2566]: E0712 15:54:06.359437    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37\": container with ID starting with 9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37 not found: ID does not exist" containerID="9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"
Jul 12 15:54:06.359507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.359464    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37"} err="failed to get container status \"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37\": rpc error: code = NotFound desc = could not find container \"9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37\": container with ID starting with 9fc36a36b8d07330ec4a8916981e6004804673297ff471cc3b8fb9d57736dc37 not found: ID does not exist"
Jul 12 15:54:06.361217 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.361195    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:54:06.368869 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.368834    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b08e9f-openshift-default-757569dc5f-lts8t"]
Jul 12 15:54:06.873674 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:06.873640    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" path="/var/lib/kubelet/pods/d4f2e30d-0b29-46a3-8281-ce748dbdbe6b/volumes"
Jul 12 15:54:07.406391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.406362    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/util/0.log"
Jul 12 15:54:07.412766 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.412740    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/pull/0.log"
Jul 12 15:54:07.418662 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.418619    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/extract/0.log"
Jul 12 15:54:07.526263 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.526232    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/util/0.log"
Jul 12 15:54:07.533339 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.533316    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/pull/0.log"
Jul 12 15:54:07.539861 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.539832    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/extract/0.log"
Jul 12 15:54:07.654926 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.654879    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/util/0.log"
Jul 12 15:54:07.661618 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.661521    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/pull/0.log"
Jul 12 15:54:07.667809 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.667775    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/extract/0.log"
Jul 12 15:54:07.775281 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.775247    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/util/0.log"
Jul 12 15:54:07.781896 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.781864    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/pull/0.log"
Jul 12 15:54:07.788461 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:07.788434    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/extract/0.log"
Jul 12 15:54:08.039476 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:08.039374    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dlggn_6b1cf3f0-2d1d-4092-8b59-4f813a069483/manager/0.log"
Jul 12 15:54:08.154814 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:08.154785    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvscb_955ac129-9df9-4c72-be7a-43b5d5dba1c9/manager/0.log"
Jul 12 15:54:08.373808 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:08.373768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-79hfh_24ee4ef8-bcb7-4a57-a694-6f78156ceebd/registry-server/0.log"
Jul 12 15:54:08.495391 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:08.495354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-69429_0359bdbf-5952-40aa-958e-07ed670564c7/manager/0.log"
Jul 12 15:54:08.602567 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:08.602536    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2868v_ea6e18c2-6067-478d-a198-09b0e2b247dd/limitador/0.log"
Jul 12 15:54:09.373529 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:09.373496    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd5b5f7f7-7pxp5_1e4fbbfc-9c9e-48b3-a5ad-26761640138e/kube-auth-proxy/0.log"
Jul 12 15:54:09.492146 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:09.492091    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/1.log"
Jul 12 15:54:09.719152 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:09.719064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ctmcs_4238ead9-f041-40d5-9e76-d756cd55d6ad/payload-processing/0.log"
Jul 12 15:54:10.372290 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:10.372254    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nxns9_2e0eb10a-af76-427b-a6d4-ed756620f1f4/main/0.log"
Jul 12 15:54:10.693832 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:10.693742    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vp2j2_728c12e6-87a1-405f-bd41-88d7b9638f18/main/0.log"
Jul 12 15:54:14.293346 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293305    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n8bdw/must-gather-8p4cb"]
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293677    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293688    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="29eb3966-ced7-432b-9449-0b6d525188a8" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293706    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293713    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293720    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293727    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.293788 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293786    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.294037 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.293897    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f2e30d-0b29-46a3-8281-ce748dbdbe6b" containerName="istio-proxy"
Jul 12 15:54:14.297388 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.297363    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.299545 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.299518    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n8bdw\"/\"kube-root-ca.crt\""
Jul 12 15:54:14.300455 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.300426    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n8bdw\"/\"openshift-service-ca.crt\""
Jul 12 15:54:14.300561 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.300426    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n8bdw\"/\"default-dockercfg-fmjlr\""
Jul 12 15:54:14.305348 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.305249    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n8bdw/must-gather-8p4cb"]
Jul 12 15:54:14.479625 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.479577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzsw\" (UniqueName: \"kubernetes.io/projected/be4c3397-c1ee-4021-9a60-f8870d4d0290-kube-api-access-jzzsw\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.479815 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.479636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be4c3397-c1ee-4021-9a60-f8870d4d0290-must-gather-output\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.580943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.580802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzsw\" (UniqueName: \"kubernetes.io/projected/be4c3397-c1ee-4021-9a60-f8870d4d0290-kube-api-access-jzzsw\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.580943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.580861    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be4c3397-c1ee-4021-9a60-f8870d4d0290-must-gather-output\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.581260 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.581239    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be4c3397-c1ee-4021-9a60-f8870d4d0290-must-gather-output\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.588904 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.588876    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzsw\" (UniqueName: \"kubernetes.io/projected/be4c3397-c1ee-4021-9a60-f8870d4d0290-kube-api-access-jzzsw\") pod \"must-gather-8p4cb\" (UID: \"be4c3397-c1ee-4021-9a60-f8870d4d0290\") " pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.608653 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.608611    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n8bdw/must-gather-8p4cb"
Jul 12 15:54:14.748507 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.748475    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n8bdw/must-gather-8p4cb"]
Jul 12 15:54:14.751343 ip-10-0-138-45 kubenswrapper[2566]: W0712 15:54:14.751314    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe4c3397_c1ee_4021_9a60_f8870d4d0290.slice/crio-07045c0f7c1e51c8107630d46c8a0edd14c36c96a98b642107802a0decc1c29a WatchSource:0}: Error finding container 07045c0f7c1e51c8107630d46c8a0edd14c36c96a98b642107802a0decc1c29a: Status 404 returned error can't find the container with id 07045c0f7c1e51c8107630d46c8a0edd14c36c96a98b642107802a0decc1c29a
Jul 12 15:54:14.753409 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:14.753389    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:54:15.392817 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:15.392764    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n8bdw/must-gather-8p4cb" event={"ID":"be4c3397-c1ee-4021-9a60-f8870d4d0290","Type":"ContainerStarted","Data":"07045c0f7c1e51c8107630d46c8a0edd14c36c96a98b642107802a0decc1c29a"}
Jul 12 15:54:16.401464 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:16.401426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n8bdw/must-gather-8p4cb" event={"ID":"be4c3397-c1ee-4021-9a60-f8870d4d0290","Type":"ContainerStarted","Data":"aac5723c3a8b3bbee1226b89a36dcf426a598be8379a5e6eacb034d8221c7872"}
Jul 12 15:54:16.401868 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:16.401473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n8bdw/must-gather-8p4cb" event={"ID":"be4c3397-c1ee-4021-9a60-f8870d4d0290","Type":"ContainerStarted","Data":"31252ea7e2dc6d5cfca05a88053cd8609466f5464be0b64027cb5f8a39b48161"}
Jul 12 15:54:16.417859 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:16.417804    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n8bdw/must-gather-8p4cb" podStartSLOduration=1.611098235 podStartE2EDuration="2.417784446s" totalImagesPullingTime="806.686211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:54:16.415430755 +0000 UTC m=+2658.003733417" watchObservedRunningTime="2026-07-12 15:54:16.417784446 +0000 UTC m=+2658.006087160"
Jul 12 15:54:17.227075 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:17.227039    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sf9rb_8b7bcb8e-c765-4d7b-88fd-a0b74f1be294/global-pull-secret-syncer/0.log"
Jul 12 15:54:17.318676 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:17.318642    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jtkbp_493d9fa1-5dc3-4efe-ac4f-f622004dd01d/konnectivity-agent/0.log"
Jul 12 15:54:17.397586 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:17.397534    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-45.ec2.internal_924e98b1f4b0eb6dc6bf4bc5f8376614/haproxy/0.log"
Jul 12 15:54:22.404483 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.404426    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/extract/0.log"
Jul 12 15:54:22.429110 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.429072    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/util/0.log"
Jul 12 15:54:22.458242 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.458206    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k5wmf_e70f32d1-c347-42e2-b005-4d715426ccd7/pull/0.log"
Jul 12 15:54:22.490313 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.490283    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/extract/0.log"
Jul 12 15:54:22.523837 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.523808    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/util/0.log"
Jul 12 15:54:22.547713 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.547666    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xnjwr_8220ca47-d382-4e18-a310-0a6791394996/pull/0.log"
Jul 12 15:54:22.575740 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.575636    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/extract/0.log"
Jul 12 15:54:22.604707 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.604519    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/util/0.log"
Jul 12 15:54:22.624215 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.624189    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x9q7_a7d3603b-ff9d-413f-8ba1-e71fa15a273e/pull/0.log"
Jul 12 15:54:22.671894 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.671786    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/extract/0.log"
Jul 12 15:54:22.694046 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.694020    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/util/0.log"
Jul 12 15:54:22.718271 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:22.718221    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14fkjd_79c018aa-a93c-44a2-b8cf-d4eb2344a137/pull/0.log"
Jul 12 15:54:23.040421 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:23.040319    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dlggn_6b1cf3f0-2d1d-4092-8b59-4f813a069483/manager/0.log"
Jul 12 15:54:23.067879 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:23.067841    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvscb_955ac129-9df9-4c72-be7a-43b5d5dba1c9/manager/0.log"
Jul 12 15:54:23.135639 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:23.135596    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-79hfh_24ee4ef8-bcb7-4a57-a694-6f78156ceebd/registry-server/0.log"
Jul 12 15:54:23.276025 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:23.274367    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-69429_0359bdbf-5952-40aa-958e-07ed670564c7/manager/0.log"
Jul 12 15:54:23.306677 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:23.306598    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2868v_ea6e18c2-6067-478d-a198-09b0e2b247dd/limitador/0.log"
Jul 12 15:54:25.346310 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:25.346215    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67fb5f8449-nlr9t_d98fedbd-2fdd-4ca5-895e-bb96020a89d5/metrics-server/0.log"
Jul 12 15:54:25.553375 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:25.553346    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrbn6_52884b6e-b27d-484f-bdc0-d0054391ab0d/node-exporter/0.log"
Jul 12 15:54:25.575287 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:25.575250    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrbn6_52884b6e-b27d-484f-bdc0-d0054391ab0d/kube-rbac-proxy/0.log"
Jul 12 15:54:25.602897 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:25.602867    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrbn6_52884b6e-b27d-484f-bdc0-d0054391ab0d/init-textfile/0.log"
Jul 12 15:54:28.107504 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.107464    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"]
Jul 12 15:54:28.116519 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.116486    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.120871 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.120831    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"]
Jul 12 15:54:28.229924 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.229852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-proc\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.230133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.230024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwvv\" (UniqueName: \"kubernetes.io/projected/d6d87356-0c80-4ec7-beba-e45320f35011-kube-api-access-lgwvv\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.230133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.230060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-sys\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.230133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.230119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-podres\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.230311 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.230278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-lib-modules\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.331704 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.331655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-proc\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.331935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.331742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwvv\" (UniqueName: \"kubernetes.io/projected/d6d87356-0c80-4ec7-beba-e45320f35011-kube-api-access-lgwvv\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.331935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.331778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-sys\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.331935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.331808    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-podres\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.331935 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.331883    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-lib-modules\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.332200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.332089    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-lib-modules\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.332200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.332157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-proc\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.332570 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.332542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-sys\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.332670 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.332649    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6d87356-0c80-4ec7-beba-e45320f35011-podres\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.340140 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.340107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwvv\" (UniqueName: \"kubernetes.io/projected/d6d87356-0c80-4ec7-beba-e45320f35011-kube-api-access-lgwvv\") pod \"perf-node-gather-daemonset-67cxr\" (UID: \"d6d87356-0c80-4ec7-beba-e45320f35011\") " pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.432875 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.432775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:28.484136 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.484091    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-mrk45_de5d418d-f154-4197-ab71-39ac528f66d2/download-server/0.log"
Jul 12 15:54:28.622404 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:28.622364    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"]
Jul 12 15:54:29.506602 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:29.506563    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr" event={"ID":"d6d87356-0c80-4ec7-beba-e45320f35011","Type":"ContainerStarted","Data":"c69057792071b60ded468afa68e14b6405d5cc065e7b4b1b1c41b59de8511d5a"}
Jul 12 15:54:29.507074 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:29.506622    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr" event={"ID":"d6d87356-0c80-4ec7-beba-e45320f35011","Type":"ContainerStarted","Data":"59cccbc5b3010ea9f19f16f8351811091c8eb85ec2f6e5fc189d6b0c92e922f2"}
Jul 12 15:54:29.507074 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:29.506723    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:29.523779 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:29.523722    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr" podStartSLOduration=1.523705353 podStartE2EDuration="1.523705353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:54:29.520173724 +0000 UTC m=+2671.108476395" watchObservedRunningTime="2026-07-12 15:54:29.523705353 +0000 UTC m=+2671.112008015"
Jul 12 15:54:30.115999 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:30.115954    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lvpkx_d8c61357-21b2-4fd2-8ebc-a65c9711d147/dns/0.log"
Jul 12 15:54:30.135489 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:30.135457    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lvpkx_d8c61357-21b2-4fd2-8ebc-a65c9711d147/kube-rbac-proxy/0.log"
Jul 12 15:54:30.228721 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:30.228693    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6tc7_9cc54b52-fc61-4de7-a089-9b9937e543a7/dns-node-resolver/0.log"
Jul 12 15:54:30.811456 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:30.811399    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6648cd57f9-jbvqz_1e6e6304-79ed-499b-ae7d-66785fa8837e/registry/0.log"
Jul 12 15:54:30.879067 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:30.879033    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhlnq_3cdd46fa-6c30-49f5-97fb-259a7f7cc2e2/node-ca/0.log"
Jul 12 15:54:32.050830 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:32.050789    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd5b5f7f7-7pxp5_1e4fbbfc-9c9e-48b3-a5ad-26761640138e/kube-auth-proxy/0.log"
Jul 12 15:54:32.081134 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:32.081099    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/0.log"
Jul 12 15:54:32.146733 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:32.146702    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/1.log"
Jul 12 15:54:32.251200 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:32.251168    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ctmcs_4238ead9-f041-40d5-9e76-d756cd55d6ad/payload-processing/0.log"
Jul 12 15:54:33.003943 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:33.003901    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njj2d_acf0c703-efa6-40f1-b941-658bb39adb7d/serve-healthcheck-canary/0.log"
Jul 12 15:54:33.546441 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:33.546407    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsg7b_7f1853d8-5758-4aae-8f64-f190e1e149e2/kube-rbac-proxy/0.log"
Jul 12 15:54:33.566070 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:33.566040    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsg7b_7f1853d8-5758-4aae-8f64-f190e1e149e2/exporter/0.log"
Jul 12 15:54:33.587270 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:33.587241    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsg7b_7f1853d8-5758-4aae-8f64-f190e1e149e2/extractor/0.log"
Jul 12 15:54:35.533834 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:35.533799    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n8bdw/perf-node-gather-daemonset-67cxr"
Jul 12 15:54:35.746450 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:35.746417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nvkhs_997fe393-76dd-4227-902d-959809aeca13/manager/0.log"
Jul 12 15:54:36.012824 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.012721    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sqrdq_f3cd2b45-6feb-4370-8438-188d37de643c/manager/0.log"
Jul 12 15:54:36.067133 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.067096    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d597d4445-gdwsz_547ee43e-257a-49ce-b8ee-ab9b136d91a8/maas-api/0.log"
Jul 12 15:54:36.285072 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.284983    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f6txg_809bd374-64a8-439a-8136-fb8d9d13b759/server/0.log"
Jul 12 15:54:36.396112 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.396081    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x9qjw_b74f5c53-42ca-47e8-8122-87c3d62774e5/manager/0.log"
Jul 12 15:54:36.524944 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.524883    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5d6cd7fc-hztjr_d8b30e77-3207-42cc-9be6-8c7c7aa21248/manager/0.log"
Jul 12 15:54:36.541933 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:36.541817    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5d6cd7fc-hztjr_d8b30e77-3207-42cc-9be6-8c7c7aa21248/copy-manifests/0.log"
Jul 12 15:54:38.255174 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:38.255121    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tj5vm_06699e09-2996-4408-97fe-bd08ed4853dd/openshift-lws-operator/0.log"
Jul 12 15:54:39.435855 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:39.435823    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd5b5f7f7-7pxp5_1e4fbbfc-9c9e-48b3-a5ad-26761640138e/kube-auth-proxy/0.log"
Jul 12 15:54:39.456316 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:39.456267    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/0.log"
Jul 12 15:54:39.520657 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:39.520628    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/1.log"
Jul 12 15:54:39.622973 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:39.622938    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ctmcs_4238ead9-f041-40d5-9e76-d756cd55d6ad/payload-processing/0.log"
Jul 12 15:54:41.045660 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:41.045620    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd5b5f7f7-7pxp5_1e4fbbfc-9c9e-48b3-a5ad-26761640138e/kube-auth-proxy/0.log"
Jul 12 15:54:41.073598 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:41.073562    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/0.log"
Jul 12 15:54:41.129940 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:41.129885    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-95bfs_61d3c1ec-85f0-433d-9b11-64a0c2832246/istio-proxy/1.log"
Jul 12 15:54:41.225139 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:41.225101    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ctmcs_4238ead9-f041-40d5-9e76-d756cd55d6ad/payload-processing/0.log"
Jul 12 15:54:44.801978 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:44.801928    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8qnrn_bfe1207e-5c58-4dba-be20-84a62d4ac136/kube-multus/0.log"
Jul 12 15:54:44.981846 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:44.981818    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/kube-multus-additional-cni-plugins/0.log"
Jul 12 15:54:45.004448 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.004416    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/egress-router-binary-copy/0.log"
Jul 12 15:54:45.025601 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.025569    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/cni-plugins/0.log"
Jul 12 15:54:45.048766 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.048732    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/bond-cni-plugin/0.log"
Jul 12 15:54:45.069967 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.069861    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/routeoverride-cni/0.log"
Jul 12 15:54:45.091815 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.091774    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/whereabouts-cni-bincopy/0.log"
Jul 12 15:54:45.113098 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.113068    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmtm7_baea5b3f-7f02-4c1c-912d-428842eaabae/whereabouts-cni/0.log"
Jul 12 15:54:45.395209 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.395158    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66nfc_072e7fce-1980-4b06-bac5-d74a9c1ff062/network-metrics-daemon/0.log"
Jul 12 15:54:45.411308 ip-10-0-138-45 kubenswrapper[2566]: I0712 15:54:45.411277    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66nfc_072e7fce-1980-4b06-bac5-d74a9c1ff062/kube-rbac-proxy/0.log"